Jul 08 17:14:17.274830 ip-10-0-133-199 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 17:14:17.274844 ip-10-0-133-199 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 17:14:17.274854 ip-10-0-133-199 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 17:14:17.275205 ip-10-0-133-199 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 17:14:27.319105 ip-10-0-133-199 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 17:14:27.319121 ip-10-0-133-199 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 363fd6bc082847e68db469ccaf6f7f9d --
Jul 08 17:16:04.954518 ip-10-0-133-199 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 17:16:05.406994 ip-10-0-133-199 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 17:16:05.406994 ip-10-0-133-199 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 17:16:05.406994 ip-10-0-133-199 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 17:16:05.406994 ip-10-0-133-199 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 17:16:05.406994 ip-10-0-133-199 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 17:16:05.408192 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.408100    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 17:16:05.416179 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416164    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416180    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416184    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416187    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416190    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416194    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416197    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416199    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416202    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416205    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416208    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416211    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416214    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416216    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416219    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416222    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:16:05.416217 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416224    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416227    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416230    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416237    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416240    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416242    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416245    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416247    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416250    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416252    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416254    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416257    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416260    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416262    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416279    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416282    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416285    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416291    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416294    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416296    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:16:05.416606 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416299    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416301    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416303    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416306    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416308    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416311    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416313    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416316    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416319    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416322    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416324    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416327    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416329    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416331    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416335    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416337    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416340    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416344    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416348    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:16:05.417079 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416351    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416353    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416356    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416359    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416361    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416364    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416366    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416369    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416371    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416373    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416376    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416378    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416381    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416384    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416386    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416388    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416391    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416394    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416396    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416399    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:16:05.417545 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416402    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416407    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416411    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416415    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416417    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416420    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416423    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416426    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416429    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416431    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416434    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416438    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416441    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416444    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416447    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416449    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416452    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416454    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416457    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:16:05.418017 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416459    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416461    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416464    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416466    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.416469    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417199    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417206    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417208    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417211    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417214    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417217    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417219    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417222    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417226    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417229    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417231    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417235    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417237    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417240    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417243    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:16:05.418597 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417245    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417248    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417251    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417253    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417256    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417258    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417260    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417263    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417282    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417285    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417288    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417290    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417293    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417295    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417300    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417305    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417308    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417311    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417313    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:16:05.419102 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417316    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417319    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417321    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417323    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417327    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417329    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417332    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417335    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417338    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417341    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417344    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417346    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417349    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417353    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417356    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417358    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417361    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417363    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417366    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417368    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:16:05.419581 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417371    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417373    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417376    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417378    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417380    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417383    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417385    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417388    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417390    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417395    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417398    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417401    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417404    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417407    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417409    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417412    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417414    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417418    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417422    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:16:05.420066 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417424    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417427    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417430    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417433    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417435    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417437    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417440    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417443    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417446    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417450    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417452    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417454    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417457    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417460    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417462    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417465    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417468    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417470    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417473    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417475    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:16:05.420526 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417477    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417480    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417482    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417485    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417487    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417490    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417889    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417895    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417898    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417901    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417905    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417908    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417912    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417914    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417917    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417920    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417923    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417926    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417929    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:16:05.421003 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417931    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417935    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417940    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417944    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417947    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417950    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417953    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417956    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417958    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417961    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417964    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417966    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417969    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417972    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417975    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417977    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417979    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417982    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417985    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:16:05.421514 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417987    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417989    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417992    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417994    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.417999    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418003    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418005    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418008    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418010    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418013    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418015    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418017    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418020    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418023    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418026    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418028    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418031    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418033    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418036    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418038    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:16:05.421954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418040    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418043    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418045    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418048    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418050    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418053    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418056    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418059    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418062    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418065    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418068    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418070    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418073    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418075    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418078    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418080    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418085    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418087    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418090    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418092    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:16:05.422442 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418095    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418097    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418100    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418102    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418106    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418108    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418111    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418113    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418116    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418118    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418120    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418123    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418125    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418127    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418130    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418132    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418135    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418137    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418139    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418142    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:16:05.422954 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418144    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418146    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418149    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418151    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418154    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418156    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418159    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418225    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418234    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418240    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418244    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418249    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418252    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418256    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418260    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418263    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418280    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418283    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418287    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418290    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418292    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418295    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418298    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 08 17:16:05.423454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418301    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418304    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418308    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418311    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418314    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418317    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418320    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418324    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418327    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418329    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418333    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418335    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418338    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418341    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418344    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418347    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418351    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418358    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418361    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418364    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418366    2578 flags.go:64] FLAG: --enable-server="true"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418370    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418375    2578 flags.go:64] FLAG: --event-burst="100"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418378    2578 flags.go:64] FLAG: --event-qps="50"
Jul 08 17:16:05.423996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418381    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418384    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418387    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418390    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418393    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418396    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418399    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418401    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418404    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418407    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418410    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418413    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418415    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418418    2578 flags.go:64] FLAG: --feature-gates=""
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418422    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418425    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418428    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418431    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418433    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418436    2578 flags.go:64] FLAG: --help="false"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418439    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418442    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418445    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 17:16:05.424609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418447    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418451    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418457    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418459    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418462    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418465    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418468    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418471    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418474    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418477    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418480    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418482    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418485    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418488    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418490    2578 flags.go:64] FLAG: --lock-file=""
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418493    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418496    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418499    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418504    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418507    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418509    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418512    2578 flags.go:64] FLAG: --logging-format="text"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418515    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418519    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 17:16:05.425175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418521    2578 flags.go:64] FLAG: --manifest-url=""
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418524    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418528    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418531    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418535    2578 flags.go:64] FLAG: --max-pods="110"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418546    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418551    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418554    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418557    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418560    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418564    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418567    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418574    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418577    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418580    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418583    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418586    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418591    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418594    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418597    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418600    2578 flags.go:64] FLAG: --port="10250"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418603    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418607    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b24edc02adedd724"
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418610    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 08 17:16:05.425845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418613    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418616    2578 flags.go:64] FLAG: --register-node="true"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418618    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418622    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418624    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418627    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418630    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418633    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418636    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418639    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418642    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418645    2578 flags.go:64] FLAG: --runonce="false"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418648    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418651    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418654    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418656    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418659    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418662    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418665    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418669    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418672    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418675    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418677    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418680    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418683    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 17:16:05.426451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418686    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418689    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418694    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418697    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418699    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418703    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418706    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418708    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418711    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418714    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418717    2578 flags.go:64] FLAG: --v="2"
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418721    2578 flags.go:64] FLAG: --version="false"
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418724    2578 flags.go:64] FLAG: --vmodule=""
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418727    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.418730    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418858    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418863    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418866    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418869    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418871    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418874    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418876    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418879    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:16:05.427050 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418882    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418884    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418888    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418891    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418893    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418896    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418898    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418901    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418904    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418906    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418909    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418912    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418914    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418917    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418919    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418922    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418924    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418927    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418931    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418934    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:16:05.427828 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418937    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418940    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418944    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418947    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418950    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418953    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418955    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418958    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418961    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418964    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418966    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418968    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418971    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418973    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418976    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418979    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418981    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418984    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418986    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:16:05.428572 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418989    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418991    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418993    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418996    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.418998    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419001    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419003    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419006    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419008    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419010    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419013    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419015    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419017    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419021    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419025    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419028    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419031    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419033    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419036    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:16:05.429028 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419038    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419041    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419043    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419046    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419048    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419050    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419053    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419055    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419058    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419061    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419063    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419066    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419068    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419071    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419073    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419076    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419078    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419080    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419083    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419086    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:16:05.429691 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419088    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419090    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419093    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419095    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419097    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419100    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419102    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419105    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419108    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419111    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419113    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419116    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.419118    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.420077    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.426845    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 17:16:05.430391 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.426859    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.426875    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.426881    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426937    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426941    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426945    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426948    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426951    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426954    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426956    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426959    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426962    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426967    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426970    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426972    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426975    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426977    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426980    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426983    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:16:05.430831 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426985    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426988    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426991    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426993    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426996    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.426998    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427001    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427005    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427008    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427011    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427015    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427019    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427022    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427026    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427029    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427031    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427034    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427036    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427039    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:16:05.431621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427042    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427044    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427047    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427050    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427052    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427055    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427058    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427060    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427063    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427065    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427068    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427070    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427073    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427075    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427078    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427080    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427082    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427085    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427087    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427089    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:16:05.432109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427092    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427094    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427097    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427099    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427102    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427104    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427107    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427110    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427113    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427115    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427118    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427120    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427122    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427125    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427127    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427130    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427132    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427134    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427137    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427139    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:16:05.432610 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427142    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427144    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427146    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427149    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427151    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427153    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427156    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427158    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427160    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427163    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427165    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427168    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427170    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427172    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427175    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427177    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427180    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427182    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427186    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427188    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:16:05.433092 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427191    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427194    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427196    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427199    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.427204    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.427468    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429252    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429394    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429402    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429407    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429412    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429417    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429421    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429426    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429431    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:16:05.433805 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429435    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429439    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429444    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429448    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429453    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429457    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429461    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429465    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429469    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429475    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429479    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429483    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429488    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429493    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429497    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429501    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429505    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429510    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429514    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429518    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:16:05.434192 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429523    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429527    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429531    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429537    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429542    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429548    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429554    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429558    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429562    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429567    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429571    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429576    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429581    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429585    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429589    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429593    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429597    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429601    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429605    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:16:05.434824 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429609    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429614    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429618    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429622    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429629    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429635    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429640    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429644    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429649    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429653    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429657    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429661    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429666    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429670    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429674    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429679    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429684    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429688    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429692    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:16:05.435334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429696    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429700    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429704    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429707    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429712    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429715    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429720    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429724    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429728    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429732    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429736    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429740    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429744    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429748    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429752    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429756    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429760    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429764    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429769    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429773    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:16:05.435792 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429777    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429781    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429785    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429789    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429793    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429798    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429802    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429806    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429810    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429817    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:05.429822    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.429831    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.429994    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.434508    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 17:16:05.436348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.436216    2578 server.go:1019] "Starting client certificate rotation"
Jul 08 17:16:05.436700 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.436302    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 17:16:05.436700 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.436337    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 17:16:05.440249 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.440234    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 17:16:05.441478 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.441459    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 17:16:05.450921 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.450904    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 08 17:16:05.453380 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.453363    2578 log.go:25] "Validated CRI v1 image API"
Jul 08 17:16:05.454722 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.454707    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 17:16:05.457572 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.457556    2578 fs.go:135] Filesystem UUIDs: map[65f9cbb4-407b-4f5f-beef-9ddeb3ddee5d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c6278258-8d2a-42ee-a0db-e8a3d6df46d4:/dev/nvme0n1p4]
Jul 08 17:16:05.457621 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.457573    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 17:16:05.462904 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.462794    2578 manager.go:216] Machine: {Timestamp:2026-07-08 17:16:05.461058774 +0000 UTC m=+0.383650119 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3050020 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b8dd57d71d70077b681da7760f9f SystemUUID:ec24b8dd-57d7-1d70-077b-681da7760f9f BootID:363fd6bc-0828-47e6-8db4-69ccaf6f7f9d Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:a1:7d:81:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:a1:7d:81:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:c1:aa:fc:bb:f9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 17:16:05.462904 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.462899    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 17:16:05.463011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.462968    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 17:16:05.467731 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.467709    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 17:16:05.467858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.467736    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 17:16:05.468507 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.468497    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 17:16:05.468543 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.468510    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 17:16:05.468543 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.468517    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 17:16:05.468543 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.468531    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 17:16:05.470071 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.470060    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 17:16:05.472867 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.472852    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 17:16:05.473598 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.473586    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 17:16:05.473710 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.473701    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 17:16:05.473740 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.473734    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 17:16:05.473774 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.473744    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 17:16:05.473774 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.473757    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 17:16:05.473774 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.473766    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 08 17:16:05.473849 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.473776    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 17:16:05.474089 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.474075    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 17:16:05.474154 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.474095    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 17:16:05.478078 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.478055    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 17:16:05.481368 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.481356    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 17:16:05.481415 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.481385    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 17:16:05.482929 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482917    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 17:16:05.482969 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482934    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 17:16:05.482969 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482940    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 17:16:05.482969 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482946    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 17:16:05.482969 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482955    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 17:16:05.482969 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482960    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 17:16:05.482969 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482968    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 17:16:05.483118 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482974    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 17:16:05.483118 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482981    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 17:16:05.483118 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482986    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 17:16:05.483118 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482994    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 17:16:05.483118 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.482999    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 17:16:05.484074 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.484056    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 17:16:05.484114 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.484057    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 17:16:05.485173 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.485161    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 17:16:05.485210 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.485175    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 17:16:05.488138 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.488124    2578 server.go:1268] "Started kubelet"
Jul 08 17:16:05.488225 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.488193    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 17:16:05.488293 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.488234    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 17:16:05.488341 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.488313    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 17:16:05.488853 ip-10-0-133-199 systemd[1]: Started Kubernetes Kubelet.
Jul 08 17:16:05.490522 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.490504    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 17:16:05.490966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.490948    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 17:16:05.493064 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.493042    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 17:16:05.495011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.494998    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 17:16:05.496501 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.495013    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6abd3e992  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.488101778 +0000 UTC m=+0.410693125,LastTimestamp:2026-07-08 17:16:05.488101778 +0000 UTC m=+0.410693125,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.499284 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.499248    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 17:16:05.499596 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.499373    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:05.499596 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.499251    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 17:16:05.500208 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.500192    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 17:16:05.500208 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.500205    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 17:16:05.500345 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.500218    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 17:16:05.500345 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.500343    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 17:16:05.500410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.500350    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 17:16:05.502655 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.502638    2578 factory.go:55] Registering systemd factory
Jul 08 17:16:05.502655 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.502657    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 08 17:16:05.502914 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.502899    2578 factory.go:153] Registering CRI-O factory
Jul 08 17:16:05.502914 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.502915    2578 factory.go:223] Registration of the crio container factory successfully
Jul 08 17:16:05.503020 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.502969    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 17:16:05.503020 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.502991    2578 factory.go:103] Registering Raw factory
Jul 08 17:16:05.503020 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.503006    2578 manager.go:1196] Started watching for new ooms in manager
Jul 08 17:16:05.503370 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.503359    2578 manager.go:349] Starting recovery of all containers
Jul 08 17:16:05.506059 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.506025    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 17:16:05.506140 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.506057    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 17:16:05.513181 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.513166    2578 manager.go:354] Recovery completed
Jul 08 17:16:05.516610 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.516585    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 08 17:16:05.520429 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.520322    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:05.522170 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.522142    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:05.522240 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.522183    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:05.522240 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.522193    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:05.522729 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.522716    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 17:16:05.522793 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.522730    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 17:16:05.522793 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.522750    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 17:16:05.522858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.522723    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:05.523511 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.523495    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:05.523548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.523525    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:05.523548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.523537    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:05.524350 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.524338    2578 policy_none.go:49] "None policy: Start"
Jul 08 17:16:05.524412 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.524356    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 17:16:05.524412 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.524371    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 17:16:05.524631 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.524552    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6addbc17a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-199.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.522170234 +0000 UTC m=+0.444761583,LastTimestamp:2026-07-08 17:16:05.522170234 +0000 UTC m=+0.444761583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.525779 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.525765    2578 policy_none.go:47] "Start"
Jul 08 17:16:05.535708 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.535636    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6addc0784  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-199.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.522188164 +0000 UTC m=+0.444779510,LastTimestamp:2026-07-08 17:16:05.522188164 +0000 UTC m=+0.444779510,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.547286 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.547210    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6addc404f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-199.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.522202703 +0000 UTC m=+0.444794049,LastTimestamp:2026-07-08 17:16:05.522202703 +0000 UTC m=+0.444794049,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.559179 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.559020    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-199.ec2.internal.18c05ff6addbc17a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6addbc17a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-199.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.522170234 +0000 UTC m=+0.444761583,LastTimestamp:2026-07-08 17:16:05.523511461 +0000 UTC m=+0.446102807,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.568004 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.567992    2578 manager.go:337] "Starting Device Plugin manager"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.568019    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.568028    2578 server.go:87] "Starting device plugin registration server"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.568247    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.568258    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.568350    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.568432    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.568440    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.568913    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.568962    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.571738    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-199.ec2.internal.18c05ff6addc0784\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6addc0784  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-199.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.522188164 +0000 UTC m=+0.444779510,LastTimestamp:2026-07-08 17:16:05.523530354 +0000 UTC m=+0.446121702,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.580494    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-199.ec2.internal.18c05ff6addc404f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6addc404f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-199.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.522202703 +0000 UTC m=+0.444794049,LastTimestamp:2026-07-08 17:16:05.523540745 +0000 UTC m=+0.446132091,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.582363    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.583649    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.583678    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.583700    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 17:16:05.586798 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.583732    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 17:16:05.589652 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.589634    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 08 17:16:05.589918 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.589860    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6b11b5fdd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.576671197 +0000 UTC m=+0.499262530,LastTimestamp:2026-07-08 17:16:05.576671197 +0000 UTC m=+0.499262530,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.592980 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.592964    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vbfjj"
Jul 08 17:16:05.611336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.611316    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vbfjj"
Jul 08 17:16:05.668866 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.668795    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:05.669780 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.669763    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:05.669871 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.669796    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:05.669871 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.669810    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:05.669871 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.669833    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.672832 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.672727    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-199.ec2.internal.18c05ff6addbc17a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-199.ec2.internal.18c05ff6addbc17a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-199.ec2.internal,UID:ip-10-0-133-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-199.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-199.ec2.internal,},FirstTimestamp:2026-07-08 17:16:05.522170234 +0000 UTC m=+0.444761583,LastTimestamp:2026-07-08 17:16:05.66977969 +0000 UTC m=+0.592371035,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-199.ec2.internal,}"
Jul 08 17:16:05.684123 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.684099    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"]
Jul 08 17:16:05.684222 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.684161    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:05.684992 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.684979    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:05.685048 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.685005    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:05.685048 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.685015    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:05.686416 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.686403    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:05.686486 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.686456    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-133-199.ec2.internal\" not found" node="ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.686533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.686506    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.686533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.686529    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:05.687158 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.687142    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:05.687242 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.687166    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:05.687242 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.687185    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:05.687523 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.687506    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:05.687613 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.687537    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:05.687613 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.687548    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:05.688889 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.688876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.688937 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.688902    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:05.689626 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.689609    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:05.689699 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.689636    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:05.689699 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.689650    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:05.701842 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.701821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305c93c2da02a622ea57fe13cd2a7200-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal\" (UID: \"305c93c2da02a622ea57fe13cd2a7200\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.701922 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.701845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305c93c2da02a622ea57fe13cd2a7200-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal\" (UID: \"305c93c2da02a622ea57fe13cd2a7200\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.701922 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.701863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96cd401c532546b6d9df4d9d4f78a0b0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-199.ec2.internal\" (UID: \"96cd401c532546b6d9df4d9d4f78a0b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.711870 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.711852    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-199.ec2.internal\" not found" node="ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.716134 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.716120    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-199.ec2.internal\" not found" node="ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.727314 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.727300    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-199.ec2.internal\" not found" node="ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.802396 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.802364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96cd401c532546b6d9df4d9d4f78a0b0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-199.ec2.internal\" (UID: \"96cd401c532546b6d9df4d9d4f78a0b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.802514 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.802400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305c93c2da02a622ea57fe13cd2a7200-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal\" (UID: \"305c93c2da02a622ea57fe13cd2a7200\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.802514 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.802420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305c93c2da02a622ea57fe13cd2a7200-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal\" (UID: \"305c93c2da02a622ea57fe13cd2a7200\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.802514 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.802445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96cd401c532546b6d9df4d9d4f78a0b0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-199.ec2.internal\" (UID: \"96cd401c532546b6d9df4d9d4f78a0b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.802514 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.802459    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305c93c2da02a622ea57fe13cd2a7200-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal\" (UID: \"305c93c2da02a622ea57fe13cd2a7200\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.802514 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.802462    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305c93c2da02a622ea57fe13cd2a7200-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal\" (UID: \"305c93c2da02a622ea57fe13cd2a7200\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.887110 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.887088    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:05.888157 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.888143    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:05.888226 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.888180    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:05.888226 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.888193    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:05.888226 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.888219    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.905499 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:05.905481    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-199.ec2.internal"
Jul 08 17:16:05.905548 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.905503    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-199.ec2.internal\": node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:05.953014 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:05.952946    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:06.015555 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.015528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:06.020926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.020638    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:06.053240 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:06.053216    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:06.153741 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:06.153705    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:06.254345 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:06.254252    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:06.353370 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.353336    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:16:06.355384 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:06.355369    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:06.435612 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.435563    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 17:16:06.436084 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.435725    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 17:16:06.455874 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:06.455845    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:06.526347 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.526253    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:16:06.556251 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:06.556222    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-199.ec2.internal\" not found"
Jul 08 17:16:06.586118 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:06.586085    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cd401c532546b6d9df4d9d4f78a0b0.slice/crio-17af244312c55768d566a0cfdea5d6794d018763d6876229302c732d16249c35 WatchSource:0}: Error finding container 17af244312c55768d566a0cfdea5d6794d018763d6876229302c732d16249c35: Status 404 returned error can't find the container with id 17af244312c55768d566a0cfdea5d6794d018763d6876229302c732d16249c35
Jul 08 17:16:06.589223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.589206    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:16:06.613464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.613433    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:11:06 +0000 UTC" deadline="2027-12-04 11:35:22.811591028 +0000 UTC"
Jul 08 17:16:06.613552 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.613475    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12330h19m16.198136557s"
Jul 08 17:16:06.631597 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.631574    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:16:06.632596 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.632579    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:16:06.632691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.632616    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:16:06.632691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.632631    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:16:06.637940 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.636665    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:16:06.642636 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.642620    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:16:06.700180 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.700144    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:06.725445 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.725419    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 17:16:06.726575 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.726560    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal"
Jul 08 17:16:06.758079 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:06.758056    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 17:16:06.829091 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:06.829070    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305c93c2da02a622ea57fe13cd2a7200.slice/crio-721bda4c4967e5cbe63e569a991d506dc3eddf65b229f55735ccb7a7ace15a1b WatchSource:0}: Error finding container 721bda4c4967e5cbe63e569a991d506dc3eddf65b229f55735ccb7a7ace15a1b: Status 404 returned error can't find the container with id 721bda4c4967e5cbe63e569a991d506dc3eddf65b229f55735ccb7a7ace15a1b
Jul 08 17:16:07.474877 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.474855    2578 apiserver.go:52] "Watching apiserver"
Jul 08 17:16:07.486663 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.486639    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 17:16:07.487010 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.486988    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5xwp6","kube-system/konnectivity-agent-kb96p","openshift-dns/node-resolver-fssdf","openshift-multus/multus-tpdks","openshift-multus/network-metrics-daemon-sbjfl","openshift-network-operator/iptables-alerter-sd4lm","openshift-ovn-kubernetes/ovnkube-node-vcdkn","kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226","openshift-cluster-node-tuning-operator/tuned-d9x4k","openshift-image-registry/node-ca-7tvgb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal","openshift-multus/multus-additional-cni-plugins-crtjf","openshift-network-diagnostics/network-check-target-ftq5c"]
Jul 08 17:16:07.488544 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.488531    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.489694 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.489661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:07.490835 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.490819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.491991 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.491969    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.492075 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.492025    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:07.493242 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.493218    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:07.493361 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.493321    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:07.494511 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.494492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:07.494620 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.494537    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:07.495878 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.495859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.497157 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.497137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.498198 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.498174    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 17:16:07.498369 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.498339    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 17:16:07.498452 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.498426    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 17:16:07.499410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.498678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.499410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.498839    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 17:16:07.499410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.498891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dx27l\""
Jul 08 17:16:07.499410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.498913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nhhw5\""
Jul 08 17:16:07.499410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.498989    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 17:16:07.499410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.499161    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 17:16:07.499410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.499236    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 17:16:07.499410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.499365    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z6zr8\""
Jul 08 17:16:07.499747 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.499438    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 17:16:07.500126 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.500106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.500230 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.500211    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 17:16:07.501574 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.501557    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.502913 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.502896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.505768 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.505746    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 17:16:07.507091 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.507072    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 17:16:07.507192 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.507176    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 17:16:07.507429 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.507413    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 17:16:07.507763 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.507580    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 17:16:07.507763 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.507582    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f84z5\""
Jul 08 17:16:07.507907 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.507604    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 17:16:07.511711 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.511694    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dzkmk\""
Jul 08 17:16:07.512131 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.512114    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 17:16:07.514788 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.514757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-os-release\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.514855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.514806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03561e29-0643-488e-8533-0eacfe4ac2e5-cni-binary-copy\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.514855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.514834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cni-binary-copy\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.514942 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.514870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-system-cni-dir\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.514942 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.514902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-ovn\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.514942 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.514935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-systemd\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.515090 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-sys\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.515320 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:07.515419 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/487ac603-2929-4959-a10b-5d6a8e332a85-serviceca\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.515457 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-cnibin\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.515663 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-k8s-cni-cncf-io\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.515707 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-node-log\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.515827 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fad3367b-2fd7-472a-a236-e4e95f32b840-agent-certs\") pod \"konnectivity-agent-kb96p\" (UID: \"fad3367b-2fd7-472a-a236-e4e95f32b840\") " pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:07.515868 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-log-socket\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.515925 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-socket-dir-parent\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.515961 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.515994 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.515978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-host\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.516038 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.516087 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgvj6\" (UniqueName: \"kubernetes.io/projected/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-kube-api-access-bgvj6\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.516132 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x6mn\" (UniqueName: \"kubernetes.io/projected/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-kube-api-access-4x6mn\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.516267 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.516303 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-tmp-dir\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.516336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-sys-fs\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.516398 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-kubelet\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.516453 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.516493 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cnibin\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.516530 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-socket-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.516563 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvtcg\" (UniqueName: \"kubernetes.io/projected/487ac603-2929-4959-a10b-5d6a8e332a85-kube-api-access-kvtcg\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.516597 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-cni-multus\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.516629 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.516662 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovnkube-script-lib\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.516697 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-modprobe-d\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.516729 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-hosts-file\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.516759 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.516789 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-systemd\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.516821 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-cni-bin\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.516856 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-var-lib-kubelet\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.516888 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:07.516921 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-device-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.516953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-cni-bin\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.516986 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.516961    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljrcq\" (UniqueName: \"kubernetes.io/projected/03561e29-0643-488e-8533-0eacfe4ac2e5-kube-api-access-ljrcq\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.517048 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-kubelet\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517081 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovnkube-config\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517111 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-env-overrides\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517146 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-lib-modules\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.517180 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-os-release\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.517213 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517246 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-cni-netd\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517246 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-tuned\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.517310 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-registration-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.517310 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-conf-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.517386 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-slash\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517386 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysconfig\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.517490 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.517524 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fad3367b-2fd7-472a-a236-e4e95f32b840-konnectivity-ca\") pod \"konnectivity-agent-kb96p\" (UID: \"fad3367b-2fd7-472a-a236-e4e95f32b840\") " pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:07.517559 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/487ac603-2929-4959-a10b-5d6a8e332a85-host\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.517589 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-daemon-config\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.517621 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-var-lib-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517654 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-etc-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517689 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysctl-d\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.517722 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-run\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.517754 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-tmp\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.517823 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517763    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpmhn\" (UniqueName: \"kubernetes.io/projected/415dbdf2-8539-4bc1-905c-6ba73835e0f6-kube-api-access-xpmhn\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.517823 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-kubelet-config\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.517906 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-hostroot\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.517906 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-run-netns\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.517906 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gf8c\" (UniqueName: \"kubernetes.io/projected/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-kube-api-access-9gf8c\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.518001 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.518001 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-cni-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.518001 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-etc-kubernetes\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.518001 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.517995    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-systemd-units\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.518119 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysctl-conf\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.518119 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjhx\" (UniqueName: \"kubernetes.io/projected/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-kube-api-access-xpjhx\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.518119 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qf2v\" (UniqueName: \"kubernetes.io/projected/49a1850c-d280-45ac-b710-07f9ba7846af-kube-api-access-8qf2v\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:07.518209 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.518209 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-netns\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.518389 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-multus-certs\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.518427 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-kubernetes\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.518461 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-dbus\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.518493 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.518470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-system-cni-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.520187 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520158    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fbpzc\""
Jul 08 17:16:07.520324 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520210    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 17:16:07.520324 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520206    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 17:16:07.520324 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520226    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 17:16:07.520501 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520461    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 17:16:07.520768 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 17:16:07.520890 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520862    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 17:16:07.521007 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520920    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g7g8p\""
Jul 08 17:16:07.521007 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520980    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 17:16:07.521124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520925    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 17:16:07.521124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.520997    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 17:16:07.521124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.521117    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 17:16:07.521273 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.521142    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zwx7r\""
Jul 08 17:16:07.521420 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.521404    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 17:16:07.524443 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.524421    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 17:16:07.524954 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.524923    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-phxbx\""
Jul 08 17:16:07.554900 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.554503    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 17:16:07.589320 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.589266    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal" event={"ID":"305c93c2da02a622ea57fe13cd2a7200","Type":"ContainerStarted","Data":"721bda4c4967e5cbe63e569a991d506dc3eddf65b229f55735ccb7a7ace15a1b"}
Jul 08 17:16:07.590673 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.590649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal" event={"ID":"96cd401c532546b6d9df4d9d4f78a0b0","Type":"ContainerStarted","Data":"17af244312c55768d566a0cfdea5d6794d018763d6876229302c732d16249c35"}
Jul 08 17:16:07.599135 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.599076    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zr27t"
Jul 08 17:16:07.601611 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.601589    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 17:16:07.619427 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-host\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.619427 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619418    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-host\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.619590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.619590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgvj6\" (UniqueName: \"kubernetes.io/projected/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-kube-api-access-bgvj6\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.619590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x6mn\" (UniqueName: \"kubernetes.io/projected/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-kube-api-access-4x6mn\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.619590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.619590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-tmp-dir\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.619590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-sys-fs\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.619590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-kubelet\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfd82851-b81b-47a9-aafe-97ab640a7377-host-slash\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cnibin\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-socket-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvtcg\" (UniqueName: \"kubernetes.io/projected/487ac603-2929-4959-a10b-5d6a8e332a85-kube-api-access-kvtcg\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-cni-multus\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovnkube-script-lib\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-modprobe-d\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-hosts-file\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-systemd\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619880    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-sys-fs\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619886    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-cni-bin\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619924    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-cni-multus\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.619966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619930    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cnibin\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-hosts-file\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-cni-bin\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619891    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-systemd\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.619976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-var-lib-kubelet\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620046    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-socket-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620081    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-modprobe-d\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620104    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-device-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620144    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-cni-bin\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620158    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620174    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-tmp-dir\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620196    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-cni-bin\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620206    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-var-lib-kubelet\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620215    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-device-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620215    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.620803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620243    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-var-lib-kubelet\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljrcq\" (UniqueName: \"kubernetes.io/projected/03561e29-0643-488e-8533-0eacfe4ac2e5-kube-api-access-ljrcq\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-kubelet\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.620291    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovnkube-config\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-env-overrides\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.620415    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:16:08.120389499 +0000 UTC m=+3.042980851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-lib-modules\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620456    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-kubelet\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620557    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-lib-modules\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-os-release\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-cni-netd\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cfd82851-b81b-47a9-aafe-97ab640a7377-iptables-alerter-script\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620757    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbnt2\" (UniqueName: \"kubernetes.io/projected/cfd82851-b81b-47a9-aafe-97ab640a7377-kube-api-access-mbnt2\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620782    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovnkube-script-lib\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.621799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620789    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-os-release\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-tuned\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620815    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-cni-netd\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620839    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-env-overrides\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-registration-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-conf-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620926    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovnkube-config\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-slash\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620961    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-conf-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.620975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysconfig\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621001    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-registration-dir\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621004    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-slash\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621058    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysconfig\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fad3367b-2fd7-472a-a236-e4e95f32b840-konnectivity-ca\") pod \"konnectivity-agent-kb96p\" (UID: \"fad3367b-2fd7-472a-a236-e4e95f32b840\") " pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/487ac603-2929-4959-a10b-5d6a8e332a85-host\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-daemon-config\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621174    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/487ac603-2929-4959-a10b-5d6a8e332a85-host\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.622719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-var-lib-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621215    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/415dbdf2-8539-4bc1-905c-6ba73835e0f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-etc-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621230    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-var-lib-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysctl-d\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-run\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621421    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-etc-openvswitch\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-tmp\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpmhn\" (UniqueName: \"kubernetes.io/projected/415dbdf2-8539-4bc1-905c-6ba73835e0f6-kube-api-access-xpmhn\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-kubelet-config\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-hostroot\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-run-netns\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gf8c\" (UniqueName: \"kubernetes.io/projected/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-kube-api-access-9gf8c\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysctl-d\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621752    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-run-netns\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621740    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-hostroot\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-cni-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.623691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-etc-kubernetes\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.621829    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621831    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fad3367b-2fd7-472a-a236-e4e95f32b840-konnectivity-ca\") pod \"konnectivity-agent-kb96p\" (UID: \"fad3367b-2fd7-472a-a236-e4e95f32b840\") " pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-systemd-units\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysctl-conf\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.621905    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret podName:591bcf3a-6a57-4037-a724-4f5bbdbf9fbb nodeName:}" failed. No retries permitted until 2026-07-08 17:16:08.121884993 +0000 UTC m=+3.044476328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret") pod "global-pull-secret-syncer-5xwp6" (UID: "591bcf3a-6a57-4037-a724-4f5bbdbf9fbb") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621903    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-kubelet-config\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621754    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-daemon-config\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621956    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-cni-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621974    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-run\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.621977    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-sysctl-conf\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622021    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-etc-kubernetes\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjhx\" (UniqueName: \"kubernetes.io/projected/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-kube-api-access-xpjhx\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622056    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-systemd-units\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qf2v\" (UniqueName: \"kubernetes.io/projected/49a1850c-d280-45ac-b710-07f9ba7846af-kube-api-access-8qf2v\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-netns\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.624630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-multus-certs\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-kubernetes\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-dbus\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-system-cni-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-os-release\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03561e29-0643-488e-8533-0eacfe4ac2e5-cni-binary-copy\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cni-binary-copy\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-system-cni-dir\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622559    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-multus-certs\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-ovn\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-systemd\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-sys\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622752    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-os-release\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622757    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622798    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-systemd\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622818    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-system-cni-dir\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622750    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-run-ovn\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.625537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/487ac603-2929-4959-a10b-5d6a8e332a85-serviceca\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-cnibin\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-k8s-cni-cncf-io\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-node-log\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.622977    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-system-cni-dir\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623024    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03561e29-0643-488e-8533-0eacfe4ac2e5-cni-binary-copy\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623032    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-dbus\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fad3367b-2fd7-472a-a236-e4e95f32b840-agent-certs\") pod \"konnectivity-agent-kb96p\" (UID: \"fad3367b-2fd7-472a-a236-e4e95f32b840\") " pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623065    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-netns\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-log-socket\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623092    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-kubernetes\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623104    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-log-socket\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-socket-dir-parent\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623146    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-multus-socket-dir-parent\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623159    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-node-log\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623224    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-cnibin\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623287    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.626258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623403    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-sys\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.627152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623439    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03561e29-0643-488e-8533-0eacfe4ac2e5-host-run-k8s-cni-cncf-io\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.627152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623526    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-cni-binary-copy\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.627152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.623597    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/487ac603-2929-4959-a10b-5d6a8e332a85-serviceca\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.627152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.624695    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-tmp\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.627152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.624939    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.627152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.625147    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-etc-tuned\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.627152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.626004    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fad3367b-2fd7-472a-a236-e4e95f32b840-agent-certs\") pod \"konnectivity-agent-kb96p\" (UID: \"fad3367b-2fd7-472a-a236-e4e95f32b840\") " pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:07.631943 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.631921    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zr27t"
Jul 08 17:16:07.640516 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.640495    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x6mn\" (UniqueName: \"kubernetes.io/projected/2e24ac31-4e4a-4848-8c74-b3c6c3828f37-kube-api-access-4x6mn\") pod \"ovnkube-node-vcdkn\" (UID: \"2e24ac31-4e4a-4848-8c74-b3c6c3828f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.644476 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.644458    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:16:07.644476 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.644477    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:16:07.644639 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.644488    2578 projected.go:196] Error preparing data for projected volume kube-api-access-hxtt9 for pod openshift-network-diagnostics/network-check-target-ftq5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:07.644639 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:07.644545    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9 podName:b8e037f8-de64-4bf0-9830-a6e1523ac8b8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:08.14453101 +0000 UTC m=+3.067122344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hxtt9" (UniqueName: "kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9") pod "network-check-target-ftq5c" (UID: "b8e037f8-de64-4bf0-9830-a6e1523ac8b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:07.646729 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.646665    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjhx\" (UniqueName: \"kubernetes.io/projected/c829c92f-1f23-4a1d-8eae-a2dc5eaa9123-kube-api-access-xpjhx\") pod \"tuned-d9x4k\" (UID: \"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123\") " pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.647265 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.647244    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpmhn\" (UniqueName: \"kubernetes.io/projected/415dbdf2-8539-4bc1-905c-6ba73835e0f6-kube-api-access-xpmhn\") pod \"aws-ebs-csi-driver-node-h9226\" (UID: \"415dbdf2-8539-4bc1-905c-6ba73835e0f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.648110 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.648088    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gf8c\" (UniqueName: \"kubernetes.io/projected/4b6a09c6-44cb-4149-b8e5-8b99e432c7eb-kube-api-access-9gf8c\") pod \"node-resolver-fssdf\" (UID: \"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb\") " pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.648877 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.648856    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljrcq\" (UniqueName: \"kubernetes.io/projected/03561e29-0643-488e-8533-0eacfe4ac2e5-kube-api-access-ljrcq\") pod \"multus-tpdks\" (UID: \"03561e29-0643-488e-8533-0eacfe4ac2e5\") " pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.649777 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.649756    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgvj6\" (UniqueName: \"kubernetes.io/projected/5d3e1142-3ba9-4444-8d23-f08949a2ac8d-kube-api-access-bgvj6\") pod \"multus-additional-cni-plugins-crtjf\" (UID: \"5d3e1142-3ba9-4444-8d23-f08949a2ac8d\") " pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.652755 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.652731    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvtcg\" (UniqueName: \"kubernetes.io/projected/487ac603-2929-4959-a10b-5d6a8e332a85-kube-api-access-kvtcg\") pod \"node-ca-7tvgb\" (UID: \"487ac603-2929-4959-a10b-5d6a8e332a85\") " pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.656954 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.656928    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qf2v\" (UniqueName: \"kubernetes.io/projected/49a1850c-d280-45ac-b710-07f9ba7846af-kube-api-access-8qf2v\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:07.724363 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.724335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfd82851-b81b-47a9-aafe-97ab640a7377-host-slash\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.724456 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.724383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cfd82851-b81b-47a9-aafe-97ab640a7377-iptables-alerter-script\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.724456 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.724407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbnt2\" (UniqueName: \"kubernetes.io/projected/cfd82851-b81b-47a9-aafe-97ab640a7377-kube-api-access-mbnt2\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.724529 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.724455    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfd82851-b81b-47a9-aafe-97ab640a7377-host-slash\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.724824 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.724807    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cfd82851-b81b-47a9-aafe-97ab640a7377-iptables-alerter-script\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.740091 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.740072    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbnt2\" (UniqueName: \"kubernetes.io/projected/cfd82851-b81b-47a9-aafe-97ab640a7377-kube-api-access-mbnt2\") pod \"iptables-alerter-sd4lm\" (UID: \"cfd82851-b81b-47a9-aafe-97ab640a7377\") " pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.799658 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.799628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d9x4k"
Jul 08 17:16:07.806811 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.806718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:07.810172 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.810146    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc829c92f_1f23_4a1d_8eae_a2dc5eaa9123.slice/crio-61d636ffb83afbd2e5007613c5f71fd385c20499e7b5aaadf0d510e620463db0 WatchSource:0}: Error finding container 61d636ffb83afbd2e5007613c5f71fd385c20499e7b5aaadf0d510e620463db0: Status 404 returned error can't find the container with id 61d636ffb83afbd2e5007613c5f71fd385c20499e7b5aaadf0d510e620463db0
Jul 08 17:16:07.815101 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.815077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fssdf"
Jul 08 17:16:07.816460 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.816435    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad3367b_2fd7_472a_a236_e4e95f32b840.slice/crio-59a89147525f167b4cf33f60566d07247838652699b59028744f72abdc03f6c0 WatchSource:0}: Error finding container 59a89147525f167b4cf33f60566d07247838652699b59028744f72abdc03f6c0: Status 404 returned error can't find the container with id 59a89147525f167b4cf33f60566d07247838652699b59028744f72abdc03f6c0
Jul 08 17:16:07.827544 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.827521    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6a09c6_44cb_4149_b8e5_8b99e432c7eb.slice/crio-1a2c1c4fe33c02c2f55ffbe76c00f06253cfd58a2f6b760d6547e4f266b57409 WatchSource:0}: Error finding container 1a2c1c4fe33c02c2f55ffbe76c00f06253cfd58a2f6b760d6547e4f266b57409: Status 404 returned error can't find the container with id 1a2c1c4fe33c02c2f55ffbe76c00f06253cfd58a2f6b760d6547e4f266b57409
Jul 08 17:16:07.828066 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.828044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-crtjf"
Jul 08 17:16:07.836391 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.836367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7tvgb"
Jul 08 17:16:07.837237 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.837212    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3e1142_3ba9_4444_8d23_f08949a2ac8d.slice/crio-4650f7f11c76538cc26ee57775168aff65adddbea0270f03be5bf4aab63f5bc5 WatchSource:0}: Error finding container 4650f7f11c76538cc26ee57775168aff65adddbea0270f03be5bf4aab63f5bc5: Status 404 returned error can't find the container with id 4650f7f11c76538cc26ee57775168aff65adddbea0270f03be5bf4aab63f5bc5
Jul 08 17:16:07.843199 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.843161    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226"
Jul 08 17:16:07.844631 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.844604    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487ac603_2929_4959_a10b_5d6a8e332a85.slice/crio-ddd613ba46a5f7826f9e840a4663ff4880929ba67e97cd5295ea4fa81d6d810f WatchSource:0}: Error finding container ddd613ba46a5f7826f9e840a4663ff4880929ba67e97cd5295ea4fa81d6d810f: Status 404 returned error can't find the container with id ddd613ba46a5f7826f9e840a4663ff4880929ba67e97cd5295ea4fa81d6d810f
Jul 08 17:16:07.852426 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.852397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tpdks"
Jul 08 17:16:07.852852 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.852831    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415dbdf2_8539_4bc1_905c_6ba73835e0f6.slice/crio-5f97ad44bd2ec7afa3ae231de08bc3f2ca6f76e8ae03b70344f360ef20aceb96 WatchSource:0}: Error finding container 5f97ad44bd2ec7afa3ae231de08bc3f2ca6f76e8ae03b70344f360ef20aceb96: Status 404 returned error can't find the container with id 5f97ad44bd2ec7afa3ae231de08bc3f2ca6f76e8ae03b70344f360ef20aceb96
Jul 08 17:16:07.858679 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.858656    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:07.860390 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.860367    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03561e29_0643_488e_8533_0eacfe4ac2e5.slice/crio-52bf4ecde9240f9c23d184c217c0a90f1b6b674f52e63463d7365fabcbedd168 WatchSource:0}: Error finding container 52bf4ecde9240f9c23d184c217c0a90f1b6b674f52e63463d7365fabcbedd168: Status 404 returned error can't find the container with id 52bf4ecde9240f9c23d184c217c0a90f1b6b674f52e63463d7365fabcbedd168
Jul 08 17:16:07.864551 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:07.864530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sd4lm"
Jul 08 17:16:07.869735 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.869712    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e24ac31_4e4a_4848_8c74_b3c6c3828f37.slice/crio-aecf9fe890af8b261da5dabe392746eb219b7029f7623ccda8ed7ce0c38a258a WatchSource:0}: Error finding container aecf9fe890af8b261da5dabe392746eb219b7029f7623ccda8ed7ce0c38a258a: Status 404 returned error can't find the container with id aecf9fe890af8b261da5dabe392746eb219b7029f7623ccda8ed7ce0c38a258a
Jul 08 17:16:07.875708 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:07.875685    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd82851_b81b_47a9_aafe_97ab640a7377.slice/crio-26c0f90316fc19023b5344d1fcaf697520f8b5c64c2cae348bcf53618ceb7417 WatchSource:0}: Error finding container 26c0f90316fc19023b5344d1fcaf697520f8b5c64c2cae348bcf53618ceb7417: Status 404 returned error can't find the container with id 26c0f90316fc19023b5344d1fcaf697520f8b5c64c2cae348bcf53618ceb7417
Jul 08 17:16:08.128335 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.128230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:08.128335 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.128319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:08.128558 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.128436    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:08.128558 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.128483    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:16:09.128469678 +0000 UTC m=+4.051061012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:08.128920 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.128826    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:08.128920 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.128894    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret podName:591bcf3a-6a57-4037-a724-4f5bbdbf9fbb nodeName:}" failed. No retries permitted until 2026-07-08 17:16:09.128879258 +0000 UTC m=+4.051470597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret") pod "global-pull-secret-syncer-5xwp6" (UID: "591bcf3a-6a57-4037-a724-4f5bbdbf9fbb") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:08.228639 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.228610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:08.228787 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.228734    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:16:08.228787 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.228746    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:16:08.228787 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.228756    2578 projected.go:196] Error preparing data for projected volume kube-api-access-hxtt9 for pod openshift-network-diagnostics/network-check-target-ftq5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:08.228896 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.228801    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9 podName:b8e037f8-de64-4bf0-9830-a6e1523ac8b8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:09.228789183 +0000 UTC m=+4.151380519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxtt9" (UniqueName: "kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9") pod "network-check-target-ftq5c" (UID: "b8e037f8-de64-4bf0-9830-a6e1523ac8b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:08.584148 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.584052    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:08.584867 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:08.584208    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:08.593796 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.593722    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d9x4k" event={"ID":"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123","Type":"ContainerStarted","Data":"61d636ffb83afbd2e5007613c5f71fd385c20499e7b5aaadf0d510e620463db0"}
Jul 08 17:16:08.595299 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.595256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sd4lm" event={"ID":"cfd82851-b81b-47a9-aafe-97ab640a7377","Type":"ContainerStarted","Data":"26c0f90316fc19023b5344d1fcaf697520f8b5c64c2cae348bcf53618ceb7417"}
Jul 08 17:16:08.596843 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.596814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7tvgb" event={"ID":"487ac603-2929-4959-a10b-5d6a8e332a85","Type":"ContainerStarted","Data":"ddd613ba46a5f7826f9e840a4663ff4880929ba67e97cd5295ea4fa81d6d810f"}
Jul 08 17:16:08.598186 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.598127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kb96p" event={"ID":"fad3367b-2fd7-472a-a236-e4e95f32b840","Type":"ContainerStarted","Data":"59a89147525f167b4cf33f60566d07247838652699b59028744f72abdc03f6c0"}
Jul 08 17:16:08.599586 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.599560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"aecf9fe890af8b261da5dabe392746eb219b7029f7623ccda8ed7ce0c38a258a"}
Jul 08 17:16:08.600999 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.600974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tpdks" event={"ID":"03561e29-0643-488e-8533-0eacfe4ac2e5","Type":"ContainerStarted","Data":"52bf4ecde9240f9c23d184c217c0a90f1b6b674f52e63463d7365fabcbedd168"}
Jul 08 17:16:08.602390 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.602365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226" event={"ID":"415dbdf2-8539-4bc1-905c-6ba73835e0f6","Type":"ContainerStarted","Data":"5f97ad44bd2ec7afa3ae231de08bc3f2ca6f76e8ae03b70344f360ef20aceb96"}
Jul 08 17:16:08.604731 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.604705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-crtjf" event={"ID":"5d3e1142-3ba9-4444-8d23-f08949a2ac8d","Type":"ContainerStarted","Data":"4650f7f11c76538cc26ee57775168aff65adddbea0270f03be5bf4aab63f5bc5"}
Jul 08 17:16:08.606155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.606130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fssdf" event={"ID":"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb","Type":"ContainerStarted","Data":"1a2c1c4fe33c02c2f55ffbe76c00f06253cfd58a2f6b760d6547e4f266b57409"}
Jul 08 17:16:08.634682 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.634642    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:11:08 +0000 UTC" deadline="2027-12-19 21:06:04.937626787 +0000 UTC"
Jul 08 17:16:08.634682 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.634682    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12699h49m56.302950154s"
Jul 08 17:16:08.949963 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:08.949629    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:16:09.138394 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:09.138353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:09.138609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:09.138424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:09.138609 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.138499    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:09.138609 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.138568    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:09.138609 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.138581    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:16:11.138557298 +0000 UTC m=+6.061148650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:09.138838 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.138623    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret podName:591bcf3a-6a57-4037-a724-4f5bbdbf9fbb nodeName:}" failed. No retries permitted until 2026-07-08 17:16:11.138607234 +0000 UTC m=+6.061198575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret") pod "global-pull-secret-syncer-5xwp6" (UID: "591bcf3a-6a57-4037-a724-4f5bbdbf9fbb") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:09.238959 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:09.238831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:09.239125 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.239042    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:16:09.239125 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.239069    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:16:09.239125 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.239083    2578 projected.go:196] Error preparing data for projected volume kube-api-access-hxtt9 for pod openshift-network-diagnostics/network-check-target-ftq5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:09.239316 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.239142    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9 podName:b8e037f8-de64-4bf0-9830-a6e1523ac8b8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:11.23912263 +0000 UTC m=+6.161713970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxtt9" (UniqueName: "kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9") pod "network-check-target-ftq5c" (UID: "b8e037f8-de64-4bf0-9830-a6e1523ac8b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:09.585505 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:09.585432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:09.585955 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.585568    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:09.586015 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:09.585977    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:09.586109 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:09.586074    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:09.635382 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:09.635336    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:11:08 +0000 UTC" deadline="2027-12-30 18:26:40.746769184 +0000 UTC"
Jul 08 17:16:09.635382 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:09.635371    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12961h10m31.111402455s"
Jul 08 17:16:10.585403 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:10.584575    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:10.585403 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:10.584732    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:11.159872 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:11.159828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:11.160077 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:11.159927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:11.160143 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.160082    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:11.160198 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.160153    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:16:15.160131294 +0000 UTC m=+10.082722696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:11.160660 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.160612    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:11.160768 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.160668    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret podName:591bcf3a-6a57-4037-a724-4f5bbdbf9fbb nodeName:}" failed. No retries permitted until 2026-07-08 17:16:15.160651676 +0000 UTC m=+10.083243034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret") pod "global-pull-secret-syncer-5xwp6" (UID: "591bcf3a-6a57-4037-a724-4f5bbdbf9fbb") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:11.260513 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:11.260473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:11.260875 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.260853    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:16:11.260947 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.260888    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:16:11.260947 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.260904    2578 projected.go:196] Error preparing data for projected volume kube-api-access-hxtt9 for pod openshift-network-diagnostics/network-check-target-ftq5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:11.261067 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.260965    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9 podName:b8e037f8-de64-4bf0-9830-a6e1523ac8b8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:15.260944764 +0000 UTC m=+10.183536121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxtt9" (UniqueName: "kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9") pod "network-check-target-ftq5c" (UID: "b8e037f8-de64-4bf0-9830-a6e1523ac8b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:11.586656 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:11.586624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:11.587110 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.586761    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:11.587193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:11.587155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:11.587267 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:11.587248    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:12.584633 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:12.584603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:12.584815 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:12.584719    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:13.586645 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:13.586611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:13.587097 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:13.586758    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:13.587164 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:13.587154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:13.587520 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:13.587257    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:14.584887 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:14.584762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:14.585093 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:14.584973    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:15.196952 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:15.196917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:15.197421 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:15.196979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:15.197421 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.197097    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:15.197421 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.197105    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:15.197421 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.197155    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret podName:591bcf3a-6a57-4037-a724-4f5bbdbf9fbb nodeName:}" failed. No retries permitted until 2026-07-08 17:16:23.19713545 +0000 UTC m=+18.119726788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret") pod "global-pull-secret-syncer-5xwp6" (UID: "591bcf3a-6a57-4037-a724-4f5bbdbf9fbb") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:15.197421 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.197177    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:16:23.197165247 +0000 UTC m=+18.119756582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:15.298405 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:15.298367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:15.298591 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.298556    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:16:15.298591 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.298581    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:16:15.298712 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.298594    2578 projected.go:196] Error preparing data for projected volume kube-api-access-hxtt9 for pod openshift-network-diagnostics/network-check-target-ftq5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:15.298712 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.298649    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9 podName:b8e037f8-de64-4bf0-9830-a6e1523ac8b8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:23.298631994 +0000 UTC m=+18.221223333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxtt9" (UniqueName: "kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9") pod "network-check-target-ftq5c" (UID: "b8e037f8-de64-4bf0-9830-a6e1523ac8b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:15.584215 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:15.584132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:15.584403 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:15.584130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:15.584403 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.584358    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:15.584534 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:15.584513    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:16.584403 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:16.583887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:16.584403 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:16.584038    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:17.584466 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:17.584429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:17.584859 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:17.584567    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:17.584859 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:17.584622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:17.584859 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:17.584736    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:18.583881 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:18.583850    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:18.584058 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:18.583967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:19.584799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:19.584596    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:19.585281 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:19.584892    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:19.588143 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:19.584658    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:19.588288 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:19.588240    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:20.584489 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:20.584405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:20.584635 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:20.584535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:21.584373 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:21.584333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:21.584769 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:21.584344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:21.584769 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:21.584451    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:21.584769 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:21.584510    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:22.584077 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:22.584045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:22.584303 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:22.584203    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:23.260951 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:23.260918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:23.261397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:23.260974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:23.261397 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.261071    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:23.261397 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.261084    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:23.261397 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.261134    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret podName:591bcf3a-6a57-4037-a724-4f5bbdbf9fbb nodeName:}" failed. No retries permitted until 2026-07-08 17:16:39.261114352 +0000 UTC m=+34.183705700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret") pod "global-pull-secret-syncer-5xwp6" (UID: "591bcf3a-6a57-4037-a724-4f5bbdbf9fbb") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:23.261397 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.261148    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:16:39.261141323 +0000 UTC m=+34.183732658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:23.362000 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:23.361967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:23.362178 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.362156    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:16:23.362223 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.362190    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:16:23.362223 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.362204    2578 projected.go:196] Error preparing data for projected volume kube-api-access-hxtt9 for pod openshift-network-diagnostics/network-check-target-ftq5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:23.362311 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.362255    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9 podName:b8e037f8-de64-4bf0-9830-a6e1523ac8b8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:39.362242091 +0000 UTC m=+34.284833424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxtt9" (UniqueName: "kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9") pod "network-check-target-ftq5c" (UID: "b8e037f8-de64-4bf0-9830-a6e1523ac8b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:23.584067 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:23.583993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:23.584067 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:23.584037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:23.584299 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.584142    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:23.584299 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:23.584157    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:24.584504 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:24.584425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:24.584958 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:24.584542    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:25.585021 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:25.584985    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:25.585487 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:25.585103    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:25.585487 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:25.585164    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:25.585487 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:25.585246    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:26.584503 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:26.584472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:26.584662 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:26.584572    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:27.584971 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:27.584602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:27.584971 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:27.584738    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:27.584971 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:27.584795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:27.584971 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:27.584904    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:28.584859 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.584663    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:28.584997 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:28.584941    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:28.653462 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.653376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"82c7708fa369fd8fef5bef2c0673a71266b0cfe5b050575b2e9a653f44dfa823"}
Jul 08 17:16:28.653462 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.653467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"e9381cee5e828f797782c284bcf4ec3d3762ee32fd52d57028952596fa47752b"}
Jul 08 17:16:28.653673 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.653521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"ee8683d3e1e6520df6ce4c80a531c5f6b52c69b3330c96243472d83563a9bd5e"}
Jul 08 17:16:28.654941 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.654913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tpdks" event={"ID":"03561e29-0643-488e-8533-0eacfe4ac2e5","Type":"ContainerStarted","Data":"2d19c0c17db2979daa03d8ead1b2470eafc0d3898564e9e63ec50ae4c185d2b7"}
Jul 08 17:16:28.658327 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.658298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d9x4k" event={"ID":"c829c92f-1f23-4a1d-8eae-a2dc5eaa9123","Type":"ContainerStarted","Data":"5ce2663030e87623b7e1d7dff9823ce1007c0a2f3b40671792cac871530db1d9"}
Jul 08 17:16:28.659660 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.659637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal" event={"ID":"96cd401c532546b6d9df4d9d4f78a0b0","Type":"ContainerStarted","Data":"59bd5a6916f7bf4fde7008fbc0a9a344920eedb044e8c0be60d34ffbeca4ed07"}
Jul 08 17:16:28.694585 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.694545    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tpdks" podStartSLOduration=1.179032522 podStartE2EDuration="21.694530711s" totalImagesPullingTime="20.515498189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:28.694521703 +0000 UTC m=+23.617113058" watchObservedRunningTime="2026-07-08 17:16:28.694530711 +0000 UTC m=+23.617122065"
Jul 08 17:16:28.738429 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.738386    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-199.ec2.internal" podStartSLOduration=21.73836884 podStartE2EDuration="21.73836884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:28.71717341 +0000 UTC m=+23.639764764" watchObservedRunningTime="2026-07-08 17:16:28.73836884 +0000 UTC m=+23.660960217"
Jul 08 17:16:28.738526 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:28.738502    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d9x4k" podStartSLOduration=2.221243189 podStartE2EDuration="22.738495855s" totalImagesPullingTime="20.517252666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:28.738252905 +0000 UTC m=+23.660844259" watchObservedRunningTime="2026-07-08 17:16:28.738495855 +0000 UTC m=+23.661087210"
Jul 08 17:16:29.584308 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.584229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:29.584308 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.584228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:29.584476 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:29.584374    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:29.584476 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:29.584379    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:29.663642 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.663597    2578 generic.go:356] "Generic (PLEG): container finished" podID="305c93c2da02a622ea57fe13cd2a7200" containerID="edaddd5443b97ab1563c6271f8900cf5ae0d3b7967bd941e39f7de9133d4f728" exitCode=0
Jul 08 17:16:29.664149 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.663689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal" event={"ID":"305c93c2da02a622ea57fe13cd2a7200","Type":"ContainerDied","Data":"edaddd5443b97ab1563c6271f8900cf5ae0d3b7967bd941e39f7de9133d4f728"}
Jul 08 17:16:29.665485 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.665461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sd4lm" event={"ID":"cfd82851-b81b-47a9-aafe-97ab640a7377","Type":"ContainerStarted","Data":"efff288faef7a61d6da63948ef94d95ac28242cea7bf80e80383270fc7bf189a"}
Jul 08 17:16:29.667166 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.667140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7tvgb" event={"ID":"487ac603-2929-4959-a10b-5d6a8e332a85","Type":"ContainerStarted","Data":"8d784d10d950a64f7782a7d119a3f3ca5316eaf104fec8cd590dd0cf5a09fecd"}
Jul 08 17:16:29.668850 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.668830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kb96p" event={"ID":"fad3367b-2fd7-472a-a236-e4e95f32b840","Type":"ContainerStarted","Data":"d339ed247b0ff1f2dc6e398ec689a56693a2f38e930c555b3ee200a1d42d00f3"}
Jul 08 17:16:29.672466 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.672445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"61d4b19a1d486d7dbe914571414016405a2b07c94451f1b79327fd5910422f0b"}
Jul 08 17:16:29.672579 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.672541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"44b2612b6f9dc7e92a57aeab2604c3499cfc25ea87530d90c3ecb983f61789ae"}
Jul 08 17:16:29.672634 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.672601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"217d3ab55ee91d79b773f6091aae3830158cd85938bb2eff180d09f054bc3fbb"}
Jul 08 17:16:29.673946 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.673922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226" event={"ID":"415dbdf2-8539-4bc1-905c-6ba73835e0f6","Type":"ContainerStarted","Data":"41fdc20bf29cd785ead128b32077c0a2eb2e0ff24c7df0d5090d02af51caa798"}
Jul 08 17:16:29.675548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.675524    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d3e1142-3ba9-4444-8d23-f08949a2ac8d" containerID="2ec4ad54fdce745c02832da8f7303f5ef8906f6f8b899b0e6a0a03b0ec37e4c1" exitCode=0
Jul 08 17:16:29.675669 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.675613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-crtjf" event={"ID":"5d3e1142-3ba9-4444-8d23-f08949a2ac8d","Type":"ContainerDied","Data":"2ec4ad54fdce745c02832da8f7303f5ef8906f6f8b899b0e6a0a03b0ec37e4c1"}
Jul 08 17:16:29.677089 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.677025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fssdf" event={"ID":"4b6a09c6-44cb-4149-b8e5-8b99e432c7eb","Type":"ContainerStarted","Data":"2a83d651c441d671997e9e78213ab26137bf23db15082578c8e1947a1a01ae1d"}
Jul 08 17:16:29.719994 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.719779    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kb96p" podStartSLOduration=3.234166741 podStartE2EDuration="23.719757061s" totalImagesPullingTime="20.48559032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:29.719458499 +0000 UTC m=+24.642049855" watchObservedRunningTime="2026-07-08 17:16:29.719757061 +0000 UTC m=+24.642348416"
Jul 08 17:16:29.740356 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.740309    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7tvgb" podStartSLOduration=7.486142001 podStartE2EDuration="23.740292431s" totalImagesPullingTime="16.25415043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:29.739731354 +0000 UTC m=+24.662322710" watchObservedRunningTime="2026-07-08 17:16:29.740292431 +0000 UTC m=+24.662883787"
Jul 08 17:16:29.756985 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.756946    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sd4lm" podStartSLOduration=2.327629969 podStartE2EDuration="22.756929791s" totalImagesPullingTime="20.429299822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:29.756478515 +0000 UTC m=+24.679069871" watchObservedRunningTime="2026-07-08 17:16:29.756929791 +0000 UTC m=+24.679521145"
Jul 08 17:16:29.772539 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:29.772501    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fssdf" podStartSLOduration=3.288586042 podStartE2EDuration="23.772487836s" totalImagesPullingTime="20.483901794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:29.771913003 +0000 UTC m=+24.694504358" watchObservedRunningTime="2026-07-08 17:16:29.772487836 +0000 UTC m=+24.695079191"
Jul 08 17:16:30.439109 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.439085    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 17:16:30.582527 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.582419    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:16:30.439104111Z","UUID":"72f27268-496a-4445-9fe6-1fa53e345086","Handler":null,"Name":"","Endpoint":""}
Jul 08 17:16:30.583734 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.583720    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 17:16:30.583833 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.583756    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 17:16:30.583977 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.583961    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:30.584093 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:30.584075    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:30.659589 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.659570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:30.660067 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.660049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:30.680770 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.680747    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226" event={"ID":"415dbdf2-8539-4bc1-905c-6ba73835e0f6","Type":"ContainerStarted","Data":"8546369e016600f5f2cb7f4b1910392156093d4c11ae75f219ebe0ac811401c7"}
Jul 08 17:16:30.682352 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.682324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal" event={"ID":"305c93c2da02a622ea57fe13cd2a7200","Type":"ContainerStarted","Data":"1fd42bf90b0b5b97122749c2e3811de485b42b1489f53e48a618c9666687e501"}
Jul 08 17:16:30.682770 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.682749    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:30.682897 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.682885    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kb96p"
Jul 08 17:16:30.727285 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:30.727227    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-199.ec2.internal" podStartSLOduration=23.727216028 podStartE2EDuration="23.727216028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:30.725951914 +0000 UTC m=+25.648543269" watchObservedRunningTime="2026-07-08 17:16:30.727216028 +0000 UTC m=+25.649807383"
Jul 08 17:16:31.584338 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:31.584303    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:31.584657 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:31.584356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:31.584657 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:31.584444    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:31.584657 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:31.584546    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:31.691053 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:31.691014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"645356eac91825c919f91d4da411d7cb0925400d8bec5490cce3798b49c78a5e"}
Jul 08 17:16:32.583829 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:32.583798    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:32.583991 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:32.583924    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:32.694517 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:32.694479    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226" event={"ID":"415dbdf2-8539-4bc1-905c-6ba73835e0f6","Type":"ContainerStarted","Data":"b3bc6a3d901847cdef76509db0be80306762bdfec395a14da8e3cd6efa556d92"}
Jul 08 17:16:32.730008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:32.729964    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9226" podStartSLOduration=3.464163837 podStartE2EDuration="26.729949315s" totalImagesPullingTime="23.265785478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:32.729450435 +0000 UTC m=+27.652041790" watchObservedRunningTime="2026-07-08 17:16:32.729949315 +0000 UTC m=+27.652540661"
Jul 08 17:16:33.584750 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:33.584514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:33.584936 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:33.584517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:33.584936 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:33.584844    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:33.585043 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:33.584955    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:33.585043 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:33.584577    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:33.585134 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:33.585048    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:33.701316 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:33.701235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" event={"ID":"2e24ac31-4e4a-4848-8c74-b3c6c3828f37","Type":"ContainerStarted","Data":"999280aae866a74b3a2373af288c1f3121fd4f75766009f7259cf473be7f623d"}
Jul 08 17:16:34.704121 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:34.704092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:34.704679 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:34.704177    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:34.704679 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:34.704228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:34.722656 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:34.722631    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:34.723145 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:34.723125    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:16:34.785053 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:34.784992    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn" podStartSLOduration=7.276612707 podStartE2EDuration="27.784977122s" totalImagesPullingTime="20.508364415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:33.753922162 +0000 UTC m=+28.676513517" watchObservedRunningTime="2026-07-08 17:16:34.784977122 +0000 UTC m=+29.707568477"
Jul 08 17:16:35.329540 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:35.329323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sbjfl"]
Jul 08 17:16:35.329689 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:35.329583    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:35.329689 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:35.329664    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:35.331542 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:35.331519    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5xwp6"]
Jul 08 17:16:35.331633 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:35.331602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:35.331689 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:35.331670    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:35.358696 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:35.358676    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ftq5c"]
Jul 08 17:16:35.358794 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:35.358743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:35.358838 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:35.358813    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:35.707255 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:35.707184    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d3e1142-3ba9-4444-8d23-f08949a2ac8d" containerID="0db39348ab82139fe8a1f6616144e2835d8b83da453d0246c1ecceb13e9b03ea" exitCode=0
Jul 08 17:16:35.707725 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:35.707285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-crtjf" event={"ID":"5d3e1142-3ba9-4444-8d23-f08949a2ac8d","Type":"ContainerDied","Data":"0db39348ab82139fe8a1f6616144e2835d8b83da453d0246c1ecceb13e9b03ea"}
Jul 08 17:16:36.584293 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:36.584250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:36.584440 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:36.584368    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:36.584440 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:36.584422    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:36.584532 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:36.584514    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:37.584625 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:37.584547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:37.585051 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:37.584641    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:37.713549 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:37.713521    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d3e1142-3ba9-4444-8d23-f08949a2ac8d" containerID="bbaf9e547aec48a5a124645d76461fb5edcdead0f52bdd9e3d1c8f0b581ce41f" exitCode=0
Jul 08 17:16:37.713678 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:37.713570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-crtjf" event={"ID":"5d3e1142-3ba9-4444-8d23-f08949a2ac8d","Type":"ContainerDied","Data":"bbaf9e547aec48a5a124645d76461fb5edcdead0f52bdd9e3d1c8f0b581ce41f"}
Jul 08 17:16:38.584838 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:38.584808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:38.585318 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:38.584913    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:38.585318 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:38.584981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:38.585318 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:38.585100    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:39.293177 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:39.293141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:39.293366 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:39.293202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:39.293366 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.293247    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:39.293366 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.293326    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:17:11.293310836 +0000 UTC m=+66.215902169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:16:39.293366 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.293341    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:39.293528 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.293395    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret podName:591bcf3a-6a57-4037-a724-4f5bbdbf9fbb nodeName:}" failed. No retries permitted until 2026-07-08 17:17:11.293377426 +0000 UTC m=+66.215968764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret") pod "global-pull-secret-syncer-5xwp6" (UID: "591bcf3a-6a57-4037-a724-4f5bbdbf9fbb") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:16:39.394019 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:39.393991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:39.394160 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.394139    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:16:39.394160 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.394163    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:16:39.394468 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.394175    2578 projected.go:196] Error preparing data for projected volume kube-api-access-hxtt9 for pod openshift-network-diagnostics/network-check-target-ftq5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:39.394468 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.394222    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9 podName:b8e037f8-de64-4bf0-9830-a6e1523ac8b8 nodeName:}" failed. No retries permitted until 2026-07-08 17:17:11.394205921 +0000 UTC m=+66.316797255 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxtt9" (UniqueName: "kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9") pod "network-check-target-ftq5c" (UID: "b8e037f8-de64-4bf0-9830-a6e1523ac8b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:16:39.584506 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:39.584456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:39.584615 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:39.584591    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftq5c" podUID="b8e037f8-de64-4bf0-9830-a6e1523ac8b8"
Jul 08 17:16:39.719795 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:39.719745    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d3e1142-3ba9-4444-8d23-f08949a2ac8d" containerID="7b71debaf1ee1c1613971e838a12ee771a5c88eec2a2ddf78ec13c7f25ed72be" exitCode=0
Jul 08 17:16:39.720089 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:39.719794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-crtjf" event={"ID":"5d3e1142-3ba9-4444-8d23-f08949a2ac8d","Type":"ContainerDied","Data":"7b71debaf1ee1c1613971e838a12ee771a5c88eec2a2ddf78ec13c7f25ed72be"}
Jul 08 17:16:39.812245 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:39.812208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:39.916575 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:39.916507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:40.584015 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:40.583987    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:40.584185 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:40.584114    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:16:40.584185 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:40.584144    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:40.584261 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:40.584217    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5xwp6" podUID="591bcf3a-6a57-4037-a724-4f5bbdbf9fbb"
Jul 08 17:16:41.294782 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.294575    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-199.ec2.internal" event="NodeReady"
Jul 08 17:16:41.295194 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.294888    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 17:16:41.373902 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.373874    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l5zg6"]
Jul 08 17:16:41.376053 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.376029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.381254 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.381231    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sh429"]
Jul 08 17:16:41.382157 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.382136    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 17:16:41.384066 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.383090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sh429"
Jul 08 17:16:41.385940 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.385920    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 17:16:41.386107 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.386091    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dpkhh\""
Jul 08 17:16:41.389679 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.389657    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 17:16:41.389787 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.389758    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 17:16:41.389852 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.389797    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zsfk5\""
Jul 08 17:16:41.390167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.390152    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 17:16:41.402642 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.402623    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l5zg6"]
Jul 08 17:16:41.404463 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.404443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sh429"]
Jul 08 17:16:41.407765 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.407730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f94bf8f8-9114-4958-96b4-ee1cbab650ad-config-volume\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.407855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.407786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef96794e-7574-42a8-807c-dfa42756254a-cert\") pod \"ingress-canary-sh429\" (UID: \"ef96794e-7574-42a8-807c-dfa42756254a\") " pod="openshift-ingress-canary/ingress-canary-sh429"
Jul 08 17:16:41.407855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.407813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmtg2\" (UniqueName: \"kubernetes.io/projected/f94bf8f8-9114-4958-96b4-ee1cbab650ad-kube-api-access-nmtg2\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.407855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.407846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf48k\" (UniqueName: \"kubernetes.io/projected/ef96794e-7574-42a8-807c-dfa42756254a-kube-api-access-nf48k\") pod \"ingress-canary-sh429\" (UID: \"ef96794e-7574-42a8-807c-dfa42756254a\") " pod="openshift-ingress-canary/ingress-canary-sh429"
Jul 08 17:16:41.407984 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.407890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.407984 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.407948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94bf8f8-9114-4958-96b4-ee1cbab650ad-tmp-dir\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.497249 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.497218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:41.508416 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.508385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef96794e-7574-42a8-807c-dfa42756254a-cert\") pod \"ingress-canary-sh429\" (UID: \"ef96794e-7574-42a8-807c-dfa42756254a\") " pod="openshift-ingress-canary/ingress-canary-sh429"
Jul 08 17:16:41.508534 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.508424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmtg2\" (UniqueName: \"kubernetes.io/projected/f94bf8f8-9114-4958-96b4-ee1cbab650ad-kube-api-access-nmtg2\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.508534 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.508457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf48k\" (UniqueName: \"kubernetes.io/projected/ef96794e-7574-42a8-807c-dfa42756254a-kube-api-access-nf48k\") pod \"ingress-canary-sh429\" (UID: \"ef96794e-7574-42a8-807c-dfa42756254a\") " pod="openshift-ingress-canary/ingress-canary-sh429"
Jul 08 17:16:41.508534 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.508514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.508684 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.508568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94bf8f8-9114-4958-96b4-ee1cbab650ad-tmp-dir\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.508684 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.508595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f94bf8f8-9114-4958-96b4-ee1cbab650ad-config-volume\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.508746 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:41.508687    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:16:41.508780 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:41.508746    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:16:42.008726256 +0000 UTC m=+36.931317612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:16:41.509093 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.509066    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94bf8f8-9114-4958-96b4-ee1cbab650ad-tmp-dir\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.509261 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.509242    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f94bf8f8-9114-4958-96b4-ee1cbab650ad-config-volume\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.513801 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.513781    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef96794e-7574-42a8-807c-dfa42756254a-cert\") pod \"ingress-canary-sh429\" (UID: \"ef96794e-7574-42a8-807c-dfa42756254a\") " pod="openshift-ingress-canary/ingress-canary-sh429"
Jul 08 17:16:41.520883 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.520860    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmtg2\" (UniqueName: \"kubernetes.io/projected/f94bf8f8-9114-4958-96b4-ee1cbab650ad-kube-api-access-nmtg2\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:41.524871 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.524849    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf48k\" (UniqueName: \"kubernetes.io/projected/ef96794e-7574-42a8-807c-dfa42756254a-kube-api-access-nf48k\") pod \"ingress-canary-sh429\" (UID: \"ef96794e-7574-42a8-807c-dfa42756254a\") " pod="openshift-ingress-canary/ingress-canary-sh429"
Jul 08 17:16:41.584260 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.584201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:16:41.587106 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.587083    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8pnd7\""
Jul 08 17:16:41.587262 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.587241    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 17:16:41.587367 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.587241    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 17:16:41.591043 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.591020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:41.695321 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.695293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sh429"
Jul 08 17:16:41.851845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:41.851767    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sh429"]
Jul 08 17:16:41.855318 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:16:41.855287    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef96794e_7574_42a8_807c_dfa42756254a.slice/crio-2cc36ee548ca0650b1a209f1db86bfafefb0d8e28fc7079c929ef482efcffd5b WatchSource:0}: Error finding container 2cc36ee548ca0650b1a209f1db86bfafefb0d8e28fc7079c929ef482efcffd5b: Status 404 returned error can't find the container with id 2cc36ee548ca0650b1a209f1db86bfafefb0d8e28fc7079c929ef482efcffd5b
Jul 08 17:16:42.011863 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:42.011822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:42.012038 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:42.011953    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:16:42.012038 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:42.012023    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:16:43.012004786 +0000 UTC m=+37.934596119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:16:42.584256 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:42.584224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:16:42.585002 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:42.584283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:16:42.588082 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:42.588058    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xkss2\""
Jul 08 17:16:42.588340 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:42.588324    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 17:16:42.589436 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:42.589411    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 17:16:42.731681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:42.731646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sh429" event={"ID":"ef96794e-7574-42a8-807c-dfa42756254a","Type":"ContainerStarted","Data":"2cc36ee548ca0650b1a209f1db86bfafefb0d8e28fc7079c929ef482efcffd5b"}
Jul 08 17:16:43.020036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:43.019956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:43.020185 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:43.020103    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:16:43.020232 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:43.020184    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:16:45.02016101 +0000 UTC m=+39.942752367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:16:44.968657 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:44.968458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:45.036199 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:45.036158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:45.036401 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:45.036339    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:16:45.036485 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:45.036403    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:16:49.036383231 +0000 UTC m=+43.958974598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:16:45.097696 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:45.097662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:45.740466 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:45.740396    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d3e1142-3ba9-4444-8d23-f08949a2ac8d" containerID="516e260d26040acec22b2ef857586d8a8684047344332f790f95159d9e7bb947" exitCode=0
Jul 08 17:16:45.740645 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:45.740490    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-crtjf" event={"ID":"5d3e1142-3ba9-4444-8d23-f08949a2ac8d","Type":"ContainerDied","Data":"516e260d26040acec22b2ef857586d8a8684047344332f790f95159d9e7bb947"}
Jul 08 17:16:45.741894 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:45.741870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sh429" event={"ID":"ef96794e-7574-42a8-807c-dfa42756254a","Type":"ContainerStarted","Data":"b0a421d4bd432917bc2461e39b9ab159e0f833c9b3d62d5770aa7f68221d135d"}
Jul 08 17:16:45.811964 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:45.811486    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sh429" podStartSLOduration=1.388577147 podStartE2EDuration="4.811468327s" totalImagesPullingTime="3.42289118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:45.811180531 +0000 UTC m=+40.733771887" watchObservedRunningTime="2026-07-08 17:16:45.811468327 +0000 UTC m=+40.734059683"
Jul 08 17:16:46.737993 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:46.737959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:46.747010 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:46.746984    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d3e1142-3ba9-4444-8d23-f08949a2ac8d" containerID="3843e1c8f65b1ddf018d2db75a6f8dc36c39e402728038218cc9f6e23224e23d" exitCode=0
Jul 08 17:16:46.747137 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:46.747075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-crtjf" event={"ID":"5d3e1142-3ba9-4444-8d23-f08949a2ac8d","Type":"ContainerDied","Data":"3843e1c8f65b1ddf018d2db75a6f8dc36c39e402728038218cc9f6e23224e23d"}
Jul 08 17:16:46.838647 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:46.838626    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:47.752449 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:47.752414    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-crtjf" event={"ID":"5d3e1142-3ba9-4444-8d23-f08949a2ac8d","Type":"ContainerStarted","Data":"2752ae66eab5db67500d3814cb2e6962725bb4c445048b988107264df3cb8be0"}
Jul 08 17:16:47.797121 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:47.797075    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-crtjf" podStartSLOduration=7.496999896 podStartE2EDuration="41.79706202s" totalImagesPullingTime="34.300062124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:47.795372968 +0000 UTC m=+42.717964322" watchObservedRunningTime="2026-07-08 17:16:47.79706202 +0000 UTC m=+42.719653375"
Jul 08 17:16:48.065474 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:48.065443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:48.339027 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:48.338960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:48.991757 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:48.991727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:49.062877 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:49.062854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:49.062996 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:49.062981    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:16:49.063048 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:49.063039    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:16:57.063022629 +0000 UTC m=+51.985613962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:16:49.185577 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:49.185549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:50.460073 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:50.460038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:50.669740 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:50.669706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:50.872014 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:50.871985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:51.064841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:51.064813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:51.491454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:51.491425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:51.617100 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:51.617071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:55.884105 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:55.884077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:56.090305 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:56.090260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:56.351462 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:56.351430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:16:57.118968 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:16:57.118937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:16:57.119309 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:57.119085    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:16:57.119309 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:16:57.119146    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:17:13.119130646 +0000 UTC m=+68.041721979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:17:02.690344 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:02.690306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:02.802479 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:02.802442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:04.757665 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:04.757629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:04.857625 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:04.857594    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:06.729101 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:06.729074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdkn"
Jul 08 17:17:06.888224 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:06.888200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:07.100812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:07.100787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:07.485488 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:07.485419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:07.588299 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:07.588254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:11.313901 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.313872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:17:11.314353 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.313918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:17:11.317448 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.317431    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 17:17:11.317727 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.317712    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 17:17:11.324528 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:17:11.324508    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 17:17:11.324635 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:17:11.324576    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:18:15.324554914 +0000 UTC m=+130.247146247 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : secret "metrics-daemon-secret" not found
Jul 08 17:17:11.327895 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.327871    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/591bcf3a-6a57-4037-a724-4f5bbdbf9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-5xwp6\" (UID: \"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb\") " pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:17:11.406759 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.406731    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5xwp6"
Jul 08 17:17:11.414695 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.414669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:17:11.417677 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.417657    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 17:17:11.428522 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.428502    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 17:17:11.438426 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.438403    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxtt9\" (UniqueName: \"kubernetes.io/projected/b8e037f8-de64-4bf0-9830-a6e1523ac8b8-kube-api-access-hxtt9\") pod \"network-check-target-ftq5c\" (UID: \"b8e037f8-de64-4bf0-9830-a6e1523ac8b8\") " pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:17:11.548090 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.548059    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5xwp6"]
Jul 08 17:17:11.552690 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:17:11.552666    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591bcf3a_6a57_4037_a724_4f5bbdbf9fbb.slice/crio-51a45a3b477703d90bace67e7654cfe03a53b9d97ed199a377d98357f088f2d0 WatchSource:0}: Error finding container 51a45a3b477703d90bace67e7654cfe03a53b9d97ed199a377d98357f088f2d0: Status 404 returned error can't find the container with id 51a45a3b477703d90bace67e7654cfe03a53b9d97ed199a377d98357f088f2d0
Jul 08 17:17:11.597595 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.597549    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8pnd7\""
Jul 08 17:17:11.605791 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.605776    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:17:11.727950 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.727929    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ftq5c"]
Jul 08 17:17:11.730109 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:17:11.730088    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e037f8_de64_4bf0_9830_a6e1523ac8b8.slice/crio-37cfba1ed983564a1081f6bade4fa1c3b7cfe7d9c5a67a93abcb9352e18358e5 WatchSource:0}: Error finding container 37cfba1ed983564a1081f6bade4fa1c3b7cfe7d9c5a67a93abcb9352e18358e5: Status 404 returned error can't find the container with id 37cfba1ed983564a1081f6bade4fa1c3b7cfe7d9c5a67a93abcb9352e18358e5
Jul 08 17:17:11.807970 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.807931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ftq5c" event={"ID":"b8e037f8-de64-4bf0-9830-a6e1523ac8b8","Type":"ContainerStarted","Data":"37cfba1ed983564a1081f6bade4fa1c3b7cfe7d9c5a67a93abcb9352e18358e5"}
Jul 08 17:17:11.809101 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:11.809038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5xwp6" event={"ID":"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb","Type":"ContainerStarted","Data":"51a45a3b477703d90bace67e7654cfe03a53b9d97ed199a377d98357f088f2d0"}
Jul 08 17:17:13.127991 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:13.127953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:17:13.128432 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:17:13.128082    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:17:13.128432 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:17:13.128151    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:17:45.128132994 +0000 UTC m=+100.050724328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:17:13.509333 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:13.509234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:13.631860 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:13.631828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:15.820169 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:15.820136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ftq5c" event={"ID":"b8e037f8-de64-4bf0-9830-a6e1523ac8b8","Type":"ContainerStarted","Data":"a543b97af2d3f5a04489506554a2b4a8d1e1d30113e8be18d99277b2151bdbda"}
Jul 08 17:17:15.820532 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:15.820289    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:17:15.842635 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:15.842586    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ftq5c" podStartSLOduration=66.10495783 podStartE2EDuration="1m9.842574425s" totalImagesPullingTime="3.737616595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:15.841396466 +0000 UTC m=+70.763987822" watchObservedRunningTime="2026-07-08 17:17:15.842574425 +0000 UTC m=+70.765165779"
Jul 08 17:17:17.826415 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:17.826338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5xwp6" event={"ID":"591bcf3a-6a57-4037-a724-4f5bbdbf9fbb","Type":"ContainerStarted","Data":"a8fb2b1a4e7cacd94d4be38e1049cb61079c14620931b22c4309987dc619a463"}
Jul 08 17:17:28.390341 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:28.390305    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:28.469156 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:28.469122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:34.956914 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.956861    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5xwp6" podStartSLOduration=82.957642351 podStartE2EDuration="1m28.956844444s" totalImagesPullingTime="5.999202093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:17.850023134 +0000 UTC m=+72.772614489" watchObservedRunningTime="2026-07-08 17:17:34.956844444 +0000 UTC m=+89.879435798"
Jul 08 17:17:34.957398 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.957385    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"]
Jul 08 17:17:34.959975 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.959958    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:34.963691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.963667    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 17:17:34.964424 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.964408    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 17:17:34.964578 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.964561    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 17:17:34.964636 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.964624    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 17:17:34.964873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.964851    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 17:17:34.964873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.964847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 17:17:34.965142 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.965117    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 17:17:34.979720 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:34.979699    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"]
Jul 08 17:17:35.070391 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.070370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/76458729-8e5b-4827-9313-17efe1f18bae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.070512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.070404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.070512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.070424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5mx\" (UniqueName: \"kubernetes.io/projected/76458729-8e5b-4827-9313-17efe1f18bae-kube-api-access-lq5mx\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.070512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.070445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-ca\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.070512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.070465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.070512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.070491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-hub\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.170916 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.170892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/76458729-8e5b-4827-9313-17efe1f18bae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.171011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.170937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.171011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.170964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5mx\" (UniqueName: \"kubernetes.io/projected/76458729-8e5b-4827-9313-17efe1f18bae-kube-api-access-lq5mx\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.171011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.170999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-ca\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.171165 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.171027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.171165 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.171054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-hub\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.171656 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.171631    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/76458729-8e5b-4827-9313-17efe1f18bae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.173450 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.173428    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-ca\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.173632 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.173615    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-hub\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.173954 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.173939    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.174193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.174175    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76458729-8e5b-4827-9313-17efe1f18bae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.179494 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.179475    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5mx\" (UniqueName: \"kubernetes.io/projected/76458729-8e5b-4827-9313-17efe1f18bae-kube-api-access-lq5mx\") pod \"cluster-proxy-proxy-agent-77f54f46cf-6lcjc\" (UID: \"76458729-8e5b-4827-9313-17efe1f18bae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.283511 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.283494    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:17:35.410809 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.410780    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"]
Jul 08 17:17:35.414297 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:17:35.414253    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76458729_8e5b_4827_9313_17efe1f18bae.slice/crio-eb30a050a15ff44eca8a197313dc56441cdd95d05012aaba413dd4591191e58c WatchSource:0}: Error finding container eb30a050a15ff44eca8a197313dc56441cdd95d05012aaba413dd4591191e58c: Status 404 returned error can't find the container with id eb30a050a15ff44eca8a197313dc56441cdd95d05012aaba413dd4591191e58c
Jul 08 17:17:35.861857 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.861815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:17:35.870257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:35.870234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" event={"ID":"76458729-8e5b-4827-9313-17efe1f18bae","Type":"ContainerStarted","Data":"eb30a050a15ff44eca8a197313dc56441cdd95d05012aaba413dd4591191e58c"}
Jul 08 17:17:39.884747 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:39.884708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" event={"ID":"76458729-8e5b-4827-9313-17efe1f18bae","Type":"ContainerStarted","Data":"b7aebf209e982b9e95819bda08b0485eb5a31b9dd34aad7c75a04cbf5062ac77"}
Jul 08 17:17:39.885124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:39.884760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" event={"ID":"76458729-8e5b-4827-9313-17efe1f18bae","Type":"ContainerStarted","Data":"6d2edf8e911de0288cd95f5823f79c3f54287cb85c77cfa3ef64ffe7ed254cf4"}
Jul 08 17:17:39.885124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:39.884780    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" event={"ID":"76458729-8e5b-4827-9313-17efe1f18bae","Type":"ContainerStarted","Data":"dcb897167a5bf538d4bf3d9634d1702010b155047cb6825994cae7cba0fd2707"}
Jul 08 17:17:39.905834 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:39.904748    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" podStartSLOduration=2.019851749 podStartE2EDuration="5.904727596s" totalImagesPullingTime="3.884875847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:39.903782862 +0000 UTC m=+94.826374217" watchObservedRunningTime="2026-07-08 17:17:39.904727596 +0000 UTC m=+94.827318953"
Jul 08 17:17:45.145175 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:45.145068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:17:45.145564 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:17:45.145227    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:17:45.145564 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:17:45.145310    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:18:49.145293481 +0000 UTC m=+164.067884815 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:17:46.825421 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:17:46.825393    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ftq5c"
Jul 08 17:18:15.335724 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:18:15.335691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:18:15.336197 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:18:15.335813    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 17:18:15.336197 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:18:15.335882    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:20:17.335860409 +0000 UTC m=+252.258451742 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : secret "metrics-daemon-secret" not found
Jul 08 17:18:44.387808 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:18:44.387757    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l5zg6" podUID="f94bf8f8-9114-4958-96b4-ee1cbab650ad"
Jul 08 17:18:45.063983 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:18:45.063947    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:18:45.599841 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:18:45.599812    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:18:49.163056 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:18:49.163014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:18:49.163483 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:18:49.163170    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:18:49.163483 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:18:49.163239    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls podName:f94bf8f8-9114-4958-96b4-ee1cbab650ad nodeName:}" failed. No retries permitted until 2026-07-08 17:20:51.163219357 +0000 UTC m=+286.085810693 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls") pod "dns-default-l5zg6" (UID: "f94bf8f8-9114-4958-96b4-ee1cbab650ad") : secret "dns-default-metrics-tls" not found
Jul 08 17:19:00.584115 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:19:00.584036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:20:03.083959 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:03.083916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:17.422141 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:17.422096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:20:17.422635 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:17.422252    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 17:20:17.422635 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:17.422340    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs podName:49a1850c-d280-45ac-b710-07f9ba7846af nodeName:}" failed. No retries permitted until 2026-07-08 17:22:19.422322029 +0000 UTC m=+374.344913361 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs") pod "network-metrics-daemon-sbjfl" (UID: "49a1850c-d280-45ac-b710-07f9ba7846af") : secret "metrics-daemon-secret" not found
Jul 08 17:20:33.233288 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.233230    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz"]
Jul 08 17:20:33.235735 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.235713    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz"
Jul 08 17:20:33.238826 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.238807    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 08 17:20:33.239997 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.239978    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 08 17:20:33.240073 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.239978    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tqh8f\""
Jul 08 17:20:33.248997 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.248977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz"]
Jul 08 17:20:33.329435 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.329414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqp9f\" (UniqueName: \"kubernetes.io/projected/9fa36fff-aeee-4ea9-9c62-98f7038b76c6-kube-api-access-sqp9f\") pod \"volume-data-source-validator-5d456fdbcd-5xbvz\" (UID: \"9fa36fff-aeee-4ea9-9c62-98f7038b76c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz"
Jul 08 17:20:33.369990 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.369963    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:33.433743 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.431137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqp9f\" (UniqueName: \"kubernetes.io/projected/9fa36fff-aeee-4ea9-9c62-98f7038b76c6-kube-api-access-sqp9f\") pod \"volume-data-source-validator-5d456fdbcd-5xbvz\" (UID: \"9fa36fff-aeee-4ea9-9c62-98f7038b76c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz"
Jul 08 17:20:33.439023 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.439004    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqp9f\" (UniqueName: \"kubernetes.io/projected/9fa36fff-aeee-4ea9-9c62-98f7038b76c6-kube-api-access-sqp9f\") pod \"volume-data-source-validator-5d456fdbcd-5xbvz\" (UID: \"9fa36fff-aeee-4ea9-9c62-98f7038b76c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz"
Jul 08 17:20:33.470832 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.470804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:33.544165 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.544140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz"
Jul 08 17:20:33.669698 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:33.669672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz"]
Jul 08 17:20:33.672335 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:20:33.672309    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa36fff_aeee_4ea9_9c62_98f7038b76c6.slice/crio-0f7176bee83026f5d70d67334c1c43de891a9eb89957fcdf8b3455550b0ac3b8 WatchSource:0}: Error finding container 0f7176bee83026f5d70d67334c1c43de891a9eb89957fcdf8b3455550b0ac3b8: Status 404 returned error can't find the container with id 0f7176bee83026f5d70d67334c1c43de891a9eb89957fcdf8b3455550b0ac3b8
Jul 08 17:20:34.376955 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:34.376924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz" event={"ID":"9fa36fff-aeee-4ea9-9c62-98f7038b76c6","Type":"ContainerStarted","Data":"0f7176bee83026f5d70d67334c1c43de891a9eb89957fcdf8b3455550b0ac3b8"}
Jul 08 17:20:35.382303 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:35.382246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz" event={"ID":"9fa36fff-aeee-4ea9-9c62-98f7038b76c6","Type":"ContainerStarted","Data":"9f914b6e1de37bfeb38d273c5d47ff8aac4ed3c44925767f108087e0be014af1"}
Jul 08 17:20:35.479251 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:35.479219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:35.541680 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:35.541658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:37.415959 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.415923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:37.518146 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.518119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:37.550928 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.550874    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5xbvz" podStartSLOduration=3.541279325 podStartE2EDuration="4.550854785s" totalImagesPullingTime="1.00957546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:35.397182999 +0000 UTC m=+270.319774354" watchObservedRunningTime="2026-07-08 17:20:37.550854785 +0000 UTC m=+272.473446140"
Jul 08 17:20:37.551135 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.551119    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b5jvx"]
Jul 08 17:20:37.554063 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.554044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.557022 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.557002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 17:20:37.557518 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.557501    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 17:20:37.557804 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.557790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-crio-socket\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.557846 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.557817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.557882 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.557838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjdsp\" (UniqueName: \"kubernetes.io/projected/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-api-access-rjdsp\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.557915 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.557886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.557915 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.557906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-data-volume\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.558231 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.558216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6zxwc\""
Jul 08 17:20:37.558286 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.558218    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 17:20:37.558330 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.558313    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 17:20:37.574209 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.574187    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b5jvx"]
Jul 08 17:20:37.617041 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.617018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:37.658440 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.658417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-crio-socket\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.658521 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.658449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.658521 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.658472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdsp\" (UniqueName: \"kubernetes.io/projected/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-api-access-rjdsp\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.658521 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.658496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.658521 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.658515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-data-volume\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.658715 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.658538    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-crio-socket\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.658715 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:37.658586    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:37.658715 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:37.658598    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 17:20:37.658715 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:37.658647    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:38.15862778 +0000 UTC m=+273.081219127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:37.658715 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:37.658667    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:38.158655724 +0000 UTC m=+273.081247065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : configmap "kube-rbac-proxy" not found
Jul 08 17:20:37.658916 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.658766    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-data-volume\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:37.667127 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:37.667075    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjdsp\" (UniqueName: \"kubernetes.io/projected/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-api-access-rjdsp\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:38.139352 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.139323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:38.161436 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.161409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:38.161580 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.161451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:38.161580 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:38.161527    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 17:20:38.161580 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:38.161566    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:38.161713 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:38.161590    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:39.161576492 +0000 UTC m=+274.084167824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : configmap "kube-rbac-proxy" not found
Jul 08 17:20:38.161713 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:38.161623    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:39.161605696 +0000 UTC m=+274.084197046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:38.239894 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.239864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:38.436626 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.436557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:38.537457 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.537432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:38.637442 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.637418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:38.853919 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.853896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:38.917457 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:38.917429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:39.168988 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:39.168909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:39.168988 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:39.168951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:39.169193 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:39.169035    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 17:20:39.169193 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:39.169091    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:41.169075251 +0000 UTC m=+276.091666588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : configmap "kube-rbac-proxy" not found
Jul 08 17:20:39.169193 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:39.169093    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:39.169193 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:39.169167    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:41.169146019 +0000 UTC m=+276.091737419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:39.341752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:39.341731    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fssdf_4b6a09c6-44cb-4149-b8e5-8b99e432c7eb/dns-node-resolver/0.log"
Jul 08 17:20:40.477783 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:40.477745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:40.531584 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:40.531554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:40.540532 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:40.540509    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7tvgb_487ac603-2929-4959-a10b-5d6a8e332a85/node-ca/0.log"
Jul 08 17:20:40.927868 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:40.927831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:41.030826 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:41.030803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:41.181354 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:41.181262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:41.181354 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:41.181324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:41.181496 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:41.181397    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 17:20:41.181496 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:41.181411    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:41.181496 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:41.181450    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:45.181435224 +0000 UTC m=+280.104026561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : configmap "kube-rbac-proxy" not found
Jul 08 17:20:41.181496 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:41.181470    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:45.181455366 +0000 UTC m=+280.104046722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:41.442415 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:41.442338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:41.542023 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:41.542002    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sh429_ef96794e-7574-42a8-807c-dfa42756254a/serve-healthcheck-canary/0.log"
Jul 08 17:20:45.034735 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:45.034705    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:45.134047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:45.134016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:45.205486 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:45.205455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:45.205602 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:45.205495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:45.205602 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:45.205574    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 17:20:45.205671 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:45.205599    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:45.205671 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:45.205638    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:53.205620952 +0000 UTC m=+288.128212306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : configmap "kube-rbac-proxy" not found
Jul 08 17:20:45.205671 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:45.205652    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:20:53.205646171 +0000 UTC m=+288.128237507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:45.234871 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:45.234840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:45.333740 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:45.333675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:45.438784 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:45.438760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:45.928997 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:45.928960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:46.614930 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:46.614904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:46.932061 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:46.931981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:47.138280 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:47.138249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:47.544201 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:47.544170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:48.064690 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:48.064651    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l5zg6" podUID="f94bf8f8-9114-4958-96b4-ee1cbab650ad"
Jul 08 17:20:48.331500 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:48.331429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:48.419940 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:48.419911    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:20:48.699458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:48.699377    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:48.753716 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:48.753695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:48.918124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:48.918099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:49.020125 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:49.020061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:49.122436 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:49.122379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:49.533460 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:49.533417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:50.126253 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:50.126220    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:50.525300 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:50.525207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:50.640117 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:50.640079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:50.925449 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:50.925422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:51.245424 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.245327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:20:51.247809 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.247791    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94bf8f8-9114-4958-96b4-ee1cbab650ad-metrics-tls\") pod \"dns-default-l5zg6\" (UID: \"f94bf8f8-9114-4958-96b4-ee1cbab650ad\") " pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:20:51.325981 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.325948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:51.422792 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.422762    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dpkhh\""
Jul 08 17:20:51.430616 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.430599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:20:51.528203 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.528171    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:51.557056 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.557031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l5zg6"]
Jul 08 17:20:51.560304 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:20:51.560262    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94bf8f8_9114_4958_96b4_ee1cbab650ad.slice/crio-85f8abfe469c57c40fb7398ffcb3a2f49726107f1d0c76a0c083136d7e662f24 WatchSource:0}: Error finding container 85f8abfe469c57c40fb7398ffcb3a2f49726107f1d0c76a0c083136d7e662f24: Status 404 returned error can't find the container with id 85f8abfe469c57c40fb7398ffcb3a2f49726107f1d0c76a0c083136d7e662f24
Jul 08 17:20:51.629055 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.629033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:51.924148 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:51.924109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:52.334755 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:52.334721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:52.434313 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:52.434253    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5zg6" event={"ID":"f94bf8f8-9114-4958-96b4-ee1cbab650ad","Type":"ContainerStarted","Data":"85f8abfe469c57c40fb7398ffcb3a2f49726107f1d0c76a0c083136d7e662f24"}
Jul 08 17:20:52.576072 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:52.576039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:52.635623 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:52.635544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:53.260970 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:53.260933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:53.261160 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:53.261012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:53.261160 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:53.261116    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:53.261254 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:20:53.261170    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls podName:81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a nodeName:}" failed. No retries permitted until 2026-07-08 17:21:09.261156192 +0000 UTC m=+304.183747524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b5jvx" (UID: "81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:20:53.261655 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:53.261628    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:20:53.521574 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:53.521513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:53.920262 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:53.920225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:54.151365 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:54.151306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:54.323841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:54.323804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:54.442195 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:54.442160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5zg6" event={"ID":"f94bf8f8-9114-4958-96b4-ee1cbab650ad","Type":"ContainerStarted","Data":"bcbaaf2382c6a00482bd240fdd59089751c1a75e649350431bc2fa00652bdf03"}
Jul 08 17:20:54.442403 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:54.442218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5zg6" event={"ID":"f94bf8f8-9114-4958-96b4-ee1cbab650ad","Type":"ContainerStarted","Data":"5f503267be89ab47340f825959d0bef1372adb94f40a9aa42689cd32d9e83ac5"}
Jul 08 17:20:54.442403 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:54.442309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:20:54.460246 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:54.460200    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l5zg6" podStartSLOduration=251.529881104 podStartE2EDuration="4m13.460185387s" totalImagesPullingTime="1.930304283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:54.458402301 +0000 UTC m=+289.380993666" watchObservedRunningTime="2026-07-08 17:20:54.460185387 +0000 UTC m=+289.382776742"
Jul 08 17:20:54.522241 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:54.522211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:55.324467 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:55.324435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:55.524553 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:55.524520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:55.720515 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:55.720437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:55.838892 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:55.838865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:55.945219 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:55.945191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:56.008963 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:56.008895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:56.064481 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:56.064452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:56.162411 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:56.162384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:56.319780 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:56.319702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:56.508162 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:56.508122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:56.609047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:56.608980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:56.912126 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:56.912004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:57.007218 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:57.007194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:57.113796 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:57.113725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:57.214527 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:57.214414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:57.580167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:57.580138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:57.718982 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:57.718953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:58.162418 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:58.162384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:58.944396 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:58.944355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:20:59.045548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:20:59.045524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:02.364997 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:02.364967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:02.461575 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:02.461503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:03.585111 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:21:03.585069    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sbjfl" podUID="49a1850c-d280-45ac-b710-07f9ba7846af"
Jul 08 17:21:04.447120 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:04.447095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l5zg6"
Jul 08 17:21:05.509119 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:05.509096    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 17:21:07.612086 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.612031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:07.718864 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.718835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:07.780793 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.780761    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"]
Jul 08 17:21:07.783595 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.783577    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"
Jul 08 17:21:07.785938 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.785918    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 08 17:21:07.786043 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.785974    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r4d9n\""
Jul 08 17:21:07.790934 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.790914    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"]
Jul 08 17:21:07.797449 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.797427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:07.862799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.862752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/13d843e5-044b-426b-99d0-296e21ad7696-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7cwsv\" (UID: \"13d843e5-044b-426b-99d0-296e21ad7696\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"
Jul 08 17:21:07.963770 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:07.963750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/13d843e5-044b-426b-99d0-296e21ad7696-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7cwsv\" (UID: \"13d843e5-044b-426b-99d0-296e21ad7696\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"
Jul 08 17:21:07.963858 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:21:07.963845    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 08 17:21:07.963905 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:21:07.963896    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d843e5-044b-426b-99d0-296e21ad7696-tls-certificates podName:13d843e5-044b-426b-99d0-296e21ad7696 nodeName:}" failed. No retries permitted until 2026-07-08 17:21:08.463883826 +0000 UTC m=+303.386475159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/13d843e5-044b-426b-99d0-296e21ad7696-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-7cwsv" (UID: "13d843e5-044b-426b-99d0-296e21ad7696") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 08 17:21:08.382669 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:08.382635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:08.468211 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:08.468182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/13d843e5-044b-426b-99d0-296e21ad7696-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7cwsv\" (UID: \"13d843e5-044b-426b-99d0-296e21ad7696\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"
Jul 08 17:21:08.470865 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:08.470841    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/13d843e5-044b-426b-99d0-296e21ad7696-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7cwsv\" (UID: \"13d843e5-044b-426b-99d0-296e21ad7696\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"
Jul 08 17:21:08.693289 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:08.693208    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"
Jul 08 17:21:08.816343 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:08.816314    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"]
Jul 08 17:21:08.819587 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:21:08.819561    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d843e5_044b_426b_99d0_296e21ad7696.slice/crio-03a3d31a721f15bd88ed15d5b2d52a0acde3bf2517d0c5c7b5ed41faf20c50c0 WatchSource:0}: Error finding container 03a3d31a721f15bd88ed15d5b2d52a0acde3bf2517d0c5c7b5ed41faf20c50c0: Status 404 returned error can't find the container with id 03a3d31a721f15bd88ed15d5b2d52a0acde3bf2517d0c5c7b5ed41faf20c50c0
Jul 08 17:21:08.822093 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:08.822077    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:21:09.274114 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:09.274081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:21:09.276816 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:09.276796    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b5jvx\" (UID: \"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a\") " pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:21:09.365875 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:09.365843    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6zxwc\""
Jul 08 17:21:09.373943 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:09.373920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b5jvx"
Jul 08 17:21:09.488217 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:09.488189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv" event={"ID":"13d843e5-044b-426b-99d0-296e21ad7696","Type":"ContainerStarted","Data":"03a3d31a721f15bd88ed15d5b2d52a0acde3bf2517d0c5c7b5ed41faf20c50c0"}
Jul 08 17:21:09.501849 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:09.501828    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b5jvx"]
Jul 08 17:21:09.504621 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:21:09.504595    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d7a056_3c0d_4ddc_b9ec_b6a7c91d8c7a.slice/crio-797ab2582e169df1c05007890d67634ce9381ce8ba566028c8a4836ffa8b6ac9 WatchSource:0}: Error finding container 797ab2582e169df1c05007890d67634ce9381ce8ba566028c8a4836ffa8b6ac9: Status 404 returned error can't find the container with id 797ab2582e169df1c05007890d67634ce9381ce8ba566028c8a4836ffa8b6ac9
Jul 08 17:21:10.222578 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:10.222542    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:10.493934 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:10.493821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv" event={"ID":"13d843e5-044b-426b-99d0-296e21ad7696","Type":"ContainerStarted","Data":"4db944cb10ce3fa3408e502ba5a969000bc35de2bb99bf5ff4acd870809dd2eb"}
Jul 08 17:21:10.495010 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:10.494989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"
Jul 08 17:21:10.496151 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:10.495802    2578 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-d559d66d5-7cwsv container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.133.0.11:8443/healthz\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body=
Jul 08 17:21:10.496151 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:10.495859    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv" podUID="13d843e5-044b-426b-99d0-296e21ad7696" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.133.0.11:8443/healthz\": dial tcp 10.133.0.11:8443: connect: connection refused"
Jul 08 17:21:10.497505 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:10.497344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b5jvx" event={"ID":"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a","Type":"ContainerStarted","Data":"797ab2582e169df1c05007890d67634ce9381ce8ba566028c8a4836ffa8b6ac9"}
Jul 08 17:21:10.511193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:10.511086    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv" podStartSLOduration=1.953054371 podStartE2EDuration="3.511068033s" totalImagesPullingTime="1.558013662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:10.510377925 +0000 UTC m=+305.432969281" watchObservedRunningTime="2026-07-08 17:21:10.511068033 +0000 UTC m=+305.433659388"
Jul 08 17:21:11.417823 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:11.417789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:11.505335 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:11.505309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7cwsv"
Jul 08 17:21:11.519689 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:11.519661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:11.616692 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:11.616654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:11.804647 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:11.804614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:11.906759 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:11.906718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:12.010675 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:12.010613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:13.509034 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:13.509000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b5jvx" event={"ID":"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a","Type":"ContainerStarted","Data":"4c9cbee75965d381e4f22f6e6453b80e45acf1f34df6ee993efb43b78011a5e5"}
Jul 08 17:21:14.250483 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.250455    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:14.352704 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.352681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:14.479083 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.479025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:14.513819 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.513791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b5jvx" event={"ID":"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a","Type":"ContainerStarted","Data":"99ff1fd157f406642609ede5ae60d2e78544871ec544c64069cbbe7ac2a1a993"}
Jul 08 17:21:14.530563 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.530544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:14.584650 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.584631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:21:14.753526 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.753465    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bbcb89f8b-kbkf8"]
Jul 08 17:21:14.756392 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.756377    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.759590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.759560    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 17:21:14.759711 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.759589    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 17:21:14.760142 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.760128    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 17:21:14.760978 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.760957    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 17:21:14.760978 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.760978    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 17:21:14.761130 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.760991    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kr92\""
Jul 08 17:21:14.761130 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.760977    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 17:21:14.761130 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.760966    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 17:21:14.766583 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.766564    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbcb89f8b-kbkf8"]
Jul 08 17:21:14.817801 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.817782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-oauth-config\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.817898 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.817820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-config\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.817898 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.817850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-service-ca\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.817974 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.817897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-449k8\" (UniqueName: \"kubernetes.io/projected/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-kube-api-access-449k8\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.817974 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.817937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-serving-cert\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.817974 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.817955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-oauth-serving-cert\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.821019 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.820976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:14.887114 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.887088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:14.918566 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.918541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-oauth-config\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.918670 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.918586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-config\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.918670 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.918610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-service-ca\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.918670 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.918639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-449k8\" (UniqueName: \"kubernetes.io/projected/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-kube-api-access-449k8\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.918839 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.918670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-serving-cert\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.918839 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.918697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-oauth-serving-cert\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.919549 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.919496    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-config\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.920221 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.920158    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-service-ca\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.920221 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.920157    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-oauth-serving-cert\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.921552 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.921527    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-serving-cert\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.921849 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.921830    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-oauth-config\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:14.928218 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:14.928195    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-449k8\" (UniqueName: \"kubernetes.io/projected/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-kube-api-access-449k8\") pod \"console-bbcb89f8b-kbkf8\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") " pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:15.065156 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:15.065128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:15.206776 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:15.206746    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbcb89f8b-kbkf8"]
Jul 08 17:21:15.209765 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:21:15.209735    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ce49f6_b827_4fda_b7d1_f6e7832e3a1a.slice/crio-8e9c914c4ddc003f59c30b875a89d4063d39f8870f17b6a3c3ae64c8a92c1333 WatchSource:0}: Error finding container 8e9c914c4ddc003f59c30b875a89d4063d39f8870f17b6a3c3ae64c8a92c1333: Status 404 returned error can't find the container with id 8e9c914c4ddc003f59c30b875a89d4063d39f8870f17b6a3c3ae64c8a92c1333
Jul 08 17:21:15.512790 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:15.512699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:15.518733 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:15.518701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbcb89f8b-kbkf8" event={"ID":"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a","Type":"ContainerStarted","Data":"8e9c914c4ddc003f59c30b875a89d4063d39f8870f17b6a3c3ae64c8a92c1333"}
Jul 08 17:21:16.940740 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:16.940661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.040559 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.040528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.156478 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.156452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.204966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.204944    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8hdlm"]
Jul 08 17:21:17.208028 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.208012    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.210954 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.210871    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 17:21:17.210954 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.210892    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 17:21:17.211121 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.210992    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 17:21:17.212171 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.211919    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 17:21:17.212171 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.211964    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 17:21:17.212335 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.212201    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p2wsh\""
Jul 08 17:21:17.212474 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.212456    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 17:21:17.240079 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.240030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.299829 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.299769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.337441 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-root\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.337562 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-wtmp\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.337562 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.337562 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.337731 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-textfile\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.337731 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-sys\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.337731 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-metrics-client-ca\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.337864 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-tls\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.337864 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.337776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p56s8\" (UniqueName: \"kubernetes.io/projected/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-kube-api-access-p56s8\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.368776 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.368746    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.436488 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.436458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.438550 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-tls\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438677 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p56s8\" (UniqueName: \"kubernetes.io/projected/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-kube-api-access-p56s8\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438677 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-root\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438677 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-wtmp\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438677 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438912 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438912 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438713    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-root\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438912 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-textfile\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438912 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-sys\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438912 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438806    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-wtmp\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.438912 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-metrics-client-ca\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.439206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.438924    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-sys\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.439206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.439110    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-textfile\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.439330 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.439310    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.439509 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.439491    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-metrics-client-ca\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.441678 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.441655    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-tls\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.441678 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.441673    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.447608 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.447547    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56s8\" (UniqueName: \"kubernetes.io/projected/42efd990-d9e2-4e2d-bdfd-fde081ea76cd-kube-api-access-p56s8\") pod \"node-exporter-8hdlm\" (UID: \"42efd990-d9e2-4e2d-bdfd-fde081ea76cd\") " pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.519461 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.519432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8hdlm"
Jul 08 17:21:17.528410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.528373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b5jvx" event={"ID":"81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a","Type":"ContainerStarted","Data":"9d3cf3c03c404e4af56e76a6019bb14aa18b79f9d91480a808f96fcc082e5448"}
Jul 08 17:21:17.538906 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.538880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.547636 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.547593    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b5jvx" podStartSLOduration=33.038952255 podStartE2EDuration="40.547575023s" totalImagesPullingTime="7.508622768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:20:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:17.54700727 +0000 UTC m=+312.469598629" watchObservedRunningTime="2026-07-08 17:21:17.547575023 +0000 UTC m=+312.470166378"
Jul 08 17:21:17.672012 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.671981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:17.813087 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:17.813045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:18.218846 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.218736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:18.281318 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.281292    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:21:18.285309 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.285287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.285817 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:21:18.285795    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42efd990_d9e2_4e2d_bdfd_fde081ea76cd.slice/crio-460e0650c14ea3c4696c7040682bbd7278e4c4dae783d535fc017e5a2455286a WatchSource:0}: Error finding container 460e0650c14ea3c4696c7040682bbd7278e4c4dae783d535fc017e5a2455286a: Status 404 returned error can't find the container with id 460e0650c14ea3c4696c7040682bbd7278e4c4dae783d535fc017e5a2455286a
Jul 08 17:21:18.292694 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.292675    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 17:21:18.292774 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.292679    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 17:21:18.292823 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.292804    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 17:21:18.292959 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.292907    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 17:21:18.292959 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.292941    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 17:21:18.293129 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.292978    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 17:21:18.293129 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.293089    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5xp9c\""
Jul 08 17:21:18.293235 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.293191    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 17:21:18.293324 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.293310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 17:21:18.294158 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.294131    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 17:21:18.302853 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.302781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:21:18.306809 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.306762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:18.345866 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.345849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.345916 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.345876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.345916 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.345900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346009 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.345989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346053 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346087 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-web-config\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxfg\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-kube-api-access-wtxfg\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346195 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346195 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346256 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346256 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-out\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346345 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.346345 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.346289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.446870 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.446838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.446876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.446899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-web-config\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.446922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxfg\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-kube-api-access-wtxfg\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-out\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447505 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447505 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447505 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.447505 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.447359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.448545 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.448186    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.448992 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.448968    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.449577 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.449306    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.450376 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.450194    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-web-config\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.450869 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.450821    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.451196 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.451174    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-out\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.451667 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.451642    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.451772 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.451686    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.452062 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.452038    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.452451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.452426    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.452548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.452530    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.453192 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.453172    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.454368 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.454349    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxfg\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-kube-api-access-wtxfg\") pod \"alertmanager-main-0\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.533352 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.533307    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8hdlm" event={"ID":"42efd990-d9e2-4e2d-bdfd-fde081ea76cd","Type":"ContainerStarted","Data":"460e0650c14ea3c4696c7040682bbd7278e4c4dae783d535fc017e5a2455286a"}
Jul 08 17:21:18.534841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.534816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbcb89f8b-kbkf8" event={"ID":"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a","Type":"ContainerStarted","Data":"d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a"}
Jul 08 17:21:18.555914 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.555759    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bbcb89f8b-kbkf8" podStartSLOduration=1.437595194 podStartE2EDuration="4.555748411s" totalImagesPullingTime="3.118153217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:18.555440008 +0000 UTC m=+313.478031364" watchObservedRunningTime="2026-07-08 17:21:18.555748411 +0000 UTC m=+313.478339765"
Jul 08 17:21:18.604787 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.604767    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:21:18.752652 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:18.752612    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:21:18.756760 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:21:18.756736    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccac9a1_004d_4f65_8277_28d5390c12d8.slice/crio-ed2119802a642c607a74df114a5f278fa9381fd18b52ab01609286fe5a92406e WatchSource:0}: Error finding container ed2119802a642c607a74df114a5f278fa9381fd18b52ab01609286fe5a92406e: Status 404 returned error can't find the container with id ed2119802a642c607a74df114a5f278fa9381fd18b52ab01609286fe5a92406e
Jul 08 17:21:19.541055 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:19.540422    2578 generic.go:356] "Generic (PLEG): container finished" podID="42efd990-d9e2-4e2d-bdfd-fde081ea76cd" containerID="bf6a7034501a6f9a6562663f7e2d103ada4df64de965a277ea247d7b47d33e6c" exitCode=0
Jul 08 17:21:19.541055 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:19.540475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8hdlm" event={"ID":"42efd990-d9e2-4e2d-bdfd-fde081ea76cd","Type":"ContainerDied","Data":"bf6a7034501a6f9a6562663f7e2d103ada4df64de965a277ea247d7b47d33e6c"}
Jul 08 17:21:19.542646 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:19.542618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerStarted","Data":"ed2119802a642c607a74df114a5f278fa9381fd18b52ab01609286fe5a92406e"}
Jul 08 17:21:20.115658 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.115619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:20.215528 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.215496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:20.336515 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.336489    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dcffbb844-x54kt"]
Jul 08 17:21:20.339967 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.339950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.343423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.343406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 17:21:20.343778 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.343759    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-501gr5fbmvcet\""
Jul 08 17:21:20.343855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.343770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:20.343855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.343847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 17:21:20.343967 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.343923    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 17:21:20.344018 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.344012    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 17:21:20.345643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.345628    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z5wtk\""
Jul 08 17:21:20.345727 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.345714    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 17:21:20.356046 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.356025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dcffbb844-x54kt"]
Jul 08 17:21:20.425928 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.425904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:20.464155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.464129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.464239 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.464165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.464239 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.464188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2321f7be-60e1-4f36-9b57-abdb09373e5b-metrics-client-ca\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.464239 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.464203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mwxb\" (UniqueName: \"kubernetes.io/projected/2321f7be-60e1-4f36-9b57-abdb09373e5b-kube-api-access-8mwxb\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.464381 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.464298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-tls\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.464381 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.464321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.464381 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.464343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.464381 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.464367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-grpc-tls\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.529702 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.529681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:20.548318 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.548288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8hdlm" event={"ID":"42efd990-d9e2-4e2d-bdfd-fde081ea76cd","Type":"ContainerStarted","Data":"8bf26c541deca086f7c0e5460ee7601bc7bb6bf1b1f6ac96aca7e3eb220dfb2e"}
Jul 08 17:21:20.548634 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.548344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8hdlm" event={"ID":"42efd990-d9e2-4e2d-bdfd-fde081ea76cd","Type":"ContainerStarted","Data":"4a6b6eaac617b0b1323b99d81dec746bab2a72dc1d98469705f2695d1e3f98e4"}
Jul 08 17:21:20.549916 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.549892    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerID="ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd" exitCode=0
Jul 08 17:21:20.550005 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.549945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerDied","Data":"ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd"}
Jul 08 17:21:20.565390 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.565365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.565481 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.565398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2321f7be-60e1-4f36-9b57-abdb09373e5b-metrics-client-ca\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.565481 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.565421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mwxb\" (UniqueName: \"kubernetes.io/projected/2321f7be-60e1-4f36-9b57-abdb09373e5b-kube-api-access-8mwxb\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.565481 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.565464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-tls\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.565698 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.565491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.565698 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.565522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.565698 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.565547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-grpc-tls\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.565698 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.565611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.566327 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.566293    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2321f7be-60e1-4f36-9b57-abdb09373e5b-metrics-client-ca\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.568797 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.568773    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.568914 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.568799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-grpc-tls\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.568914 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.568873    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-tls\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.568914 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.568902    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.569063 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.568935    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.569063 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.568992    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2321f7be-60e1-4f36-9b57-abdb09373e5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.572216 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.572174    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8hdlm" podStartSLOduration=2.625734039 podStartE2EDuration="3.572160325s" totalImagesPullingTime="873.070618ms" totalInitContainerRuntime="73.355668ms" isStatefulPod=true podCreationTimestamp="2026-07-08 17:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:20.571647641 +0000 UTC m=+315.494238998" watchObservedRunningTime="2026-07-08 17:21:20.572160325 +0000 UTC m=+315.494751680"
Jul 08 17:21:20.577774 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.577606    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mwxb\" (UniqueName: \"kubernetes.io/projected/2321f7be-60e1-4f36-9b57-abdb09373e5b-kube-api-access-8mwxb\") pod \"thanos-querier-7dcffbb844-x54kt\" (UID: \"2321f7be-60e1-4f36-9b57-abdb09373e5b\") " pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.602598 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.602571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:20.683532 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.683478    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:20.813858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:20.813831    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dcffbb844-x54kt"]
Jul 08 17:21:20.817118 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:21:20.817088    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2321f7be_60e1_4f36_9b57_abdb09373e5b.slice/crio-f1eec3032d4a80d9a860749dc688731de5c6bad82595e27d77f4af5cac282f01 WatchSource:0}: Error finding container f1eec3032d4a80d9a860749dc688731de5c6bad82595e27d77f4af5cac282f01: Status 404 returned error can't find the container with id f1eec3032d4a80d9a860749dc688731de5c6bad82595e27d77f4af5cac282f01
Jul 08 17:21:21.554197 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.554167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt" event={"ID":"2321f7be-60e1-4f36-9b57-abdb09373e5b","Type":"ContainerStarted","Data":"f1eec3032d4a80d9a860749dc688731de5c6bad82595e27d77f4af5cac282f01"}
Jul 08 17:21:21.561812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.561787    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-975bb49b5-jskwb"]
Jul 08 17:21:21.564928 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.564902    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.574102 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.573923    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 17:21:21.575913 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.575891    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-975bb49b5-jskwb"]
Jul 08 17:21:21.675204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.674637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-oauth-config\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.675204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.674677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-oauth-serving-cert\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.675204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.674705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kzqf\" (UniqueName: \"kubernetes.io/projected/6f320f24-fd19-4500-a96f-e74503124a02-kube-api-access-5kzqf\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.675204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.674778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-serving-cert\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.675204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.674887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-console-config\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.675204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.674956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-trusted-ca-bundle\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.675204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.674989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-service-ca\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.776184 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.776146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-trusted-ca-bundle\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.776392 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.776200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-service-ca\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.776392 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.776329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-oauth-config\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.776392 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.776379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-oauth-serving-cert\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.776556 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.776408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kzqf\" (UniqueName: \"kubernetes.io/projected/6f320f24-fd19-4500-a96f-e74503124a02-kube-api-access-5kzqf\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.776556 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.776472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-serving-cert\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.776661 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.776557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-console-config\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.777151 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.776956    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-service-ca\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.777151 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.777101    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-trusted-ca-bundle\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.777343 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.777261    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-console-config\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.777404 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.777368    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-oauth-serving-cert\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.779897 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.779876    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-oauth-config\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.780001 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.779976    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-serving-cert\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.785156 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.785133    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kzqf\" (UniqueName: \"kubernetes.io/projected/6f320f24-fd19-4500-a96f-e74503124a02-kube-api-access-5kzqf\") pod \"console-975bb49b5-jskwb\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") " pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.877207 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.877131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:21.958340 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:21.958306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:22.042254 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.042200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:22.158841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.158808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:22.233405 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.233382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-975bb49b5-jskwb"]
Jul 08 17:21:22.237286 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:21:22.237242    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f320f24_fd19_4500_a96f_e74503124a02.slice/crio-51b215ac0a6bc571a852a0ccc40276ca7fe7c518d0283a1dc4081c3ea380834b WatchSource:0}: Error finding container 51b215ac0a6bc571a852a0ccc40276ca7fe7c518d0283a1dc4081c3ea380834b: Status 404 returned error can't find the container with id 51b215ac0a6bc571a852a0ccc40276ca7fe7c518d0283a1dc4081c3ea380834b
Jul 08 17:21:22.561653 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.561618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerStarted","Data":"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2"}
Jul 08 17:21:22.562047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.561700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerStarted","Data":"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54"}
Jul 08 17:21:22.562047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.561737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerStarted","Data":"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178"}
Jul 08 17:21:22.562047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.561764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerStarted","Data":"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd"}
Jul 08 17:21:22.562047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.561798    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerStarted","Data":"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72"}
Jul 08 17:21:22.563415 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.563381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-975bb49b5-jskwb" event={"ID":"6f320f24-fd19-4500-a96f-e74503124a02","Type":"ContainerStarted","Data":"a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef"}
Jul 08 17:21:22.563533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.563433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-975bb49b5-jskwb" event={"ID":"6f320f24-fd19-4500-a96f-e74503124a02","Type":"ContainerStarted","Data":"51b215ac0a6bc571a852a0ccc40276ca7fe7c518d0283a1dc4081c3ea380834b"}
Jul 08 17:21:22.584002 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:22.583949    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-975bb49b5-jskwb" podStartSLOduration=1.5839302050000001 podStartE2EDuration="1.583930205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:22.581867668 +0000 UTC m=+317.504459024" watchObservedRunningTime="2026-07-08 17:21:22.583930205 +0000 UTC m=+317.506521560"
Jul 08 17:21:23.368926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.368891    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:21:23.372770 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.372748    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.373448 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.373425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:23.375992 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.375568    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 17:21:23.375992 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.375730    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gl9wg\""
Jul 08 17:21:23.375992 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.375849    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 17:21:23.375992 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.375944    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 17:21:23.375992 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.375957    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 17:21:23.375992 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.375957    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 17:21:23.376500 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.375947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 17:21:23.376500 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.376077    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cifee2kbnomqc\""
Jul 08 17:21:23.376723 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.376705    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 17:21:23.377797 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.377483    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 17:21:23.377797 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.377560    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 17:21:23.377797 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.377733    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 17:21:23.377999 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.377888    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 17:21:23.377999 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.377901    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 17:21:23.378115 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.378094    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 17:21:23.378218 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.378104    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 17:21:23.378869 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.378849    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 17:21:23.389941 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.389922    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:21:23.493733 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.493879 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.493879 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.493879 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-web-config\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.493879 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.493879 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494058 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494058 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-config\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494058 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.493975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494058 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494263 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494263 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-config-out\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494263 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494263 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494263 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwrf\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-kube-api-access-nbwrf\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494465 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494465 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494465 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494465 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.494465 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.494412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595024 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.594996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-config\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-config-out\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwrf\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-kube-api-access-nbwrf\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.595464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595469    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-web-config\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.595801    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596603 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.596215    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.596603 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.596235    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.599423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.598514    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-config\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.599423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.598871    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.599423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.599116    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.599423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.599102    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-web-config\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.599423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.599383    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.599722 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.599539    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.600262 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.599968    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-config-out\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.600262 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.599999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.600262 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.600087    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.600727 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.600683    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.601660 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.601629    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.602473 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.602426    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.602735 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.602717    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.603007 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.602983    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.603795 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.603767    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.608431 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.608369    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwrf\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-kube-api-access-nbwrf\") pod \"prometheus-k8s-0\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.684103 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.684031    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:23.882441 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.882418    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:21:23.886139 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:21:23.886116    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3321c176_4ea3_4566_98df_23a558dcd10e.slice/crio-4a9c3d62223da9e80d3586815cad53799b79beb431c5c1d5d9ed414c63560405 WatchSource:0}: Error finding container 4a9c3d62223da9e80d3586815cad53799b79beb431c5c1d5d9ed414c63560405: Status 404 returned error can't find the container with id 4a9c3d62223da9e80d3586815cad53799b79beb431c5c1d5d9ed414c63560405
Jul 08 17:21:23.889802 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.889759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:23.975445 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:23.975406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:24.076042 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.076011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:24.172177 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.172142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:24.574940 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.574902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt" event={"ID":"2321f7be-60e1-4f36-9b57-abdb09373e5b","Type":"ContainerStarted","Data":"7bf61400f3f90689ed67184e8ffcc8b1a58fa0b4f0e3f409818730fefcc7f380"}
Jul 08 17:21:24.575109 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.575004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt" event={"ID":"2321f7be-60e1-4f36-9b57-abdb09373e5b","Type":"ContainerStarted","Data":"760a07582d4fc01f04808434b5ad074fcc236140b68d39c12d85c2b95139971c"}
Jul 08 17:21:24.575109 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.575047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:24.575109 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.575081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt" event={"ID":"2321f7be-60e1-4f36-9b57-abdb09373e5b","Type":"ContainerStarted","Data":"21a25e89d4228b91077fb78c07e832ae17b9831f51d08948c20c9e726fac5ef9"}
Jul 08 17:21:24.575311 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.575114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt" event={"ID":"2321f7be-60e1-4f36-9b57-abdb09373e5b","Type":"ContainerStarted","Data":"18874e65c42fb570830837084659b9779a03ceebd45ea94db535b5b60fb75a16"}
Jul 08 17:21:24.575311 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.575139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt" event={"ID":"2321f7be-60e1-4f36-9b57-abdb09373e5b","Type":"ContainerStarted","Data":"4f30a2625cfd0319abc921607a0098a1481d15ef3cac740433e12b6a8983d657"}
Jul 08 17:21:24.575311 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.575175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt" event={"ID":"2321f7be-60e1-4f36-9b57-abdb09373e5b","Type":"ContainerStarted","Data":"a4f94f91d147b34c1d040cf83cdce0b6c313fbc872f891ea74b2490a67166876"}
Jul 08 17:21:24.576573 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.576547    2578 generic.go:356] "Generic (PLEG): container finished" podID="3321c176-4ea3-4566-98df-23a558dcd10e" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794" exitCode=0
Jul 08 17:21:24.576694 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.576634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerDied","Data":"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"}
Jul 08 17:21:24.576738 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.576722    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerStarted","Data":"4a9c3d62223da9e80d3586815cad53799b79beb431c5c1d5d9ed414c63560405"}
Jul 08 17:21:24.580480 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.580455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerStarted","Data":"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558"}
Jul 08 17:21:24.597461 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.597421    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt" podStartSLOduration=1.6742733379999999 podStartE2EDuration="4.597408139s" totalImagesPullingTime="2.923134801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:24.596855983 +0000 UTC m=+319.519447337" watchObservedRunningTime="2026-07-08 17:21:24.597408139 +0000 UTC m=+319.519999494"
Jul 08 17:21:24.650491 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:24.650444    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.323897642 podStartE2EDuration="6.650429823s" totalImagesPullingTime="4.311169449s" totalInitContainerRuntime="15.362732ms" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:24.648362328 +0000 UTC m=+319.570953683" watchObservedRunningTime="2026-07-08 17:21:24.650429823 +0000 UTC m=+319.573021178"
Jul 08 17:21:25.065890 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:25.065861    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:25.066041 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:25.065913    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:25.070649 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:25.070627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:25.354213 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:25.354137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:25.452376 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:25.452343    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:25.592512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:25.592451    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:21:25.955685 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:25.955658    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-975bb49b5-jskwb"]
Jul 08 17:21:26.009489 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:26.009453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:26.111721 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:26.111691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:26.767155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:26.767114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:26.867147 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:26.867091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:27.502403 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:27.502364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:27.570001 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:27.569970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:28.601558 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:28.601523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerStarted","Data":"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"}
Jul 08 17:21:28.602008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:28.601599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerStarted","Data":"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"}
Jul 08 17:21:28.602008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:28.601651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerStarted","Data":"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"}
Jul 08 17:21:28.602008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:28.601696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerStarted","Data":"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"}
Jul 08 17:21:28.602008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:28.601743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerStarted","Data":"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"}
Jul 08 17:21:28.602008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:28.601783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerStarted","Data":"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"}
Jul 08 17:21:28.628656 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:28.628603    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.220599189 podStartE2EDuration="5.628581652s" totalImagesPullingTime="3.384820771s" totalInitContainerRuntime="23.161692ms" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:28.627942649 +0000 UTC m=+323.550534006" watchObservedRunningTime="2026-07-08 17:21:28.628581652 +0000 UTC m=+323.551173212"
Jul 08 17:21:28.684686 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:28.684664    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:21:30.594400 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:30.594372    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dcffbb844-x54kt"
Jul 08 17:21:31.877573 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:31.877539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:35.285080 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:35.285039    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" podUID="76458729-8e5b-4827-9313-17efe1f18bae" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 17:21:37.185427 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:37.185391    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:37.195931 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:37.195903    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bbcb89f8b-kbkf8"]
Jul 08 17:21:37.315493 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:37.315446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:37.420565 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:37.420537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:37.551615 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:37.551591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:41.006186 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:41.006148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:41.103477 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:41.103452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:45.284586 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:45.284551    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" podUID="76458729-8e5b-4827-9313-17efe1f18bae" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 17:21:49.221722 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:49.221688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:49.320426 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:49.320400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:50.975746 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:50.975702    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-975bb49b5-jskwb" podUID="6f320f24-fd19-4500-a96f-e74503124a02" containerName="console" containerID="cri-o://a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef" gracePeriod=15
Jul 08 17:21:51.218314 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.218292    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:51.225342 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-oauth-config\") pod \"6f320f24-fd19-4500-a96f-e74503124a02\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") "
Jul 08 17:21:51.225466 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225364    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-console-config\") pod \"6f320f24-fd19-4500-a96f-e74503124a02\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") "
Jul 08 17:21:51.225466 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225393    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-oauth-serving-cert\") pod \"6f320f24-fd19-4500-a96f-e74503124a02\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") "
Jul 08 17:21:51.225466 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225419    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kzqf\" (UniqueName: \"kubernetes.io/projected/6f320f24-fd19-4500-a96f-e74503124a02-kube-api-access-5kzqf\") pod \"6f320f24-fd19-4500-a96f-e74503124a02\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") "
Jul 08 17:21:51.225466 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-serving-cert\") pod \"6f320f24-fd19-4500-a96f-e74503124a02\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") "
Jul 08 17:21:51.225728 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-trusted-ca-bundle\") pod \"6f320f24-fd19-4500-a96f-e74503124a02\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") "
Jul 08 17:21:51.225728 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225526    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-service-ca\") pod \"6f320f24-fd19-4500-a96f-e74503124a02\" (UID: \"6f320f24-fd19-4500-a96f-e74503124a02\") "
Jul 08 17:21:51.225929 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225785    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-console-config" (OuterVolumeSpecName: "console-config") pod "6f320f24-fd19-4500-a96f-e74503124a02" (UID: "6f320f24-fd19-4500-a96f-e74503124a02"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:21:51.225929 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225824    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6f320f24-fd19-4500-a96f-e74503124a02" (UID: "6f320f24-fd19-4500-a96f-e74503124a02"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:21:51.226035 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225972    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6f320f24-fd19-4500-a96f-e74503124a02" (UID: "6f320f24-fd19-4500-a96f-e74503124a02"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:21:51.226035 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.225995    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-service-ca" (OuterVolumeSpecName: "service-ca") pod "6f320f24-fd19-4500-a96f-e74503124a02" (UID: "6f320f24-fd19-4500-a96f-e74503124a02"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:21:51.227797 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.227769    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6f320f24-fd19-4500-a96f-e74503124a02" (UID: "6f320f24-fd19-4500-a96f-e74503124a02"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:21:51.227797 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.227781    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6f320f24-fd19-4500-a96f-e74503124a02" (UID: "6f320f24-fd19-4500-a96f-e74503124a02"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:21:51.227797 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.227779    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f320f24-fd19-4500-a96f-e74503124a02-kube-api-access-5kzqf" (OuterVolumeSpecName: "kube-api-access-5kzqf") pod "6f320f24-fd19-4500-a96f-e74503124a02" (UID: "6f320f24-fd19-4500-a96f-e74503124a02"). InnerVolumeSpecName "kube-api-access-5kzqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:21:51.326854 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.326817    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-oauth-config\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:21:51.326854 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.326851    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-console-config\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:21:51.326854 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.326861    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-oauth-serving-cert\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:21:51.327047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.326870    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kzqf\" (UniqueName: \"kubernetes.io/projected/6f320f24-fd19-4500-a96f-e74503124a02-kube-api-access-5kzqf\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:21:51.327047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.326879    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f320f24-fd19-4500-a96f-e74503124a02-console-serving-cert\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:21:51.327047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.326888    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-trusted-ca-bundle\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:21:51.327047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.326896    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f320f24-fd19-4500-a96f-e74503124a02-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:21:51.689660 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.689629    2578 generic.go:356] "Generic (PLEG): container finished" podID="6f320f24-fd19-4500-a96f-e74503124a02" containerID="a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef" exitCode=0
Jul 08 17:21:51.689785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.689668    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-975bb49b5-jskwb"
Jul 08 17:21:51.689785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.689716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-975bb49b5-jskwb" event={"ID":"6f320f24-fd19-4500-a96f-e74503124a02","Type":"ContainerDied","Data":"a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef"}
Jul 08 17:21:51.689785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.689763    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-975bb49b5-jskwb" event={"ID":"6f320f24-fd19-4500-a96f-e74503124a02","Type":"ContainerDied","Data":"51b215ac0a6bc571a852a0ccc40276ca7fe7c518d0283a1dc4081c3ea380834b"}
Jul 08 17:21:51.689785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.689784    2578 scope.go:117] "RemoveContainer" containerID="a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef"
Jul 08 17:21:51.698707 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.698690    2578 scope.go:117] "RemoveContainer" containerID="a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef"
Jul 08 17:21:51.698945 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:21:51.698923    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef\": container with ID starting with a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef not found: ID does not exist" containerID="a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef"
Jul 08 17:21:51.699011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.698957    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef"} err="failed to get container status \"a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef\": rpc error: code = NotFound desc = could not find container \"a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef\": container with ID starting with a3ec1899a4b6af6b788008ec04bf13216a0b60661127056268ab7820714141ef not found: ID does not exist"
Jul 08 17:21:51.706404 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.706385    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-975bb49b5-jskwb"]
Jul 08 17:21:51.709547 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:51.709528    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-975bb49b5-jskwb"]
Jul 08 17:21:53.591508 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:53.591478    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f320f24-fd19-4500-a96f-e74503124a02" path="/var/lib/kubelet/pods/6f320f24-fd19-4500-a96f-e74503124a02/volumes"
Jul 08 17:21:55.285250 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:55.285214    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" podUID="76458729-8e5b-4827-9313-17efe1f18bae" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 17:21:55.285672 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:55.285307    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc"
Jul 08 17:21:55.285857 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:55.285839    2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b7aebf209e982b9e95819bda08b0485eb5a31b9dd34aad7c75a04cbf5062ac77"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 08 17:21:55.285901 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:55.285885    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" podUID="76458729-8e5b-4827-9313-17efe1f18bae" containerName="service-proxy" containerID="cri-o://b7aebf209e982b9e95819bda08b0485eb5a31b9dd34aad7c75a04cbf5062ac77" gracePeriod=30
Jul 08 17:21:55.707359 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:55.707262    2578 generic.go:356] "Generic (PLEG): container finished" podID="76458729-8e5b-4827-9313-17efe1f18bae" containerID="b7aebf209e982b9e95819bda08b0485eb5a31b9dd34aad7c75a04cbf5062ac77" exitCode=2
Jul 08 17:21:55.707359 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:55.707336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" event={"ID":"76458729-8e5b-4827-9313-17efe1f18bae","Type":"ContainerDied","Data":"b7aebf209e982b9e95819bda08b0485eb5a31b9dd34aad7c75a04cbf5062ac77"}
Jul 08 17:21:55.707525 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:55.707377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f54f46cf-6lcjc" event={"ID":"76458729-8e5b-4827-9313-17efe1f18bae","Type":"ContainerStarted","Data":"e5dc663da899395975dad338f2f1440cd850435ca5e0d5b1f0e0859ce04e085d"}
Jul 08 17:21:56.009337 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:56.009232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:21:56.108799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:21:56.108771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:02.216614 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.216496    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bbcb89f8b-kbkf8" podUID="97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" containerName="console" containerID="cri-o://d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a" gracePeriod=15
Jul 08 17:22:02.461997 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.461965    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:22:02.509696 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.509617    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-449k8\" (UniqueName: \"kubernetes.io/projected/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-kube-api-access-449k8\") pod \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") "
Jul 08 17:22:02.509696 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.509686    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-serving-cert\") pod \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") "
Jul 08 17:22:02.509896 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.509714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-oauth-serving-cert\") pod \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") "
Jul 08 17:22:02.509896 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.509745    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-service-ca\") pod \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") "
Jul 08 17:22:02.509896 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.509791    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-oauth-config\") pod \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") "
Jul 08 17:22:02.509896 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.509839    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-config\") pod \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\" (UID: \"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a\") "
Jul 08 17:22:02.510193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.510153    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" (UID: "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:02.510193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.510171    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" (UID: "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:02.510438 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.510418    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-config" (OuterVolumeSpecName: "console-config") pod "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" (UID: "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:02.512030 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.512007    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-kube-api-access-449k8" (OuterVolumeSpecName: "kube-api-access-449k8") pod "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" (UID: "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a"). InnerVolumeSpecName "kube-api-access-449k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:22:02.512126 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.512034    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" (UID: "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:02.512318 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.512289    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" (UID: "97ce49f6-b827-4fda-b7d1-f6e7832e3a1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:02.611055 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.611029    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:02.611055 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.611050    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-oauth-config\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:02.611197 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.611059    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-config\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:02.611197 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.611068    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-449k8\" (UniqueName: \"kubernetes.io/projected/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-kube-api-access-449k8\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:02.611197 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.611076    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-console-serving-cert\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:02.611197 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.611084    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a-oauth-serving-cert\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:02.733427 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.733401    2578 generic.go:356] "Generic (PLEG): container finished" podID="97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" containerID="d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a" exitCode=0
Jul 08 17:22:02.733542 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.733438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbcb89f8b-kbkf8" event={"ID":"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a","Type":"ContainerDied","Data":"d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a"}
Jul 08 17:22:02.733542 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.733446    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbcb89f8b-kbkf8"
Jul 08 17:22:02.733542 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.733474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbcb89f8b-kbkf8" event={"ID":"97ce49f6-b827-4fda-b7d1-f6e7832e3a1a","Type":"ContainerDied","Data":"8e9c914c4ddc003f59c30b875a89d4063d39f8870f17b6a3c3ae64c8a92c1333"}
Jul 08 17:22:02.733542 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.733493    2578 scope.go:117] "RemoveContainer" containerID="d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a"
Jul 08 17:22:02.743028 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.743013    2578 scope.go:117] "RemoveContainer" containerID="d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a"
Jul 08 17:22:02.743298 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:02.743257    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a\": container with ID starting with d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a not found: ID does not exist" containerID="d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a"
Jul 08 17:22:02.743361 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.743305    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a"} err="failed to get container status \"d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a\": rpc error: code = NotFound desc = could not find container \"d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a\": container with ID starting with d472d6486a2e302d656beafd74442ffd168fbdcc885010c3164564efec17897a not found: ID does not exist"
Jul 08 17:22:02.755943 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.755920    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bbcb89f8b-kbkf8"]
Jul 08 17:22:02.759810 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:02.759765    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bbcb89f8b-kbkf8"]
Jul 08 17:22:03.589638 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:03.589604    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" path="/var/lib/kubelet/pods/97ce49f6-b827-4fda-b7d1-f6e7832e3a1a/volumes"
Jul 08 17:22:19.444942 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:19.444907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:22:19.447339 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:19.447310    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a1850c-d280-45ac-b710-07f9ba7846af-metrics-certs\") pod \"network-metrics-daemon-sbjfl\" (UID: \"49a1850c-d280-45ac-b710-07f9ba7846af\") " pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:22:19.687960 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:19.687934    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xkss2\""
Jul 08 17:22:19.695357 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:19.695313    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjfl"
Jul 08 17:22:19.821996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:19.821973    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sbjfl"]
Jul 08 17:22:19.824423 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:22:19.824391    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a1850c_d280_45ac_b710_07f9ba7846af.slice/crio-f1e00fb1cf4b9de4ced2d6d0c6bf74263c5a140435c30660ba4324657c61b7ed WatchSource:0}: Error finding container f1e00fb1cf4b9de4ced2d6d0c6bf74263c5a140435c30660ba4324657c61b7ed: Status 404 returned error can't find the container with id f1e00fb1cf4b9de4ced2d6d0c6bf74263c5a140435c30660ba4324657c61b7ed
Jul 08 17:22:20.802758 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:20.802718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbjfl" event={"ID":"49a1850c-d280-45ac-b710-07f9ba7846af","Type":"ContainerStarted","Data":"f1e00fb1cf4b9de4ced2d6d0c6bf74263c5a140435c30660ba4324657c61b7ed"}
Jul 08 17:22:21.695803 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:21.695747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:21.751041 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:21.751019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:21.809858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:21.809834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbjfl" event={"ID":"49a1850c-d280-45ac-b710-07f9ba7846af","Type":"ContainerStarted","Data":"bc2a08837b77af162c5b04a42bb3110aa965b16fd1751e4c4b815b641f1a44ea"}
Jul 08 17:22:21.810314 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:21.809885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbjfl" event={"ID":"49a1850c-d280-45ac-b710-07f9ba7846af","Type":"ContainerStarted","Data":"558fac3441593f7f30231374c64ee6c3a910b76ddc58ee8c391b04f328f0ecf2"}
Jul 08 17:22:21.811621 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:21.811601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:21.829010 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:21.828965    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sbjfl" podStartSLOduration=374.802260155 podStartE2EDuration="6m15.828952725s" totalImagesPullingTime="1.02669257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:22:21.827078572 +0000 UTC m=+376.749669952" watchObservedRunningTime="2026-07-08 17:22:21.828952725 +0000 UTC m=+376.751544079"
Jul 08 17:22:21.921329 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:21.921303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:22.077408 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:22.077369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:22.138286 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:22.138251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:23.684483 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:23.684439    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:23.706328 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:23.706304    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:23.832359 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:23.832335    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:36.443928 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:36.443888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:36.851028 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:36.850998    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:37.556397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.556361    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:22:37.556785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.556624    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="alertmanager" containerID="cri-o://6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72" gracePeriod=120
Jul 08 17:22:37.556785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.556711    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy-metric" containerID="cri-o://0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2" gracePeriod=120
Jul 08 17:22:37.556785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.556723    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy-web" containerID="cri-o://6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178" gracePeriod=120
Jul 08 17:22:37.556785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.556750    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy" containerID="cri-o://ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54" gracePeriod=120
Jul 08 17:22:37.556999 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.556787    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="config-reloader" containerID="cri-o://086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd" gracePeriod=120
Jul 08 17:22:37.556999 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.556844    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="prom-label-proxy" containerID="cri-o://a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558" gracePeriod=120
Jul 08 17:22:37.872555 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.872489    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerID="a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558" exitCode=0
Jul 08 17:22:37.872555 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.872515    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerID="ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54" exitCode=0
Jul 08 17:22:37.872555 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.872521    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerID="086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd" exitCode=0
Jul 08 17:22:37.872555 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.872527    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerID="6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72" exitCode=0
Jul 08 17:22:37.872755 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.872547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerDied","Data":"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558"}
Jul 08 17:22:37.872755 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.872637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerDied","Data":"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54"}
Jul 08 17:22:37.872755 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.872664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerDied","Data":"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd"}
Jul 08 17:22:37.872755 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:37.872688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerDied","Data":"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72"}
Jul 08 17:22:38.796206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.796183    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:38.879574 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.879501    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerID="0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2" exitCode=0
Jul 08 17:22:38.879574 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.879523    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerID="6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178" exitCode=0
Jul 08 17:22:38.879574 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.879564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerDied","Data":"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2"}
Jul 08 17:22:38.879776 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.879582    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:38.879776 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.879618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerDied","Data":"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178"}
Jul 08 17:22:38.879776 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.879645    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ccac9a1-004d-4f65-8277-28d5390c12d8","Type":"ContainerDied","Data":"ed2119802a642c607a74df114a5f278fa9381fd18b52ab01609286fe5a92406e"}
Jul 08 17:22:38.879776 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.879675    2578 scope.go:117] "RemoveContainer" containerID="a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558"
Jul 08 17:22:38.887011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.886994    2578 scope.go:117] "RemoveContainer" containerID="0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2"
Jul 08 17:22:38.891092 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891074    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891105    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtxfg\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-kube-api-access-wtxfg\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891160    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-metrics-client-ca\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891328 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-trusted-ca-bundle\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891328 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891214    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-cluster-tls-config\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891328 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-main-tls\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891328 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891526 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891382    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-tls-assets\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891526 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891411    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-volume\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891526 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891439    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-web-config\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891526 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891469    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-out\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891526 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-main-db\") pod \"9ccac9a1-004d-4f65-8277-28d5390c12d8\" (UID: \"9ccac9a1-004d-4f65-8277-28d5390c12d8\") "
Jul 08 17:22:38.891767 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891590    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:38.892203 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.891932    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-metrics-client-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.892203 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.892088    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:38.894057 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.894030    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-kube-api-access-wtxfg" (OuterVolumeSpecName: "kube-api-access-wtxfg") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "kube-api-access-wtxfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:22:38.894283 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.894232    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:22:38.894520 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.894422    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:38.896008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.895979    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:38.896099 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.896032    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:22:38.896304 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.896250    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:38.896503 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.896472    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-out" (OuterVolumeSpecName: "config-out") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:22:38.896654 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.896517    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:38.896654 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.896553    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-volume" (OuterVolumeSpecName: "config-volume") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:38.896654 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.896649    2578 scope.go:117] "RemoveContainer" containerID="ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54"
Jul 08 17:22:38.900829 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.900802    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:38.907068 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.907050    2578 scope.go:117] "RemoveContainer" containerID="6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178"
Jul 08 17:22:38.907295 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.907258    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-web-config" (OuterVolumeSpecName: "web-config") pod "9ccac9a1-004d-4f65-8277-28d5390c12d8" (UID: "9ccac9a1-004d-4f65-8277-28d5390c12d8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:38.913488 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.913473    2578 scope.go:117] "RemoveContainer" containerID="086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd"
Jul 08 17:22:38.920221 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.920206    2578 scope.go:117] "RemoveContainer" containerID="6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72"
Jul 08 17:22:38.926614 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.926600    2578 scope.go:117] "RemoveContainer" containerID="ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd"
Jul 08 17:22:38.932754 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.932739    2578 scope.go:117] "RemoveContainer" containerID="a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558"
Jul 08 17:22:38.933014 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:38.932997    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558\": container with ID starting with a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558 not found: ID does not exist" containerID="a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558"
Jul 08 17:22:38.933062 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.933022    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558"} err="failed to get container status \"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558\": rpc error: code = NotFound desc = could not find container \"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558\": container with ID starting with a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558 not found: ID does not exist"
Jul 08 17:22:38.933062 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.933040    2578 scope.go:117] "RemoveContainer" containerID="0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2"
Jul 08 17:22:38.933289 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:38.933253    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2\": container with ID starting with 0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2 not found: ID does not exist" containerID="0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2"
Jul 08 17:22:38.933336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.933292    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2"} err="failed to get container status \"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2\": rpc error: code = NotFound desc = could not find container \"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2\": container with ID starting with 0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2 not found: ID does not exist"
Jul 08 17:22:38.933336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.933309    2578 scope.go:117] "RemoveContainer" containerID="ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54"
Jul 08 17:22:38.933565 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:38.933547    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54\": container with ID starting with ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54 not found: ID does not exist" containerID="ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54"
Jul 08 17:22:38.933633 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.933572    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54"} err="failed to get container status \"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54\": rpc error: code = NotFound desc = could not find container \"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54\": container with ID starting with ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54 not found: ID does not exist"
Jul 08 17:22:38.933633 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.933592    2578 scope.go:117] "RemoveContainer" containerID="6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178"
Jul 08 17:22:38.933828 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:38.933811    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178\": container with ID starting with 6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178 not found: ID does not exist" containerID="6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178"
Jul 08 17:22:38.933864 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.933834    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178"} err="failed to get container status \"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178\": rpc error: code = NotFound desc = could not find container \"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178\": container with ID starting with 6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178 not found: ID does not exist"
Jul 08 17:22:38.933864 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.933848    2578 scope.go:117] "RemoveContainer" containerID="086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd"
Jul 08 17:22:38.934063 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:38.934043    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd\": container with ID starting with 086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd not found: ID does not exist" containerID="086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd"
Jul 08 17:22:38.934100 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934066    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd"} err="failed to get container status \"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd\": rpc error: code = NotFound desc = could not find container \"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd\": container with ID starting with 086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd not found: ID does not exist"
Jul 08 17:22:38.934100 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934080    2578 scope.go:117] "RemoveContainer" containerID="6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72"
Jul 08 17:22:38.934282 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:38.934252    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72\": container with ID starting with 6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72 not found: ID does not exist" containerID="6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72"
Jul 08 17:22:38.934348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934290    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72"} err="failed to get container status \"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72\": rpc error: code = NotFound desc = could not find container \"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72\": container with ID starting with 6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72 not found: ID does not exist"
Jul 08 17:22:38.934348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934309    2578 scope.go:117] "RemoveContainer" containerID="ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd"
Jul 08 17:22:38.934558 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:38.934542    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd\": container with ID starting with ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd not found: ID does not exist" containerID="ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd"
Jul 08 17:22:38.934592 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934563    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd"} err="failed to get container status \"ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd\": rpc error: code = NotFound desc = could not find container \"ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd\": container with ID starting with ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd not found: ID does not exist"
Jul 08 17:22:38.934592 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934576    2578 scope.go:117] "RemoveContainer" containerID="a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558"
Jul 08 17:22:38.934786 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934770    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558"} err="failed to get container status \"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558\": rpc error: code = NotFound desc = could not find container \"a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558\": container with ID starting with a6009ac7c67923b5d42e95e7117c2edfb8517a32dc619576d2febd7704946558 not found: ID does not exist"
Jul 08 17:22:38.934831 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934787    2578 scope.go:117] "RemoveContainer" containerID="0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2"
Jul 08 17:22:38.935004 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.934984    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2"} err="failed to get container status \"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2\": rpc error: code = NotFound desc = could not find container \"0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2\": container with ID starting with 0f263afe9b0a81ea45df2f637603dbd44c75a0c133b3c0836cdd661dfe2877c2 not found: ID does not exist"
Jul 08 17:22:38.935070 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935018    2578 scope.go:117] "RemoveContainer" containerID="ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54"
Jul 08 17:22:38.935228 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935211    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54"} err="failed to get container status \"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54\": rpc error: code = NotFound desc = could not find container \"ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54\": container with ID starting with ede9d086a26a384db1c884308714af4dfb1464dc701963c2d44fccb41b6a0e54 not found: ID does not exist"
Jul 08 17:22:38.935317 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935230    2578 scope.go:117] "RemoveContainer" containerID="6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178"
Jul 08 17:22:38.935459 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935443    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178"} err="failed to get container status \"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178\": rpc error: code = NotFound desc = could not find container \"6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178\": container with ID starting with 6bf8e417bf39c04a8bd9a167bf6c8fbffc0a92e8382e93ab271e450621937178 not found: ID does not exist"
Jul 08 17:22:38.935525 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935461    2578 scope.go:117] "RemoveContainer" containerID="086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd"
Jul 08 17:22:38.935684 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935665    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd"} err="failed to get container status \"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd\": rpc error: code = NotFound desc = could not find container \"086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd\": container with ID starting with 086fe7e759177476a4281805a209fbd4d43717b386d2d35fdb7f803eb4e064bd not found: ID does not exist"
Jul 08 17:22:38.935724 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935685    2578 scope.go:117] "RemoveContainer" containerID="6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72"
Jul 08 17:22:38.935897 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935880    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72"} err="failed to get container status \"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72\": rpc error: code = NotFound desc = could not find container \"6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72\": container with ID starting with 6e09e4cefe9846f260c31e86adafe0ef646bef0163c423371f463c4f29774d72 not found: ID does not exist"
Jul 08 17:22:38.935942 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.935898    2578 scope.go:117] "RemoveContainer" containerID="ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd"
Jul 08 17:22:38.936096 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.936080    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd"} err="failed to get container status \"ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd\": rpc error: code = NotFound desc = could not find container \"ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd\": container with ID starting with ff3bdab2cbd57907737ee7a0722cb825daa1b40eec47d1c72cf52976087570bd not found: ID does not exist"
Jul 08 17:22:38.992759 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992737    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-main-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992759 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992759    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992768    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-tls-assets\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992777    2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-volume\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992785    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-web-config\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992793    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-config-out\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992801    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-main-db\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992809    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992833    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtxfg\" (UniqueName: \"kubernetes.io/projected/9ccac9a1-004d-4f65-8277-28d5390c12d8-kube-api-access-wtxfg\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992843    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.992858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992852    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ccac9a1-004d-4f65-8277-28d5390c12d8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:38.993189 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:38.992871    2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ccac9a1-004d-4f65-8277-28d5390c12d8-cluster-tls-config\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:39.205550 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.205524    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:22:39.210299 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.210262    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:22:39.235979 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.235959    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:22:39.236231 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236219    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f320f24-fd19-4500-a96f-e74503124a02" containerName="console"
Jul 08 17:22:39.236292 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236233    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f320f24-fd19-4500-a96f-e74503124a02" containerName="console"
Jul 08 17:22:39.236292 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236247    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="prom-label-proxy"
Jul 08 17:22:39.236292 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236252    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="prom-label-proxy"
Jul 08 17:22:39.236292 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236259    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" containerName="console"
Jul 08 17:22:39.236292 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236280    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" containerName="console"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236295    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="init-config-reloader"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236301    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="init-config-reloader"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236308    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy-web"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236312    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy-web"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236317    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236322    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236330    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy-metric"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236336    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy-metric"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236344    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="config-reloader"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236349    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="config-reloader"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236353    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="alertmanager"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236360    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="alertmanager"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236409    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="alertmanager"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236418    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236425    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="97ce49f6-b827-4fda-b7d1-f6e7832e3a1a" containerName="console"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236430    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy-web"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236435    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="kube-rbac-proxy-metric"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236446    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f320f24-fd19-4500-a96f-e74503124a02" containerName="console"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236456    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="prom-label-proxy"
Jul 08 17:22:39.236458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.236462    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" containerName="config-reloader"
Jul 08 17:22:39.241367 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.241353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.244213 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.244190    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 17:22:39.244330 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.244188    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 17:22:39.244330 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.244243    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 17:22:39.245198 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.245181    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5xp9c\""
Jul 08 17:22:39.245300 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.245243    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 17:22:39.245300 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.245247    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 17:22:39.245535 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.245519    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 17:22:39.245767 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.245749    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 17:22:39.245842 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.245749    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 17:22:39.249784 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.249764    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 17:22:39.254029 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.254007    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:22:39.396182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4d41f3a-8d5c-4b03-9992-74def02af6a7-config-out\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396373 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj4n5\" (UniqueName: \"kubernetes.io/projected/d4d41f3a-8d5c-4b03-9992-74def02af6a7-kube-api-access-qj4n5\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396373 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396373 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4d41f3a-8d5c-4b03-9992-74def02af6a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396373 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d41f3a-8d5c-4b03-9992-74def02af6a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4d41f3a-8d5c-4b03-9992-74def02af6a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-web-config\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396663 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396663 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4d41f3a-8d5c-4b03-9992-74def02af6a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.396663 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.396647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.497681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.497612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.497681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.497645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4d41f3a-8d5c-4b03-9992-74def02af6a7-config-out\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.497681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.497661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj4n5\" (UniqueName: \"kubernetes.io/projected/d4d41f3a-8d5c-4b03-9992-74def02af6a7-kube-api-access-qj4n5\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.497926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.497689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.497926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.497821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4d41f3a-8d5c-4b03-9992-74def02af6a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.497926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.497866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d41f3a-8d5c-4b03-9992-74def02af6a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.497926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.497895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4d41f3a-8d5c-4b03-9992-74def02af6a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.498115 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.497960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-web-config\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.498115 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.498000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.498115 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.498032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.498115 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.498102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.498338 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.498131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4d41f3a-8d5c-4b03-9992-74def02af6a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.498338 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.498164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.498338 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.498166    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4d41f3a-8d5c-4b03-9992-74def02af6a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.499120 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.498619    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d41f3a-8d5c-4b03-9992-74def02af6a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.499358 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.499333    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4d41f3a-8d5c-4b03-9992-74def02af6a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.500566 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.500541    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4d41f3a-8d5c-4b03-9992-74def02af6a7-config-out\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.501145 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.500785    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.501145 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.501097    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.501314 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.501295    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.501404 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.501387    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.501459 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.501444    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.501799 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.501780    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.502211 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.502194    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4d41f3a-8d5c-4b03-9992-74def02af6a7-web-config\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.502482 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.502467    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4d41f3a-8d5c-4b03-9992-74def02af6a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.506497 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.506477    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj4n5\" (UniqueName: \"kubernetes.io/projected/d4d41f3a-8d5c-4b03-9992-74def02af6a7-kube-api-access-qj4n5\") pod \"alertmanager-main-0\" (UID: \"d4d41f3a-8d5c-4b03-9992-74def02af6a7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.551479 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.551452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 17:22:39.589926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.589901    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ccac9a1-004d-4f65-8277-28d5390c12d8" path="/var/lib/kubelet/pods/9ccac9a1-004d-4f65-8277-28d5390c12d8/volumes"
Jul 08 17:22:39.695563 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.695513    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 17:22:39.698959 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:22:39.698933    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d41f3a_8d5c_4b03_9992_74def02af6a7.slice/crio-9f794e2edc8d50de222f5a065f8b87acce51e404c94ae8f06ed867ab684b6b0b WatchSource:0}: Error finding container 9f794e2edc8d50de222f5a065f8b87acce51e404c94ae8f06ed867ab684b6b0b: Status 404 returned error can't find the container with id 9f794e2edc8d50de222f5a065f8b87acce51e404c94ae8f06ed867ab684b6b0b
Jul 08 17:22:39.885434 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.885401    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4d41f3a-8d5c-4b03-9992-74def02af6a7" containerID="b22d40b9f82844ce3d68fcfe767bd5cff549db7dc8090cbb9869c3f27ee57c9b" exitCode=0
Jul 08 17:22:39.885806 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.885452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d41f3a-8d5c-4b03-9992-74def02af6a7","Type":"ContainerDied","Data":"b22d40b9f82844ce3d68fcfe767bd5cff549db7dc8090cbb9869c3f27ee57c9b"}
Jul 08 17:22:39.885806 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:39.885507    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d41f3a-8d5c-4b03-9992-74def02af6a7","Type":"ContainerStarted","Data":"9f794e2edc8d50de222f5a065f8b87acce51e404c94ae8f06ed867ab684b6b0b"}
Jul 08 17:22:40.892609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:40.892528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d41f3a-8d5c-4b03-9992-74def02af6a7","Type":"ContainerStarted","Data":"16cd614a6f3d1e355cdffb51b2f22ba31e2f389feb7fe0ce7567138bdeb7c14f"}
Jul 08 17:22:40.892953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:40.892609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d41f3a-8d5c-4b03-9992-74def02af6a7","Type":"ContainerStarted","Data":"0fac278ca1c568ffa249980327909acfeafb36fd84be8a37bb56e24ef164f216"}
Jul 08 17:22:40.892953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:40.892649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d41f3a-8d5c-4b03-9992-74def02af6a7","Type":"ContainerStarted","Data":"07cdb3975ddfcf1820f40eb28514f749566f64c0ef71a9a86dd0cda973a28efb"}
Jul 08 17:22:40.892953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:40.892687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d41f3a-8d5c-4b03-9992-74def02af6a7","Type":"ContainerStarted","Data":"11b7b80518c162851a83c08f4bbb86e95f59620f165b9e8fc26c3f7c824d3d45"}
Jul 08 17:22:40.892953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:40.892758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d41f3a-8d5c-4b03-9992-74def02af6a7","Type":"ContainerStarted","Data":"55d7876007945c52405b91e58ae9104864237f7f76a572b32d981085ca990bcf"}
Jul 08 17:22:40.892953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:40.892795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d41f3a-8d5c-4b03-9992-74def02af6a7","Type":"ContainerStarted","Data":"f389199c2c50785d2698d33ae35d821b9c30d17d457ad99805ee3086880c082c"}
Jul 08 17:22:40.922770 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:40.922711    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.906838725 podStartE2EDuration="1.922691453s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.852728ms" isStatefulPod=false podCreationTimestamp="2026-07-08 17:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:22:40.919486562 +0000 UTC m=+395.842077916" watchObservedRunningTime="2026-07-08 17:22:40.922691453 +0000 UTC m=+395.845282809"
Jul 08 17:22:41.836654 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:41.836612    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:22:41.837009 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:41.836907    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="prometheus" containerID="cri-o://b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49" gracePeriod=600
Jul 08 17:22:41.837009 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:41.836922    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy" containerID="cri-o://d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245" gracePeriod=600
Jul 08 17:22:41.837009 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:41.836967    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="thanos-sidecar" containerID="cri-o://14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba" gracePeriod=600
Jul 08 17:22:41.837009 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:41.836969    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3" gracePeriod=600
Jul 08 17:22:41.837333 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:41.836973    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="config-reloader" containerID="cri-o://b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb" gracePeriod=600
Jul 08 17:22:41.837333 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:41.836967    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy-web" containerID="cri-o://b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404" gracePeriod=600
Jul 08 17:22:42.079328 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.079307    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:42.221883 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.221811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-trusted-ca-bundle\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.221883 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.221843    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-1\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.221883 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.221870    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.221896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-kubelet-serving-ca-bundle\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222024    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-db\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222171 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-web-config\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222171 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222089    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-config-out\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222171 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-config\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222171 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222144    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-metrics-client-certs\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222185    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-tls\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222212    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-kube-rbac-proxy\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222249    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222257    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222314    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-tls-assets\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222318    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222326    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222345    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-grpc-tls\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222385    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-serving-certs-ca-bundle\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbwrf\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-kube-api-access-nbwrf\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222458    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-2\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222494    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-thanos-prometheus-http-client-file\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-0\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.222812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-metrics-client-ca\") pod \"3321c176-4ea3-4566-98df-23a558dcd10e\" (UID: \"3321c176-4ea3-4566-98df-23a558dcd10e\") "
Jul 08 17:22:42.223021 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.222983    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.223021 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.223004    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.223106 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.223023    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.223237 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.223211    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:22:42.223430 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.223404    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:42.224021 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.223760    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:42.224874 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.224737    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.225130 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.225099    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.225234 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.225199    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.225778 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.225749    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.226370 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.226050    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.226370 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.226091    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-kube-api-access-nbwrf" (OuterVolumeSpecName: "kube-api-access-nbwrf") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "kube-api-access-nbwrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:22:42.226589 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.226561    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.226667 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.226636    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:42.226785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.226762    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:22:42.227062 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.227034    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-config-out" (OuterVolumeSpecName: "config-out") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:22:42.227322 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.227302    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-config" (OuterVolumeSpecName: "config") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.227770 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.227748    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.228330 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.228306    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:22:42.235599 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.235577    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-web-config" (OuterVolumeSpecName: "web-config") pod "3321c176-4ea3-4566-98df-23a558dcd10e" (UID: "3321c176-4ea3-4566-98df-23a558dcd10e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:22:42.324101 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324063    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324101 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324101    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-db\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324116    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-web-config\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324128    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3321c176-4ea3-4566-98df-23a558dcd10e-config-out\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324139    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-config\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324151    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-metrics-client-certs\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324166    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324179    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-kube-rbac-proxy\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324194    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324208    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-tls-assets\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324220    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-secret-grpc-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324232    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324247    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbwrf\" (UniqueName: \"kubernetes.io/projected/3321c176-4ea3-4566-98df-23a558dcd10e-kube-api-access-nbwrf\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324257 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324261    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324742 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324294    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3321c176-4ea3-4566-98df-23a558dcd10e-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324742 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324311    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.324742 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.324325    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3321c176-4ea3-4566-98df-23a558dcd10e-configmap-metrics-client-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:22:42.904523 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904486    2578 generic.go:356] "Generic (PLEG): container finished" podID="3321c176-4ea3-4566-98df-23a558dcd10e" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3" exitCode=0
Jul 08 17:22:42.904523 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904516    2578 generic.go:356] "Generic (PLEG): container finished" podID="3321c176-4ea3-4566-98df-23a558dcd10e" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245" exitCode=0
Jul 08 17:22:42.904523 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904523    2578 generic.go:356] "Generic (PLEG): container finished" podID="3321c176-4ea3-4566-98df-23a558dcd10e" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404" exitCode=0
Jul 08 17:22:42.904523 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904530    2578 generic.go:356] "Generic (PLEG): container finished" podID="3321c176-4ea3-4566-98df-23a558dcd10e" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba" exitCode=0
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904536    2578 generic.go:356] "Generic (PLEG): container finished" podID="3321c176-4ea3-4566-98df-23a558dcd10e" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb" exitCode=0
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904540    2578 generic.go:356] "Generic (PLEG): container finished" podID="3321c176-4ea3-4566-98df-23a558dcd10e" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49" exitCode=0
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerDied","Data":"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"}
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904565    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerDied","Data":"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"}
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904628    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerDied","Data":"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"}
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerDied","Data":"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"}
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904678    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerDied","Data":"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"}
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904680    2578 scope.go:117] "RemoveContainer" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerDied","Data":"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"}
Jul 08 17:22:42.904752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.904725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3321c176-4ea3-4566-98df-23a558dcd10e","Type":"ContainerDied","Data":"4a9c3d62223da9e80d3586815cad53799b79beb431c5c1d5d9ed414c63560405"}
Jul 08 17:22:42.914081 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.913989    2578 scope.go:117] "RemoveContainer" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"
Jul 08 17:22:42.922091 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.922070    2578 scope.go:117] "RemoveContainer" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"
Jul 08 17:22:42.928500 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.928484    2578 scope.go:117] "RemoveContainer" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"
Jul 08 17:22:42.934245 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.934226    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:22:42.935417 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.935401    2578 scope.go:117] "RemoveContainer" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"
Jul 08 17:22:42.938587 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.938568    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:22:42.942520 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.942505    2578 scope.go:117] "RemoveContainer" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"
Jul 08 17:22:42.949325 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.949307    2578 scope.go:117] "RemoveContainer" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"
Jul 08 17:22:42.955697 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.955684    2578 scope.go:117] "RemoveContainer" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"
Jul 08 17:22:42.955949 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:42.955931    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": container with ID starting with bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3 not found: ID does not exist" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"
Jul 08 17:22:42.956011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.955960    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"} err="failed to get container status \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": rpc error: code = NotFound desc = could not find container \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": container with ID starting with bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3 not found: ID does not exist"
Jul 08 17:22:42.956011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.955985    2578 scope.go:117] "RemoveContainer" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"
Jul 08 17:22:42.956242 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:42.956225    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": container with ID starting with d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245 not found: ID does not exist" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"
Jul 08 17:22:42.956302 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.956248    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"} err="failed to get container status \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": rpc error: code = NotFound desc = could not find container \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": container with ID starting with d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245 not found: ID does not exist"
Jul 08 17:22:42.956302 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.956281    2578 scope.go:117] "RemoveContainer" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"
Jul 08 17:22:42.956491 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:42.956475    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": container with ID starting with b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404 not found: ID does not exist" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"
Jul 08 17:22:42.956533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.956496    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"} err="failed to get container status \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": rpc error: code = NotFound desc = could not find container \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": container with ID starting with b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404 not found: ID does not exist"
Jul 08 17:22:42.956533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.956510    2578 scope.go:117] "RemoveContainer" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"
Jul 08 17:22:42.956736 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:42.956715    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": container with ID starting with 14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba not found: ID does not exist" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"
Jul 08 17:22:42.956778 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.956742    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"} err="failed to get container status \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": rpc error: code = NotFound desc = could not find container \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": container with ID starting with 14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba not found: ID does not exist"
Jul 08 17:22:42.956778 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.956757    2578 scope.go:117] "RemoveContainer" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"
Jul 08 17:22:42.956981 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:42.956966    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": container with ID starting with b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb not found: ID does not exist" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"
Jul 08 17:22:42.957023 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.956983    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"} err="failed to get container status \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": rpc error: code = NotFound desc = could not find container \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": container with ID starting with b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb not found: ID does not exist"
Jul 08 17:22:42.957023 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.956996    2578 scope.go:117] "RemoveContainer" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"
Jul 08 17:22:42.957229 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:42.957213    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": container with ID starting with b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49 not found: ID does not exist" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"
Jul 08 17:22:42.957263 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.957232    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"} err="failed to get container status \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": rpc error: code = NotFound desc = could not find container \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": container with ID starting with b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49 not found: ID does not exist"
Jul 08 17:22:42.957263 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.957246    2578 scope.go:117] "RemoveContainer" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"
Jul 08 17:22:42.957476 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:22:42.957456    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": container with ID starting with 377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794 not found: ID does not exist" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"
Jul 08 17:22:42.957527 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.957480    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"} err="failed to get container status \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": rpc error: code = NotFound desc = could not find container \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": container with ID starting with 377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794 not found: ID does not exist"
Jul 08 17:22:42.957527 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.957493    2578 scope.go:117] "RemoveContainer" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"
Jul 08 17:22:42.957714 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.957699    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"} err="failed to get container status \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": rpc error: code = NotFound desc = could not find container \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": container with ID starting with bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3 not found: ID does not exist"
Jul 08 17:22:42.957751 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.957714    2578 scope.go:117] "RemoveContainer" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"
Jul 08 17:22:42.957922 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.957905    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"} err="failed to get container status \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": rpc error: code = NotFound desc = could not find container \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": container with ID starting with d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245 not found: ID does not exist"
Jul 08 17:22:42.957966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.957922    2578 scope.go:117] "RemoveContainer" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"
Jul 08 17:22:42.958126 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958111    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"} err="failed to get container status \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": rpc error: code = NotFound desc = could not find container \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": container with ID starting with b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404 not found: ID does not exist"
Jul 08 17:22:42.958163 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958127    2578 scope.go:117] "RemoveContainer" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"
Jul 08 17:22:42.958327 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958311    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"} err="failed to get container status \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": rpc error: code = NotFound desc = could not find container \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": container with ID starting with 14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba not found: ID does not exist"
Jul 08 17:22:42.958383 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958327    2578 scope.go:117] "RemoveContainer" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"
Jul 08 17:22:42.958537 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958521    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"} err="failed to get container status \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": rpc error: code = NotFound desc = could not find container \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": container with ID starting with b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb not found: ID does not exist"
Jul 08 17:22:42.958586 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958537    2578 scope.go:117] "RemoveContainer" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"
Jul 08 17:22:42.958768 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958750    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"} err="failed to get container status \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": rpc error: code = NotFound desc = could not find container \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": container with ID starting with b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49 not found: ID does not exist"
Jul 08 17:22:42.958806 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958770    2578 scope.go:117] "RemoveContainer" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"
Jul 08 17:22:42.958973 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958954    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"} err="failed to get container status \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": rpc error: code = NotFound desc = could not find container \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": container with ID starting with 377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794 not found: ID does not exist"
Jul 08 17:22:42.959014 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.958974    2578 scope.go:117] "RemoveContainer" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"
Jul 08 17:22:42.959153 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959139    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"} err="failed to get container status \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": rpc error: code = NotFound desc = could not find container \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": container with ID starting with bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3 not found: ID does not exist"
Jul 08 17:22:42.959190 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959154    2578 scope.go:117] "RemoveContainer" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"
Jul 08 17:22:42.959374 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959357    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"} err="failed to get container status \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": rpc error: code = NotFound desc = could not find container \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": container with ID starting with d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245 not found: ID does not exist"
Jul 08 17:22:42.959413 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959375    2578 scope.go:117] "RemoveContainer" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"
Jul 08 17:22:42.959585 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959568    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"} err="failed to get container status \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": rpc error: code = NotFound desc = could not find container \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": container with ID starting with b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404 not found: ID does not exist"
Jul 08 17:22:42.959630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959586    2578 scope.go:117] "RemoveContainer" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"
Jul 08 17:22:42.959774 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959757    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"} err="failed to get container status \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": rpc error: code = NotFound desc = could not find container \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": container with ID starting with 14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba not found: ID does not exist"
Jul 08 17:22:42.959808 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959776    2578 scope.go:117] "RemoveContainer" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"
Jul 08 17:22:42.959966 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959947    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"} err="failed to get container status \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": rpc error: code = NotFound desc = could not find container \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": container with ID starting with b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb not found: ID does not exist"
Jul 08 17:22:42.960007 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.959966    2578 scope.go:117] "RemoveContainer" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"
Jul 08 17:22:42.960143 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960127    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"} err="failed to get container status \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": rpc error: code = NotFound desc = could not find container \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": container with ID starting with b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49 not found: ID does not exist"
Jul 08 17:22:42.960191 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960144    2578 scope.go:117] "RemoveContainer" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"
Jul 08 17:22:42.960388 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960372    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"} err="failed to get container status \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": rpc error: code = NotFound desc = could not find container \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": container with ID starting with 377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794 not found: ID does not exist"
Jul 08 17:22:42.960426 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960389    2578 scope.go:117] "RemoveContainer" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"
Jul 08 17:22:42.960601 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960583    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"} err="failed to get container status \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": rpc error: code = NotFound desc = could not find container \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": container with ID starting with bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3 not found: ID does not exist"
Jul 08 17:22:42.960601 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960601    2578 scope.go:117] "RemoveContainer" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"
Jul 08 17:22:42.960775 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960760    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"} err="failed to get container status \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": rpc error: code = NotFound desc = could not find container \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": container with ID starting with d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245 not found: ID does not exist"
Jul 08 17:22:42.960813 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960776    2578 scope.go:117] "RemoveContainer" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"
Jul 08 17:22:42.960965 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960949    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"} err="failed to get container status \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": rpc error: code = NotFound desc = could not find container \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": container with ID starting with b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404 not found: ID does not exist"
Jul 08 17:22:42.961002 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.960966    2578 scope.go:117] "RemoveContainer" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"
Jul 08 17:22:42.961156 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.961138    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"} err="failed to get container status \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": rpc error: code = NotFound desc = could not find container \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": container with ID starting with 14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba not found: ID does not exist"
Jul 08 17:22:42.961218 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.961156    2578 scope.go:117] "RemoveContainer" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"
Jul 08 17:22:42.961425 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.961406    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"} err="failed to get container status \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": rpc error: code = NotFound desc = could not find container \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": container with ID starting with b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb not found: ID does not exist"
Jul 08 17:22:42.961425 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.961425    2578 scope.go:117] "RemoveContainer" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"
Jul 08 17:22:42.961744 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.961726    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"} err="failed to get container status \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": rpc error: code = NotFound desc = could not find container \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": container with ID starting with b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49 not found: ID does not exist"
Jul 08 17:22:42.961800 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.961746    2578 scope.go:117] "RemoveContainer" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"
Jul 08 17:22:42.961928 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.961906    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"} err="failed to get container status \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": rpc error: code = NotFound desc = could not find container \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": container with ID starting with 377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794 not found: ID does not exist"
Jul 08 17:22:42.961928 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.961927    2578 scope.go:117] "RemoveContainer" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"
Jul 08 17:22:42.962200 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.962173    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"} err="failed to get container status \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": rpc error: code = NotFound desc = could not find container \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": container with ID starting with bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3 not found: ID does not exist"
Jul 08 17:22:42.962289 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.962202    2578 scope.go:117] "RemoveContainer" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"
Jul 08 17:22:42.962510 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.962487    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"} err="failed to get container status \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": rpc error: code = NotFound desc = could not find container \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": container with ID starting with d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245 not found: ID does not exist"
Jul 08 17:22:42.962510 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.962509    2578 scope.go:117] "RemoveContainer" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963354    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963716    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy-web"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963729    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy-web"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963749    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="init-config-reloader"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963757    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="init-config-reloader"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963766    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="thanos-sidecar"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963774    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="thanos-sidecar"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963783    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="config-reloader"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963791    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="config-reloader"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963806    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963813    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963821    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy-thanos"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963838    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy-thanos"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963848    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="prometheus"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963855    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="prometheus"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963928    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="config-reloader"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963940    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963950    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy-web"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963960    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="prometheus"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963969    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="kube-rbac-proxy-thanos"
Jul 08 17:22:42.965206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.963976    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" containerName="thanos-sidecar"
Jul 08 17:22:42.966097 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.965284    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"} err="failed to get container status \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": rpc error: code = NotFound desc = could not find container \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": container with ID starting with b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404 not found: ID does not exist"
Jul 08 17:22:42.966097 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.965307    2578 scope.go:117] "RemoveContainer" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"
Jul 08 17:22:42.966097 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.965854    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"} err="failed to get container status \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": rpc error: code = NotFound desc = could not find container \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": container with ID starting with 14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba not found: ID does not exist"
Jul 08 17:22:42.966097 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.965868    2578 scope.go:117] "RemoveContainer" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"
Jul 08 17:22:42.966311 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.966121    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"} err="failed to get container status \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": rpc error: code = NotFound desc = could not find container \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": container with ID starting with b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb not found: ID does not exist"
Jul 08 17:22:42.966311 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.966138    2578 scope.go:117] "RemoveContainer" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"
Jul 08 17:22:42.966421 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.966397    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"} err="failed to get container status \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": rpc error: code = NotFound desc = could not find container \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": container with ID starting with b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49 not found: ID does not exist"
Jul 08 17:22:42.966481 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.966425    2578 scope.go:117] "RemoveContainer" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"
Jul 08 17:22:42.966685 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.966666    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"} err="failed to get container status \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": rpc error: code = NotFound desc = could not find container \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": container with ID starting with 377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794 not found: ID does not exist"
Jul 08 17:22:42.966742 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.966686    2578 scope.go:117] "RemoveContainer" containerID="bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"
Jul 08 17:22:42.966902 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.966884    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3"} err="failed to get container status \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": rpc error: code = NotFound desc = could not find container \"bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3\": container with ID starting with bd4b9aea086044c5c97e27edc7bc6b77bd8664bd4821f9c5ce8a7546c5af8be3 not found: ID does not exist"
Jul 08 17:22:42.966963 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.966904    2578 scope.go:117] "RemoveContainer" containerID="d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"
Jul 08 17:22:42.967144 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967126    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245"} err="failed to get container status \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": rpc error: code = NotFound desc = could not find container \"d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245\": container with ID starting with d39495c281b61e20f5947d01f8d594c1f72de142a80b4366591e58bc01f22245 not found: ID does not exist"
Jul 08 17:22:42.967193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967145    2578 scope.go:117] "RemoveContainer" containerID="b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"
Jul 08 17:22:42.967371 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967354    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404"} err="failed to get container status \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": rpc error: code = NotFound desc = could not find container \"b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404\": container with ID starting with b10350e2f95fabab55c7a18329f1662ee5b07ad0f9e78fb94572d4bb08ea9404 not found: ID does not exist"
Jul 08 17:22:42.967422 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967371    2578 scope.go:117] "RemoveContainer" containerID="14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"
Jul 08 17:22:42.967553 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967538    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba"} err="failed to get container status \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": rpc error: code = NotFound desc = could not find container \"14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba\": container with ID starting with 14a60ea263ecc78c9d0645bfdf7f7b623fe987b815c4cf67dd928ad00e4110ba not found: ID does not exist"
Jul 08 17:22:42.967591 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967554    2578 scope.go:117] "RemoveContainer" containerID="b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"
Jul 08 17:22:42.967733 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967714    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb"} err="failed to get container status \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": rpc error: code = NotFound desc = could not find container \"b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb\": container with ID starting with b769d8c0d6a8eabaa64f241074238bb3fe3a2784f870f53837fd2e01db178deb not found: ID does not exist"
Jul 08 17:22:42.967778 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967735    2578 scope.go:117] "RemoveContainer" containerID="b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"
Jul 08 17:22:42.967979 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967957    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49"} err="failed to get container status \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": rpc error: code = NotFound desc = could not find container \"b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49\": container with ID starting with b5fe0968d3ac1d22bd9f25819c454f8aa40e0034e3b04a112adad48272878c49 not found: ID does not exist"
Jul 08 17:22:42.968027 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.967980    2578 scope.go:117] "RemoveContainer" containerID="377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"
Jul 08 17:22:42.968168 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.968153    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794"} err="failed to get container status \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": rpc error: code = NotFound desc = could not find container \"377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794\": container with ID starting with 377a61ea6b4092081ced0c1af1db65bef3b6543fcb9ab8d9808013395fd76794 not found: ID does not exist"
Jul 08 17:22:42.969531 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.969517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:42.972644 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.972623    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 17:22:42.972747 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.972653    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gl9wg\""
Jul 08 17:22:42.972747 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.972701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 17:22:42.972747 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.972718    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 17:22:42.972905 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.972752    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cifee2kbnomqc\""
Jul 08 17:22:42.972905 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.972775    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 17:22:42.972905 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.972876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 17:22:42.973024 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.973005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 17:22:42.973105 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.973089    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 17:22:42.973162 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.973108    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 17:22:42.973929 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.973910    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 17:22:42.973929 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.973929    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 17:22:42.974122 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.973982    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 17:22:42.974122 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.973929    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 17:22:42.974216 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.974208    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 17:22:42.976069 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.975932    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 17:22:42.978196 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.978180    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 17:22:42.982512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:42.982496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:22:43.130193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-config\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130220    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26mtz\" (UniqueName: \"kubernetes.io/projected/32778a17-26a3-42f9-b071-b1c6b05ff5e9-kube-api-access-26mtz\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32778a17-26a3-42f9-b071-b1c6b05ff5e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.130643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32778a17-26a3-42f9-b071-b1c6b05ff5e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.131125 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.130675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.231737 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.231845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.231845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.231845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.231845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.231845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32778a17-26a3-42f9-b071-b1c6b05ff5e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32778a17-26a3-42f9-b071-b1c6b05ff5e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-config\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.231982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232065 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26mtz\" (UniqueName: \"kubernetes.io/projected/32778a17-26a3-42f9-b071-b1c6b05ff5e9-kube-api-access-26mtz\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232451    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.232811 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.232795    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.233362 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.233339    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.234240 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.234201    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.235053 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.234875    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.235668 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.235236    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.236328 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.236191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.236481 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.236463    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32778a17-26a3-42f9-b071-b1c6b05ff5e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.236603 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.236583    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.237016 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.236996    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-config\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.237231 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.237211    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.237747 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.237707    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.237919 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.237897    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32778a17-26a3-42f9-b071-b1c6b05ff5e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.238043 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.238015    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.238139 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.238102    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.238417 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.238388    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.238417 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.238407    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32778a17-26a3-42f9-b071-b1c6b05ff5e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.238417 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.238413    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.238812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.238792    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32778a17-26a3-42f9-b071-b1c6b05ff5e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.241155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.241135    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26mtz\" (UniqueName: \"kubernetes.io/projected/32778a17-26a3-42f9-b071-b1c6b05ff5e9-kube-api-access-26mtz\") pod \"prometheus-k8s-0\" (UID: \"32778a17-26a3-42f9-b071-b1c6b05ff5e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.279230 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.279210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:43.415419 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.415352    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 17:22:43.419070 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:22:43.419043    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32778a17_26a3_42f9_b071_b1c6b05ff5e9.slice/crio-b3bf40e60351f5f70fd942f3547ba2117a95abb30f94bbdf03864581ff10de63 WatchSource:0}: Error finding container b3bf40e60351f5f70fd942f3547ba2117a95abb30f94bbdf03864581ff10de63: Status 404 returned error can't find the container with id b3bf40e60351f5f70fd942f3547ba2117a95abb30f94bbdf03864581ff10de63
Jul 08 17:22:43.589170 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.589145    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3321c176-4ea3-4566-98df-23a558dcd10e" path="/var/lib/kubelet/pods/3321c176-4ea3-4566-98df-23a558dcd10e/volumes"
Jul 08 17:22:43.910206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.910176    2578 generic.go:356] "Generic (PLEG): container finished" podID="32778a17-26a3-42f9-b071-b1c6b05ff5e9" containerID="b9ffbff17411478f37976a3b7d4d7bbd91f698d69fdd9932ef918cce2d3f70de" exitCode=0
Jul 08 17:22:43.910364 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.910262    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32778a17-26a3-42f9-b071-b1c6b05ff5e9","Type":"ContainerDied","Data":"b9ffbff17411478f37976a3b7d4d7bbd91f698d69fdd9932ef918cce2d3f70de"}
Jul 08 17:22:43.910364 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:43.910347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32778a17-26a3-42f9-b071-b1c6b05ff5e9","Type":"ContainerStarted","Data":"b3bf40e60351f5f70fd942f3547ba2117a95abb30f94bbdf03864581ff10de63"}
Jul 08 17:22:44.476907 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.476839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:44.575114 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.575091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:44.918325 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.918284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32778a17-26a3-42f9-b071-b1c6b05ff5e9","Type":"ContainerStarted","Data":"96f187d09c99fe5c0c7e4a14b09d596e5c559eb9123479f6d61b44e055e8bd38"}
Jul 08 17:22:44.918446 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.918376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32778a17-26a3-42f9-b071-b1c6b05ff5e9","Type":"ContainerStarted","Data":"c126bf4e06a12df4fa22e7b41e9ea4eff9a3d888478cd9ebe3f22284dbb97954"}
Jul 08 17:22:44.918446 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.918407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32778a17-26a3-42f9-b071-b1c6b05ff5e9","Type":"ContainerStarted","Data":"be16adbaed512b9519b5e12d5ca0c33353798338b851c7f41abd2654c09d1db8"}
Jul 08 17:22:44.918446 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.918432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32778a17-26a3-42f9-b071-b1c6b05ff5e9","Type":"ContainerStarted","Data":"e57b7bc6c1b27b0b4e6c319f32e0ee0cb9114df791233c1ca1300334b21ce9c9"}
Jul 08 17:22:44.918552 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.918460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32778a17-26a3-42f9-b071-b1c6b05ff5e9","Type":"ContainerStarted","Data":"a255ceddb9ff762de718eb8336bc1db4acfee2be4c7901eaeea36f2fe911181c"}
Jul 08 17:22:44.918552 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.918487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32778a17-26a3-42f9-b071-b1c6b05ff5e9","Type":"ContainerStarted","Data":"a2dfdca6db243a82a28537bdb44f436cc50fe0064e80f9558990bec34c97220e"}
Jul 08 17:22:44.953168 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:44.953125    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.93016617 podStartE2EDuration="2.953110308s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.944138ms" isStatefulPod=false podCreationTimestamp="2026-07-08 17:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:22:44.950493612 +0000 UTC m=+399.873084992" watchObservedRunningTime="2026-07-08 17:22:44.953110308 +0000 UTC m=+399.875701689"
Jul 08 17:22:46.579004 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:46.578967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:46.746314 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:46.746254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:46.844241 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:46.844175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:47.340436 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:47.340401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:47.403501 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:47.403475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:48.280314 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:48.280283    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:22:53.647628 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:53.647593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:53.722792 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:53.722763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:53.891526 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:53.891496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:53.991823 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:53.991752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:57.672016 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:57.671977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:22:57.839566 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:22:57.839536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:23:23.040502 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:23.040458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:23:23.127857 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:23.127816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:23:43.280423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:43.280392    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:23:43.297178 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:43.297154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:23:44.161467 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:44.161439    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 17:23:51.784081 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:51.784046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:23:51.888819 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:51.888787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:23:55.273408 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:55.273372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:23:55.377008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:23:55.376975    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:03.772994 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:03.772948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:03.888007 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:03.887966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:06.004285 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:06.004232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:06.164478 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:06.164424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:11.015471 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:11.015429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:11.119060 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:11.119029    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:14.698036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:14.698004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:47.560029 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:47.559994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:24:47.649459 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:24:47.649414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:05.103996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:05.103910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:14.287471 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:14.287430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:15.135039 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:15.135004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:17.642970 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:17.642939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:18.115497 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:18.115462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:18.221757 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:18.221723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:20.472234 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:20.472178    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:20.572852 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:20.572797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:20.731030 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:20.730951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:20.913609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:20.913579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:22.890909 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:22.890874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:23.090558 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:23.090525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:24.721482 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:24.721453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:24.824895 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:24.824867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:28.320465 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:28.320434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:28.419352 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:28.419330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:28.724055 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:28.723973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:28.824665 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:28.824632    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:30.497792 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:30.497757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:35.123866 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:35.123831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:35.222162 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:35.222133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:41.067580 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:41.067543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:41.169232 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:41.169201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:42.908592 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:42.908557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:55.170291 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.170239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:55.224066 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.224040    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"]
Jul 08 17:25:55.227147 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.227126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.230503 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.230484    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 17:25:55.231869 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.231838    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 17:25:55.232010 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.231872    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 17:25:55.232010 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.231933    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 17:25:55.232010 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.231982    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lpcrq\""
Jul 08 17:25:55.232191 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.231984    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 17:25:55.242772 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.242744    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"]
Jul 08 17:25:55.274999 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.274975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef6b76de-0aa3-435e-85b3-889bfcbdfece-metrics-cert\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.275089 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.275001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28lcc\" (UniqueName: \"kubernetes.io/projected/ef6b76de-0aa3-435e-85b3-889bfcbdfece-kube-api-access-28lcc\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.275089 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.275022    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef6b76de-0aa3-435e-85b3-889bfcbdfece-cert\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.275089 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.275048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef6b76de-0aa3-435e-85b3-889bfcbdfece-manager-config\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.278340 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.278319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:25:55.376031 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.376004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef6b76de-0aa3-435e-85b3-889bfcbdfece-metrics-cert\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.376132 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.376033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28lcc\" (UniqueName: \"kubernetes.io/projected/ef6b76de-0aa3-435e-85b3-889bfcbdfece-kube-api-access-28lcc\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.376132 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.376060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef6b76de-0aa3-435e-85b3-889bfcbdfece-cert\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.376132 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.376087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef6b76de-0aa3-435e-85b3-889bfcbdfece-manager-config\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.376865 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.376795    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef6b76de-0aa3-435e-85b3-889bfcbdfece-manager-config\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.378730 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.378705    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef6b76de-0aa3-435e-85b3-889bfcbdfece-cert\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.378825 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.378756    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef6b76de-0aa3-435e-85b3-889bfcbdfece-metrics-cert\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.385226 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.385202    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28lcc\" (UniqueName: \"kubernetes.io/projected/ef6b76de-0aa3-435e-85b3-889bfcbdfece-kube-api-access-28lcc\") pod \"lws-controller-manager-8596cf9c79-5n6cp\" (UID: \"ef6b76de-0aa3-435e-85b3-889bfcbdfece\") " pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.540454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.540432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:55.667225 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:55.667205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"]
Jul 08 17:25:55.669569 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:25:55.669547    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6b76de_0aa3_435e_85b3_889bfcbdfece.slice/crio-a9da9dee1750ec47dcf25e76b99b65b5c8afa90d27767507d34c69ce87a0a90b WatchSource:0}: Error finding container a9da9dee1750ec47dcf25e76b99b65b5c8afa90d27767507d34c69ce87a0a90b: Status 404 returned error can't find the container with id a9da9dee1750ec47dcf25e76b99b65b5c8afa90d27767507d34c69ce87a0a90b
Jul 08 17:25:56.644860 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:56.644824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp" event={"ID":"ef6b76de-0aa3-435e-85b3-889bfcbdfece","Type":"ContainerStarted","Data":"a9da9dee1750ec47dcf25e76b99b65b5c8afa90d27767507d34c69ce87a0a90b"}
Jul 08 17:25:58.655341 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:58.655302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp" event={"ID":"ef6b76de-0aa3-435e-85b3-889bfcbdfece","Type":"ContainerStarted","Data":"30e84b9a2f7f37dc880771746572b52bbd06952783324d5c4ab39779f1f63f27"}
Jul 08 17:25:58.655734 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:58.655373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:25:58.674396 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:25:58.674347    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp" podStartSLOduration=1.268934509 podStartE2EDuration="3.674332816s" totalImagesPullingTime="2.405398307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:25:58.672948205 +0000 UTC m=+593.595539562" watchObservedRunningTime="2026-07-08 17:25:58.674332816 +0000 UTC m=+593.596924171"
Jul 08 17:26:09.662509 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:09.662479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8596cf9c79-5n6cp"
Jul 08 17:26:10.809766 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:10.809736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:11.836621 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:11.836587    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"]
Jul 08 17:26:11.839875 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:11.839856    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:11.844252 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:11.844228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 17:26:11.844404 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:11.844236    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 17:26:11.847819 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:11.847788    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 17:26:11.848357 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:11.848336    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-748sr\""
Jul 08 17:26:11.848457 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:11.848397    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 17:26:11.862193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:11.862168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"]
Jul 08 17:26:12.013849 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.013809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-webhook-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.013849 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.013849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mnds\" (UniqueName: \"kubernetes.io/projected/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-kube-api-access-7mnds\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.014081 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.013909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-manifests\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.014081 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.013959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.014081 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.014000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-tmp\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.115193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.115122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-manifests\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.115193 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.115174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.115438 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.115194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-tmp\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.115438 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.115233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-webhook-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.115438 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.115249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mnds\" (UniqueName: \"kubernetes.io/projected/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-kube-api-access-7mnds\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.115683 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.115661    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-manifests\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.117710 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.117680    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-tmp\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.117909 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.117891    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.117952 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.117890    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-webhook-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.124467 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.124442    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mnds\" (UniqueName: \"kubernetes.io/projected/ef92054f-759e-4b4c-9d4e-3dcb4a76ed45-kube-api-access-7mnds\") pod \"opendatahub-operator-controller-manager-564755f94b-hbg2h\" (UID: \"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.150867 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.150834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:12.289867 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.289836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"]
Jul 08 17:26:12.294249 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:26:12.294223    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef92054f_759e_4b4c_9d4e_3dcb4a76ed45.slice/crio-5e569a35f32c135f2e6d285aa9b018e6637b24e3a8f389497bb6ed7e03d956e8 WatchSource:0}: Error finding container 5e569a35f32c135f2e6d285aa9b018e6637b24e3a8f389497bb6ed7e03d956e8: Status 404 returned error can't find the container with id 5e569a35f32c135f2e6d285aa9b018e6637b24e3a8f389497bb6ed7e03d956e8
Jul 08 17:26:12.296095 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.296078    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:26:12.635894 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.635853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:12.709207 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:12.709177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h" event={"ID":"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45","Type":"ContainerStarted","Data":"5e569a35f32c135f2e6d285aa9b018e6637b24e3a8f389497bb6ed7e03d956e8"}
Jul 08 17:26:15.723232 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:15.723198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h" event={"ID":"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45","Type":"ContainerStarted","Data":"00a27f2fd79ca53338847e69114c296f95445a4f3df7adc47436c9ac88f46f50"}
Jul 08 17:26:16.728816 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:16.728732    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef92054f-759e-4b4c-9d4e-3dcb4a76ed45" containerID="00a27f2fd79ca53338847e69114c296f95445a4f3df7adc47436c9ac88f46f50" exitCode=0
Jul 08 17:26:16.728816 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:16.728808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h" event={"ID":"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45","Type":"ContainerDied","Data":"00a27f2fd79ca53338847e69114c296f95445a4f3df7adc47436c9ac88f46f50"}
Jul 08 17:26:17.734894 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:17.734851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h" event={"ID":"ef92054f-759e-4b4c-9d4e-3dcb4a76ed45","Type":"ContainerStarted","Data":"a54ea423d2d1ef90e291c1a5560a3d6c85df88fd2233c53bd74d0a64d4b53f5d"}
Jul 08 17:26:17.735315 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:17.734990    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:17.759838 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:17.759786    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h" podStartSLOduration=2.441132192 podStartE2EDuration="6.75977409s" totalImagesPullingTime="3.242296703s" totalInitContainerRuntime="1.076345195s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:17.757787491 +0000 UTC m=+612.680378849" watchObservedRunningTime="2026-07-08 17:26:17.75977409 +0000 UTC m=+612.682365444"
Jul 08 17:26:28.745954 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:28.745925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-hbg2h"
Jul 08 17:26:30.913765 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:30.913734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:31.143002 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:31.142965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:31.720568 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:31.720526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:31.817841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:31.817809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:32.069464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:32.069433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:32.438626 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:32.438540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:32.701419 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:32.701330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:36.707206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:36.707179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:36.836171 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:36.836143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:38.048709 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:38.048668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:38.127212 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:38.127172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:39.475881 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.475847    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"]
Jul 08 17:26:39.478985 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.478968    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.484352 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.484320    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 17:26:39.484479 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.484438    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 17:26:39.484702 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.484687    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 17:26:39.484805 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.484745    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 17:26:39.484948 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.484933    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8sdtb\""
Jul 08 17:26:39.485591 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.485494    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 17:26:39.489776 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.489760    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 17:26:39.517658 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.517636    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"]
Jul 08 17:26:39.524397 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.524368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.524501 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.524440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.524501 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.524469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.524584 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.524515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkrt\" (UniqueName: \"kubernetes.io/projected/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-kube-api-access-qzkrt\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.524584 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.524550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.524649 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.524632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.524685 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.524673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.600301 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.600255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:39.625041 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.625015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.625167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.625051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.625167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.625095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.625167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.625117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.625167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.625157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkrt\" (UniqueName: \"kubernetes.io/projected/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-kube-api-access-qzkrt\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.625420 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.625190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.625420 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.625317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.625689 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.625664    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.627500 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.627471    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.627689 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.627673    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.627764 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.627745    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.627871 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.627851    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.633711 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.633689    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.634009 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.633992    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkrt\" (UniqueName: \"kubernetes.io/projected/e9c5072a-e7a3-4878-aaca-c65cb79bf2f6-kube-api-access-qzkrt\") pod \"istiod-openshift-gateway-94bb8fbfd-zbwsq\" (UID: \"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.788476 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.788450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:39.936302 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:39.936249    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"]
Jul 08 17:26:39.939284 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:26:39.939241    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c5072a_e7a3_4878_aaca_c65cb79bf2f6.slice/crio-e5d5dd0238569dd99576e0840c210fb7771266977b5cd9cb7a350d19264e004f WatchSource:0}: Error finding container e5d5dd0238569dd99576e0840c210fb7771266977b5cd9cb7a350d19264e004f: Status 404 returned error can't find the container with id e5d5dd0238569dd99576e0840c210fb7771266977b5cd9cb7a350d19264e004f
Jul 08 17:26:40.830373 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:40.830337    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq" event={"ID":"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6","Type":"ContainerStarted","Data":"e5d5dd0238569dd99576e0840c210fb7771266977b5cd9cb7a350d19264e004f"}
Jul 08 17:26:41.571302 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:41.570922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:41.690818 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:41.690776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:41.788760 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:41.788717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:42.061165 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.061127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:42.356788 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.356704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:42.375336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.375289    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 08 17:26:42.375446 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.375362    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 08 17:26:42.556047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.556003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:42.842148 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.842111    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq" event={"ID":"e9c5072a-e7a3-4878-aaca-c65cb79bf2f6","Type":"ContainerStarted","Data":"6f89f5310441a78aae366128df5b9963ab27df83fc1bdbead2f37fd2eea69c74"}
Jul 08 17:26:42.842372 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.842246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:42.870826 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.870642    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq" podStartSLOduration=1.436905779 podStartE2EDuration="3.870622478s" totalImagesPullingTime="2.433716699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:42.869596105 +0000 UTC m=+637.792187461" watchObservedRunningTime="2026-07-08 17:26:42.870622478 +0000 UTC m=+637.793213835"
Jul 08 17:26:42.871013 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.870844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:42.972104 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:42.972045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:43.043865 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:43.043836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:43.547148 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:43.547123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:43.819626 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:43.819541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:26:43.847520 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:43.847495    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbwsq"
Jul 08 17:26:44.281646 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:26:44.281611    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:32.573808 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:32.573775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:32.675061 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:32.675027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:32.790691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:32.790661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:45.351846 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:45.351804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:45.406657 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:45.406631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:47.111569 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:47.111539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:47.212900 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:47.212867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:50.718130 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:50.718068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:55.611237 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:55.611205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:56.238128 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:56.238089    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:56.789885 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:56.789803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:56.887359 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:56.887311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:56.991953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:56.991923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:27:57.519165 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:27:57.519131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:00.064873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:00.064833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:00.639490 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:00.639463    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:04.236600 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:04.236565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:05.655800 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:05.655758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:06.814155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:06.814119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:07.145209 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:07.145136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:07.943438 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:07.943410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:08.044857 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:08.044827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:08.163573 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:08.163543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:08.658096 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:08.658063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:12.823585 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:12.823548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:12.923299 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:12.923248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:13.681996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:13.681950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:13.773762 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:13.773730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:16.126828 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:16.126790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:16.192911 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:16.192883    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:19.140470 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:19.140439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:19.322437 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:19.322400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:21.225452 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:21.225419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:21.326878 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:21.326849    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:23.786655 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:23.786623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:23.887451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:23.887418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:29.046200 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.046161    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"]
Jul 08 17:28:29.049630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.049610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:29.052325 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.052307    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 17:28:29.053077 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.053050    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-psnw7\""
Jul 08 17:28:29.053242 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.053228    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 17:28:29.063073 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.063048    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"]
Jul 08 17:28:29.195076 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.195037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d5832b-88fa-4bd2-b910-aa4c0964b466-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" (UID: \"68d5832b-88fa-4bd2-b910-aa4c0964b466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:29.195238 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.195118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hczc\" (UniqueName: \"kubernetes.io/projected/68d5832b-88fa-4bd2-b910-aa4c0964b466-kube-api-access-7hczc\") pod \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" (UID: \"68d5832b-88fa-4bd2-b910-aa4c0964b466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:29.295889 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.295848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d5832b-88fa-4bd2-b910-aa4c0964b466-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" (UID: \"68d5832b-88fa-4bd2-b910-aa4c0964b466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:29.296056 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.295915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hczc\" (UniqueName: \"kubernetes.io/projected/68d5832b-88fa-4bd2-b910-aa4c0964b466-kube-api-access-7hczc\") pod \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" (UID: \"68d5832b-88fa-4bd2-b910-aa4c0964b466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:29.296368 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.296263    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d5832b-88fa-4bd2-b910-aa4c0964b466-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" (UID: \"68d5832b-88fa-4bd2-b910-aa4c0964b466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:29.305125 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.305102    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hczc\" (UniqueName: \"kubernetes.io/projected/68d5832b-88fa-4bd2-b910-aa4c0964b466-kube-api-access-7hczc\") pod \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" (UID: \"68d5832b-88fa-4bd2-b910-aa4c0964b466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:29.358999 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.358973    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:29.498672 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.498643    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"]
Jul 08 17:28:29.501501 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:28:29.501472    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d5832b_88fa_4bd2_b910_aa4c0964b466.slice/crio-323baf34a5544c0c5418420be21c24803a0b4c57708e5b715516c37b176afeb7 WatchSource:0}: Error finding container 323baf34a5544c0c5418420be21c24803a0b4c57708e5b715516c37b176afeb7: Status 404 returned error can't find the container with id 323baf34a5544c0c5418420be21c24803a0b4c57708e5b715516c37b176afeb7
Jul 08 17:28:29.637325 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.637230    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"]
Jul 08 17:28:29.643507 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.643486    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"]
Jul 08 17:28:29.666753 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.666731    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"]
Jul 08 17:28:29.670960 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.670941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:29.695470 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.695445    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"]
Jul 08 17:28:29.800124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.800095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/937297ca-b648-4904-be09-45814fb25f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gxdpw\" (UID: \"937297ca-b648-4904-be09-45814fb25f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:29.800325 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.800150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m2b6\" (UniqueName: \"kubernetes.io/projected/937297ca-b648-4904-be09-45814fb25f02-kube-api-access-6m2b6\") pod \"kuadrant-operator-controller-manager-55467d9f7-gxdpw\" (UID: \"937297ca-b648-4904-be09-45814fb25f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:29.901224 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.901136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/937297ca-b648-4904-be09-45814fb25f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gxdpw\" (UID: \"937297ca-b648-4904-be09-45814fb25f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:29.901224 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.901215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m2b6\" (UniqueName: \"kubernetes.io/projected/937297ca-b648-4904-be09-45814fb25f02-kube-api-access-6m2b6\") pod \"kuadrant-operator-controller-manager-55467d9f7-gxdpw\" (UID: \"937297ca-b648-4904-be09-45814fb25f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:29.901681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.901660    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/937297ca-b648-4904-be09-45814fb25f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gxdpw\" (UID: \"937297ca-b648-4904-be09-45814fb25f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:29.909768 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.909736    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m2b6\" (UniqueName: \"kubernetes.io/projected/937297ca-b648-4904-be09-45814fb25f02-kube-api-access-6m2b6\") pod \"kuadrant-operator-controller-manager-55467d9f7-gxdpw\" (UID: \"937297ca-b648-4904-be09-45814fb25f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:29.983217 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:29.983173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:30.123531 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:30.123506    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"]
Jul 08 17:28:30.126359 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:28:30.126329    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937297ca_b648_4904_be09_45814fb25f02.slice/crio-d70e8dbbc17662ea46defc1c7322f3a303f626dfa70536a025c47baa53562034 WatchSource:0}: Error finding container d70e8dbbc17662ea46defc1c7322f3a303f626dfa70536a025c47baa53562034: Status 404 returned error can't find the container with id d70e8dbbc17662ea46defc1c7322f3a303f626dfa70536a025c47baa53562034
Jul 08 17:28:30.249674 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:30.249602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw" event={"ID":"937297ca-b648-4904-be09-45814fb25f02","Type":"ContainerStarted","Data":"d70e8dbbc17662ea46defc1c7322f3a303f626dfa70536a025c47baa53562034"}
Jul 08 17:28:31.630235 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:31.630143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:31.729295 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:31.729240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:32.033464 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:32.033431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:32.132228 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:32.132189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:34.272730 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.272642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw" event={"ID":"937297ca-b648-4904-be09-45814fb25f02","Type":"ContainerStarted","Data":"c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300"}
Jul 08 17:28:34.272730 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.272706    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:34.274398 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.274370    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" containerName="manager" containerID="cri-o://fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a" gracePeriod=2
Jul 08 17:28:34.295383 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.295312    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw" podStartSLOduration=1.5461828469999999 podStartE2EDuration="5.29528997s" totalImagesPullingTime="3.749107123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:34.293924257 +0000 UTC m=+749.216515614" watchObservedRunningTime="2026-07-08 17:28:34.29528997 +0000 UTC m=+749.217881324"
Jul 08 17:28:34.516231 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.516209    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:34.518729 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:28:34.518706    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" is forbidden: User \"system:node:ip-10-0-133-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-199.ec2.internal' and this object" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:34.545090 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.545070    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d5832b-88fa-4bd2-b910-aa4c0964b466-extensions-socket-volume\") pod \"68d5832b-88fa-4bd2-b910-aa4c0964b466\" (UID: \"68d5832b-88fa-4bd2-b910-aa4c0964b466\") "
Jul 08 17:28:34.545170 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.545102    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hczc\" (UniqueName: \"kubernetes.io/projected/68d5832b-88fa-4bd2-b910-aa4c0964b466-kube-api-access-7hczc\") pod \"68d5832b-88fa-4bd2-b910-aa4c0964b466\" (UID: \"68d5832b-88fa-4bd2-b910-aa4c0964b466\") "
Jul 08 17:28:34.545337 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.545318    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68d5832b-88fa-4bd2-b910-aa4c0964b466-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "68d5832b-88fa-4bd2-b910-aa4c0964b466" (UID: "68d5832b-88fa-4bd2-b910-aa4c0964b466"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:28:34.547259 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.547240    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d5832b-88fa-4bd2-b910-aa4c0964b466-kube-api-access-7hczc" (OuterVolumeSpecName: "kube-api-access-7hczc") pod "68d5832b-88fa-4bd2-b910-aa4c0964b466" (UID: "68d5832b-88fa-4bd2-b910-aa4c0964b466"). InnerVolumeSpecName "kube-api-access-7hczc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:28:34.627538 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.627494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:34.646238 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.646212    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68d5832b-88fa-4bd2-b910-aa4c0964b466-extensions-socket-volume\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:28:34.646238 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.646233    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hczc\" (UniqueName: \"kubernetes.io/projected/68d5832b-88fa-4bd2-b910-aa4c0964b466-kube-api-access-7hczc\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:28:34.682578 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:34.682556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:35.279843 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:35.279800    2578 generic.go:356] "Generic (PLEG): container finished" podID="68d5832b-88fa-4bd2-b910-aa4c0964b466" containerID="fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a" exitCode=2
Jul 08 17:28:35.280348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:35.279853    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:35.280348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:35.279912    2578 scope.go:117] "RemoveContainer" containerID="fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a"
Jul 08 17:28:35.282561 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:28:35.282534    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" is forbidden: User \"system:node:ip-10-0-133-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-199.ec2.internal' and this object" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:35.289178 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:35.289162    2578 scope.go:117] "RemoveContainer" containerID="fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a"
Jul 08 17:28:35.289474 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:28:35.289457    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a\": container with ID starting with fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a not found: ID does not exist" containerID="fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a"
Jul 08 17:28:35.289547 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:35.289505    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a"} err="failed to get container status \"fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a\": rpc error: code = NotFound desc = could not find container \"fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a\": container with ID starting with fdefdfb5f04213199d5575376f6f0c3cc3367b5cb971a12ef30a8ff89c5cee7a not found: ID does not exist"
Jul 08 17:28:35.290617 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:28:35.290596    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" is forbidden: User \"system:node:ip-10-0-133-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-199.ec2.internal' and this object" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:35.588458 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:28:35.588380    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kl2cn\" is forbidden: User \"system:node:ip-10-0-133-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-199.ec2.internal' and this object" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kl2cn"
Jul 08 17:28:35.589812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:35.589790    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" path="/var/lib/kubelet/pods/68d5832b-88fa-4bd2-b910-aa4c0964b466/volumes"
Jul 08 17:28:39.829321 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:39.829286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:39.935080 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:39.935052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:43.423109 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:43.423081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:43.480329 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:43.480299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:45.282441 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:45.282413    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:55.841566 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:55.841518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:55.899518 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:55.899473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:28:58.026817 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.026775    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"]
Jul 08 17:28:58.027326 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.027019    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw" podUID="937297ca-b648-4904-be09-45814fb25f02" containerName="manager" containerID="cri-o://c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300" gracePeriod=10
Jul 08 17:28:58.268098 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.268075    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:58.336501 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.336469    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/937297ca-b648-4904-be09-45814fb25f02-extensions-socket-volume\") pod \"937297ca-b648-4904-be09-45814fb25f02\" (UID: \"937297ca-b648-4904-be09-45814fb25f02\") "
Jul 08 17:28:58.336672 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.336549    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m2b6\" (UniqueName: \"kubernetes.io/projected/937297ca-b648-4904-be09-45814fb25f02-kube-api-access-6m2b6\") pod \"937297ca-b648-4904-be09-45814fb25f02\" (UID: \"937297ca-b648-4904-be09-45814fb25f02\") "
Jul 08 17:28:58.336894 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.336872    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937297ca-b648-4904-be09-45814fb25f02-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "937297ca-b648-4904-be09-45814fb25f02" (UID: "937297ca-b648-4904-be09-45814fb25f02"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:28:58.338631 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.338611    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937297ca-b648-4904-be09-45814fb25f02-kube-api-access-6m2b6" (OuterVolumeSpecName: "kube-api-access-6m2b6") pod "937297ca-b648-4904-be09-45814fb25f02" (UID: "937297ca-b648-4904-be09-45814fb25f02"). InnerVolumeSpecName "kube-api-access-6m2b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:28:58.380327 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.380296    2578 generic.go:356] "Generic (PLEG): container finished" podID="937297ca-b648-4904-be09-45814fb25f02" containerID="c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300" exitCode=0
Jul 08 17:28:58.380496 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.380332    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"
Jul 08 17:28:58.380496 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.380374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw" event={"ID":"937297ca-b648-4904-be09-45814fb25f02","Type":"ContainerDied","Data":"c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300"}
Jul 08 17:28:58.380496 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.380426    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw" event={"ID":"937297ca-b648-4904-be09-45814fb25f02","Type":"ContainerDied","Data":"d70e8dbbc17662ea46defc1c7322f3a303f626dfa70536a025c47baa53562034"}
Jul 08 17:28:58.380496 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.380449    2578 scope.go:117] "RemoveContainer" containerID="c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300"
Jul 08 17:28:58.389158 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.389143    2578 scope.go:117] "RemoveContainer" containerID="c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300"
Jul 08 17:28:58.389435 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:28:58.389418    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300\": container with ID starting with c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300 not found: ID does not exist" containerID="c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300"
Jul 08 17:28:58.389502 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.389447    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300"} err="failed to get container status \"c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300\": rpc error: code = NotFound desc = could not find container \"c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300\": container with ID starting with c559d9f180dd9fcee00ffa188b7063cd7ac71e7dd8d95d7d86e1403f81d7e300 not found: ID does not exist"
Jul 08 17:28:58.404665 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.404637    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"]
Jul 08 17:28:58.408849 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.408827    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gxdpw"]
Jul 08 17:28:58.437047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.437027    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/937297ca-b648-4904-be09-45814fb25f02-extensions-socket-volume\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:28:58.437047 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:58.437047    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m2b6\" (UniqueName: \"kubernetes.io/projected/937297ca-b648-4904-be09-45814fb25f02-kube-api-access-6m2b6\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:28:59.588809 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:28:59.588774    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="937297ca-b648-4904-be09-45814fb25f02" path="/var/lib/kubelet/pods/937297ca-b648-4904-be09-45814fb25f02/volumes"
Jul 08 17:29:01.989782 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:01.989750    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:02.190948 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:02.190916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:12.286747 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:12.286710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:16.235173 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.235129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:16.243501 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.243470    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"]
Jul 08 17:29:16.243810 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.243787    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="937297ca-b648-4904-be09-45814fb25f02" containerName="manager"
Jul 08 17:29:16.243856 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.243813    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="937297ca-b648-4904-be09-45814fb25f02" containerName="manager"
Jul 08 17:29:16.243856 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.243836    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" containerName="manager"
Jul 08 17:29:16.243856 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.243841    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" containerName="manager"
Jul 08 17:29:16.243953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.243896    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="937297ca-b648-4904-be09-45814fb25f02" containerName="manager"
Jul 08 17:29:16.243953 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.243908    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="68d5832b-88fa-4bd2-b910-aa4c0964b466" containerName="manager"
Jul 08 17:29:16.248332 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.248312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:16.251215 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.251182    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 17:29:16.251473 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.251458    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 17:29:16.252431 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.252410    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cncpd\""
Jul 08 17:29:16.252486 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.252410    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 17:29:16.262004 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.261971    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"]
Jul 08 17:29:16.340181 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.340146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"]
Jul 08 17:29:16.348101 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.348071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:16.389232 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.389178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzl4m\" (UniqueName: \"kubernetes.io/projected/97dcb3b2-d1c0-4918-9170-061ee302d0b3-kube-api-access-pzl4m\") pod \"limitador-limitador-64c94fd64f-ps6kd\" (UID: \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:16.389413 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.389304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97dcb3b2-d1c0-4918-9170-061ee302d0b3-config-file\") pod \"limitador-limitador-64c94fd64f-ps6kd\" (UID: \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:16.448684 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.448639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:16.489855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.489740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97dcb3b2-d1c0-4918-9170-061ee302d0b3-config-file\") pod \"limitador-limitador-64c94fd64f-ps6kd\" (UID: \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:16.489855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.489832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzl4m\" (UniqueName: \"kubernetes.io/projected/97dcb3b2-d1c0-4918-9170-061ee302d0b3-kube-api-access-pzl4m\") pod \"limitador-limitador-64c94fd64f-ps6kd\" (UID: \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:16.490511 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.490489    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97dcb3b2-d1c0-4918-9170-061ee302d0b3-config-file\") pod \"limitador-limitador-64c94fd64f-ps6kd\" (UID: \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:16.498951 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.498910    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzl4m\" (UniqueName: \"kubernetes.io/projected/97dcb3b2-d1c0-4918-9170-061ee302d0b3-kube-api-access-pzl4m\") pod \"limitador-limitador-64c94fd64f-ps6kd\" (UID: \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:16.558634 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.558595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:16.699143 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:16.699104    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"]
Jul 08 17:29:16.701847 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:29:16.701819    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97dcb3b2_d1c0_4918_9170_061ee302d0b3.slice/crio-30c91f0c7b75738b1484c21727a6722d54d347817e8ec7af8f0647820af324f3 WatchSource:0}: Error finding container 30c91f0c7b75738b1484c21727a6722d54d347817e8ec7af8f0647820af324f3: Status 404 returned error can't find the container with id 30c91f0c7b75738b1484c21727a6722d54d347817e8ec7af8f0647820af324f3
Jul 08 17:29:17.095007 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:17.094976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:17.193343 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:17.193299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:17.461911 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:17.461791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd" event={"ID":"97dcb3b2-d1c0-4918-9170-061ee302d0b3","Type":"ContainerStarted","Data":"30c91f0c7b75738b1484c21727a6722d54d347817e8ec7af8f0647820af324f3"}
Jul 08 17:29:19.471900 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:19.471864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd" event={"ID":"97dcb3b2-d1c0-4918-9170-061ee302d0b3","Type":"ContainerStarted","Data":"2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57"}
Jul 08 17:29:19.472388 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:19.471964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:19.488506 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:19.488423    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd" podStartSLOduration=0.963811371 podStartE2EDuration="3.488408068s" totalImagesPullingTime="2.524596697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:19.487571851 +0000 UTC m=+794.410163207" watchObservedRunningTime="2026-07-08 17:29:19.488408068 +0000 UTC m=+794.410999423"
Jul 08 17:29:30.476654 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:30.476626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:31.539765 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:31.539735    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"]
Jul 08 17:29:31.540188 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:31.539900    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd" podUID="97dcb3b2-d1c0-4918-9170-061ee302d0b3" containerName="limitador" containerID="cri-o://2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57" gracePeriod=30
Jul 08 17:29:32.084721 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.084696    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:32.118694 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.118641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97dcb3b2-d1c0-4918-9170-061ee302d0b3-config-file\") pod \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\" (UID: \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\") "
Jul 08 17:29:32.118801 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.118699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzl4m\" (UniqueName: \"kubernetes.io/projected/97dcb3b2-d1c0-4918-9170-061ee302d0b3-kube-api-access-pzl4m\") pod \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\" (UID: \"97dcb3b2-d1c0-4918-9170-061ee302d0b3\") "
Jul 08 17:29:32.118972 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.118953    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97dcb3b2-d1c0-4918-9170-061ee302d0b3-config-file" (OuterVolumeSpecName: "config-file") pod "97dcb3b2-d1c0-4918-9170-061ee302d0b3" (UID: "97dcb3b2-d1c0-4918-9170-061ee302d0b3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:29:32.120918 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.120892    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97dcb3b2-d1c0-4918-9170-061ee302d0b3-kube-api-access-pzl4m" (OuterVolumeSpecName: "kube-api-access-pzl4m") pod "97dcb3b2-d1c0-4918-9170-061ee302d0b3" (UID: "97dcb3b2-d1c0-4918-9170-061ee302d0b3"). InnerVolumeSpecName "kube-api-access-pzl4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:29:32.219769 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.219734    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97dcb3b2-d1c0-4918-9170-061ee302d0b3-config-file\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:29:32.219769 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.219766    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzl4m\" (UniqueName: \"kubernetes.io/projected/97dcb3b2-d1c0-4918-9170-061ee302d0b3-kube-api-access-pzl4m\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:29:32.527661 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.527587    2578 generic.go:356] "Generic (PLEG): container finished" podID="97dcb3b2-d1c0-4918-9170-061ee302d0b3" containerID="2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57" exitCode=0
Jul 08 17:29:32.527661 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.527640    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"
Jul 08 17:29:32.527848 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.527678    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd" event={"ID":"97dcb3b2-d1c0-4918-9170-061ee302d0b3","Type":"ContainerDied","Data":"2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57"}
Jul 08 17:29:32.527848 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.527730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps6kd" event={"ID":"97dcb3b2-d1c0-4918-9170-061ee302d0b3","Type":"ContainerDied","Data":"30c91f0c7b75738b1484c21727a6722d54d347817e8ec7af8f0647820af324f3"}
Jul 08 17:29:32.527848 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.527752    2578 scope.go:117] "RemoveContainer" containerID="2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57"
Jul 08 17:29:32.536204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.536186    2578 scope.go:117] "RemoveContainer" containerID="2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57"
Jul 08 17:29:32.536496 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:29:32.536474    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57\": container with ID starting with 2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57 not found: ID does not exist" containerID="2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57"
Jul 08 17:29:32.536598 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.536502    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57"} err="failed to get container status \"2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57\": rpc error: code = NotFound desc = could not find container \"2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57\": container with ID starting with 2980d8c7675068a04f24f725dfd793e8dca5d9708e5e1ddbf15dffef7a119e57 not found: ID does not exist"
Jul 08 17:29:32.562509 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.562489    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"]
Jul 08 17:29:32.567199 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:32.567177    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps6kd"]
Jul 08 17:29:33.589071 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:33.589040    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97dcb3b2-d1c0-4918-9170-061ee302d0b3" path="/var/lib/kubelet/pods/97dcb3b2-d1c0-4918-9170-061ee302d0b3/volumes"
Jul 08 17:29:35.872855 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:35.872814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:35.977281 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:35.977235    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:36.405477 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.405448    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"]
Jul 08 17:29:36.405763 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.405751    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97dcb3b2-d1c0-4918-9170-061ee302d0b3" containerName="limitador"
Jul 08 17:29:36.405807 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.405765    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="97dcb3b2-d1c0-4918-9170-061ee302d0b3" containerName="limitador"
Jul 08 17:29:36.405841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.405815    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="97dcb3b2-d1c0-4918-9170-061ee302d0b3" containerName="limitador"
Jul 08 17:29:36.409900 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.409885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:36.412785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.412767    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 17:29:36.412929 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.412885    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dzwlx\""
Jul 08 17:29:36.413039 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.413023    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 17:29:36.414144 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.414127    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 17:29:36.421166 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.421148    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"]
Jul 08 17:29:36.452110 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.452083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:36.453145 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.453125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f4wq\" (UniqueName: \"kubernetes.io/projected/35f95abc-4a81-4688-ade4-5624367d15f0-kube-api-access-7f4wq\") pod \"postgres-69fb4594cf-vjhzb\" (UID: \"35f95abc-4a81-4688-ade4-5624367d15f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:36.453195 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.453176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/35f95abc-4a81-4688-ade4-5624367d15f0-data\") pod \"postgres-69fb4594cf-vjhzb\" (UID: \"35f95abc-4a81-4688-ade4-5624367d15f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:36.553889 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.553864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f4wq\" (UniqueName: \"kubernetes.io/projected/35f95abc-4a81-4688-ade4-5624367d15f0-kube-api-access-7f4wq\") pod \"postgres-69fb4594cf-vjhzb\" (UID: \"35f95abc-4a81-4688-ade4-5624367d15f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:36.554012 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.553922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/35f95abc-4a81-4688-ade4-5624367d15f0-data\") pod \"postgres-69fb4594cf-vjhzb\" (UID: \"35f95abc-4a81-4688-ade4-5624367d15f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:36.554326 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.554310    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/35f95abc-4a81-4688-ade4-5624367d15f0-data\") pod \"postgres-69fb4594cf-vjhzb\" (UID: \"35f95abc-4a81-4688-ade4-5624367d15f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:36.566954 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.566929    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f4wq\" (UniqueName: \"kubernetes.io/projected/35f95abc-4a81-4688-ade4-5624367d15f0-kube-api-access-7f4wq\") pod \"postgres-69fb4594cf-vjhzb\" (UID: \"35f95abc-4a81-4688-ade4-5624367d15f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:36.720805 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.720744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:36.848851 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:36.848823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"]
Jul 08 17:29:36.851766 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:29:36.851728    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f95abc_4a81_4688_ade4_5624367d15f0.slice/crio-18fcb22ee6c8f0eedfb7f25a0b68c09d1c26c2eb39695d0df468c2495f7eb8ba WatchSource:0}: Error finding container 18fcb22ee6c8f0eedfb7f25a0b68c09d1c26c2eb39695d0df468c2495f7eb8ba: Status 404 returned error can't find the container with id 18fcb22ee6c8f0eedfb7f25a0b68c09d1c26c2eb39695d0df468c2495f7eb8ba
Jul 08 17:29:37.554872 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:37.554843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb" event={"ID":"35f95abc-4a81-4688-ade4-5624367d15f0","Type":"ContainerStarted","Data":"18fcb22ee6c8f0eedfb7f25a0b68c09d1c26c2eb39695d0df468c2495f7eb8ba"}
Jul 08 17:29:42.002009 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:42.001906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:42.580031 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:42.579992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb" event={"ID":"35f95abc-4a81-4688-ade4-5624367d15f0","Type":"ContainerStarted","Data":"ba7053856074f05b1baae340b70e53c9c34b59650556cfbc704198b831b7c529"}
Jul 08 17:29:42.580222 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:42.580101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:42.595991 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:42.595939    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb" podStartSLOduration=1.813160874 podStartE2EDuration="6.595922373s" totalImagesPullingTime="4.782761499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:42.595479345 +0000 UTC m=+817.518070701" watchObservedRunningTime="2026-07-08 17:29:42.595922373 +0000 UTC m=+817.518513728"
Jul 08 17:29:48.550897 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:48.550863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:48.613679 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:48.613652    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vjhzb"
Jul 08 17:29:48.614154 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:48.614136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:48.946232 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:48.946141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:49.088331 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:49.088296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:55.314801 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.314757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:55.336806 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.336765    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79cf69f5cd-w5lnz"]
Jul 08 17:29:55.358231 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.358198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79cf69f5cd-w5lnz"]
Jul 08 17:29:55.358413 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.358353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:55.361263 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.361241    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 17:29:55.361423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.361239    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 17:29:55.361423 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.361251    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bvgdb\""
Jul 08 17:29:55.402514 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.402483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:55.461899 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.461867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:55.510602 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.510563    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-lbfj5"]
Jul 08 17:29:55.513987 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.513964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:55.517973 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.517953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7960799e-dc3d-41f1-a441-1fac86411ac3-webhook-cert\") pod \"maas-controller-79cf69f5cd-w5lnz\" (UID: \"7960799e-dc3d-41f1-a441-1fac86411ac3\") " pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:55.518078 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.517989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqsnv\" (UniqueName: \"kubernetes.io/projected/7960799e-dc3d-41f1-a441-1fac86411ac3-kube-api-access-jqsnv\") pod \"maas-controller-79cf69f5cd-w5lnz\" (UID: \"7960799e-dc3d-41f1-a441-1fac86411ac3\") " pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:55.522351 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.522328    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-lbfj5"]
Jul 08 17:29:55.615091 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.615010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:55.619095 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.619079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9wns\" (UniqueName: \"kubernetes.io/projected/36493548-3882-4dbb-804c-551300d6b738-kube-api-access-c9wns\") pod \"maas-controller-5cf8f76d6f-lbfj5\" (UID: \"36493548-3882-4dbb-804c-551300d6b738\") " pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:55.619154 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.619120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7960799e-dc3d-41f1-a441-1fac86411ac3-webhook-cert\") pod \"maas-controller-79cf69f5cd-w5lnz\" (UID: \"7960799e-dc3d-41f1-a441-1fac86411ac3\") " pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:55.619154 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.619147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqsnv\" (UniqueName: \"kubernetes.io/projected/7960799e-dc3d-41f1-a441-1fac86411ac3-kube-api-access-jqsnv\") pod \"maas-controller-79cf69f5cd-w5lnz\" (UID: \"7960799e-dc3d-41f1-a441-1fac86411ac3\") " pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:55.619236 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.619218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36493548-3882-4dbb-804c-551300d6b738-webhook-cert\") pod \"maas-controller-5cf8f76d6f-lbfj5\" (UID: \"36493548-3882-4dbb-804c-551300d6b738\") " pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:55.621638 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.621619    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7960799e-dc3d-41f1-a441-1fac86411ac3-webhook-cert\") pod \"maas-controller-79cf69f5cd-w5lnz\" (UID: \"7960799e-dc3d-41f1-a441-1fac86411ac3\") " pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:55.628090 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.628057    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqsnv\" (UniqueName: \"kubernetes.io/projected/7960799e-dc3d-41f1-a441-1fac86411ac3-kube-api-access-jqsnv\") pod \"maas-controller-79cf69f5cd-w5lnz\" (UID: \"7960799e-dc3d-41f1-a441-1fac86411ac3\") " pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:55.668896 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.668866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:55.720017 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.719984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36493548-3882-4dbb-804c-551300d6b738-webhook-cert\") pod \"maas-controller-5cf8f76d6f-lbfj5\" (UID: \"36493548-3882-4dbb-804c-551300d6b738\") " pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:55.720151 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.720070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9wns\" (UniqueName: \"kubernetes.io/projected/36493548-3882-4dbb-804c-551300d6b738-kube-api-access-c9wns\") pod \"maas-controller-5cf8f76d6f-lbfj5\" (UID: \"36493548-3882-4dbb-804c-551300d6b738\") " pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:55.722844 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.722819    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36493548-3882-4dbb-804c-551300d6b738-webhook-cert\") pod \"maas-controller-5cf8f76d6f-lbfj5\" (UID: \"36493548-3882-4dbb-804c-551300d6b738\") " pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:55.729712 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.729682    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9wns\" (UniqueName: \"kubernetes.io/projected/36493548-3882-4dbb-804c-551300d6b738-kube-api-access-c9wns\") pod \"maas-controller-5cf8f76d6f-lbfj5\" (UID: \"36493548-3882-4dbb-804c-551300d6b738\") " pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:55.806029 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.805848    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79cf69f5cd-w5lnz"]
Jul 08 17:29:55.808728 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:29:55.808693    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7960799e_dc3d_41f1_a441_1fac86411ac3.slice/crio-2b4e9661ba321982a9b4744334d91c610853a14195f26abd9322cbbe6c2e5c0e WatchSource:0}: Error finding container 2b4e9661ba321982a9b4744334d91c610853a14195f26abd9322cbbe6c2e5c0e: Status 404 returned error can't find the container with id 2b4e9661ba321982a9b4744334d91c610853a14195f26abd9322cbbe6c2e5c0e
Jul 08 17:29:55.825620 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.825588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:55.963701 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:55.963665    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-lbfj5"]
Jul 08 17:29:55.967011 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:29:55.966981    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36493548_3882_4dbb_804c_551300d6b738.slice/crio-a02e66aff44f196bb3b1f1ff3cab7ef7768559990e8059fd4dfe44c32d340121 WatchSource:0}: Error finding container a02e66aff44f196bb3b1f1ff3cab7ef7768559990e8059fd4dfe44c32d340121: Status 404 returned error can't find the container with id a02e66aff44f196bb3b1f1ff3cab7ef7768559990e8059fd4dfe44c32d340121
Jul 08 17:29:56.644392 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:56.644296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5" event={"ID":"36493548-3882-4dbb-804c-551300d6b738","Type":"ContainerStarted","Data":"a02e66aff44f196bb3b1f1ff3cab7ef7768559990e8059fd4dfe44c32d340121"}
Jul 08 17:29:56.646984 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:56.646913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz" event={"ID":"7960799e-dc3d-41f1-a441-1fac86411ac3","Type":"ContainerStarted","Data":"2b4e9661ba321982a9b4744334d91c610853a14195f26abd9322cbbe6c2e5c0e"}
Jul 08 17:29:58.659701 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:58.659663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz" event={"ID":"7960799e-dc3d-41f1-a441-1fac86411ac3","Type":"ContainerStarted","Data":"8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6"}
Jul 08 17:29:58.660162 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:58.659885    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:29:58.662032 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:58.661965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5" event={"ID":"36493548-3882-4dbb-804c-551300d6b738","Type":"ContainerStarted","Data":"152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397"}
Jul 08 17:29:58.662174 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:58.662057    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:29:58.673078 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:58.673057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:29:58.693540 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:58.693483    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz" podStartSLOduration=1.087174271 podStartE2EDuration="3.693468364s" totalImagesPullingTime="2.606294093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:58.691168217 +0000 UTC m=+833.613759572" watchObservedRunningTime="2026-07-08 17:29:58.693468364 +0000 UTC m=+833.616059719"
Jul 08 17:29:58.718188 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:58.718137    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5" podStartSLOduration=1.2606468880000001 podStartE2EDuration="3.718122501s" totalImagesPullingTime="2.457475613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:58.717584782 +0000 UTC m=+833.640176134" watchObservedRunningTime="2026-07-08 17:29:58.718122501 +0000 UTC m=+833.640713856"
Jul 08 17:29:58.771409 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:29:58.771364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:30:09.670711 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:09.670683    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:30:09.671099 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:09.670880    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:30:09.718600 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:09.718577    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79cf69f5cd-w5lnz"]
Jul 08 17:30:09.718777 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:09.718742    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz" podUID="7960799e-dc3d-41f1-a441-1fac86411ac3" containerName="manager" containerID="cri-o://8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6" gracePeriod=30
Jul 08 17:30:09.967607 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:09.967578    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:30:10.141447 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.141414    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqsnv\" (UniqueName: \"kubernetes.io/projected/7960799e-dc3d-41f1-a441-1fac86411ac3-kube-api-access-jqsnv\") pod \"7960799e-dc3d-41f1-a441-1fac86411ac3\" (UID: \"7960799e-dc3d-41f1-a441-1fac86411ac3\") "
Jul 08 17:30:10.141610 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.141526    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7960799e-dc3d-41f1-a441-1fac86411ac3-webhook-cert\") pod \"7960799e-dc3d-41f1-a441-1fac86411ac3\" (UID: \"7960799e-dc3d-41f1-a441-1fac86411ac3\") "
Jul 08 17:30:10.143830 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.143792    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7960799e-dc3d-41f1-a441-1fac86411ac3-kube-api-access-jqsnv" (OuterVolumeSpecName: "kube-api-access-jqsnv") pod "7960799e-dc3d-41f1-a441-1fac86411ac3" (UID: "7960799e-dc3d-41f1-a441-1fac86411ac3"). InnerVolumeSpecName "kube-api-access-jqsnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:30:10.143830 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.143819    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7960799e-dc3d-41f1-a441-1fac86411ac3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7960799e-dc3d-41f1-a441-1fac86411ac3" (UID: "7960799e-dc3d-41f1-a441-1fac86411ac3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:30:10.242428 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.242363    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqsnv\" (UniqueName: \"kubernetes.io/projected/7960799e-dc3d-41f1-a441-1fac86411ac3-kube-api-access-jqsnv\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:30:10.242428 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.242388    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7960799e-dc3d-41f1-a441-1fac86411ac3-webhook-cert\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:30:10.716204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.716176    2578 generic.go:356] "Generic (PLEG): container finished" podID="7960799e-dc3d-41f1-a441-1fac86411ac3" containerID="8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6" exitCode=0
Jul 08 17:30:10.716637 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.716212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz" event={"ID":"7960799e-dc3d-41f1-a441-1fac86411ac3","Type":"ContainerDied","Data":"8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6"}
Jul 08 17:30:10.716637 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.716214    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz"
Jul 08 17:30:10.716637 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.716259    2578 scope.go:117] "RemoveContainer" containerID="8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6"
Jul 08 17:30:10.716637 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.716249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cf69f5cd-w5lnz" event={"ID":"7960799e-dc3d-41f1-a441-1fac86411ac3","Type":"ContainerDied","Data":"2b4e9661ba321982a9b4744334d91c610853a14195f26abd9322cbbe6c2e5c0e"}
Jul 08 17:30:10.725413 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.725233    2578 scope.go:117] "RemoveContainer" containerID="8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6"
Jul 08 17:30:10.725547 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:30:10.725530    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6\": container with ID starting with 8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6 not found: ID does not exist" containerID="8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6"
Jul 08 17:30:10.725627 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.725556    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6"} err="failed to get container status \"8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6\": rpc error: code = NotFound desc = could not find container \"8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6\": container with ID starting with 8ab71dc9c637713bc503009f243e3e6a6652fe69bb291aea3e3dec47039756d6 not found: ID does not exist"
Jul 08 17:30:10.736851 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.736822    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79cf69f5cd-w5lnz"]
Jul 08 17:30:10.740516 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:10.740498    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79cf69f5cd-w5lnz"]
Jul 08 17:30:11.589841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:11.589804    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7960799e-dc3d-41f1-a441-1fac86411ac3" path="/var/lib/kubelet/pods/7960799e-dc3d-41f1-a441-1fac86411ac3/volumes"
Jul 08 17:30:30.036527 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.036487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:30:30.478444 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.478364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:30:30.537867 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.537838    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"]
Jul 08 17:30:30.538152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.538140    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7960799e-dc3d-41f1-a441-1fac86411ac3" containerName="manager"
Jul 08 17:30:30.538195 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.538154    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7960799e-dc3d-41f1-a441-1fac86411ac3" containerName="manager"
Jul 08 17:30:30.538230 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.538216    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7960799e-dc3d-41f1-a441-1fac86411ac3" containerName="manager"
Jul 08 17:30:30.541095 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.541080    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.543732 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.543710    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 17:30:30.543955 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.543943    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8btv6\""
Jul 08 17:30:30.551750 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.551729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"]
Jul 08 17:30:30.593902 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.593873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29db8cca-5e24-4244-98f8-e8ba1f22be9a-openshift-service-ca\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.594072 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.593921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25s2l\" (UniqueName: \"kubernetes.io/projected/29db8cca-5e24-4244-98f8-e8ba1f22be9a-kube-api-access-25s2l\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.594072 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.594000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29db8cca-5e24-4244-98f8-e8ba1f22be9a-maas-api-tls\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.694432 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.694397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29db8cca-5e24-4244-98f8-e8ba1f22be9a-openshift-service-ca\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.694432 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.694429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25s2l\" (UniqueName: \"kubernetes.io/projected/29db8cca-5e24-4244-98f8-e8ba1f22be9a-kube-api-access-25s2l\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.694673 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.694477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29db8cca-5e24-4244-98f8-e8ba1f22be9a-maas-api-tls\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.694673 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:30:30.694595    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 08 17:30:30.694673 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:30:30.694671    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29db8cca-5e24-4244-98f8-e8ba1f22be9a-maas-api-tls podName:29db8cca-5e24-4244-98f8-e8ba1f22be9a nodeName:}" failed. No retries permitted until 2026-07-08 17:30:31.194649783 +0000 UTC m=+866.117241136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/29db8cca-5e24-4244-98f8-e8ba1f22be9a-maas-api-tls") pod "maas-api-6db8bd4f89-5fxp9" (UID: "29db8cca-5e24-4244-98f8-e8ba1f22be9a") : secret "maas-api-serving-cert" not found
Jul 08 17:30:30.695029 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.695011    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29db8cca-5e24-4244-98f8-e8ba1f22be9a-openshift-service-ca\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.705743 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.705719    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25s2l\" (UniqueName: \"kubernetes.io/projected/29db8cca-5e24-4244-98f8-e8ba1f22be9a-kube-api-access-25s2l\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:30.751748 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.751682    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:30:30.964976 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:30.964947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:30:31.085773 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.085749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:30:31.198751 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.198727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29db8cca-5e24-4244-98f8-e8ba1f22be9a-maas-api-tls\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:31.201140 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.201122    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29db8cca-5e24-4244-98f8-e8ba1f22be9a-maas-api-tls\") pod \"maas-api-6db8bd4f89-5fxp9\" (UID: \"29db8cca-5e24-4244-98f8-e8ba1f22be9a\") " pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:31.249344 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.249317    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ltxbk"]
Jul 08 17:30:31.252692 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.252677    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:31.255223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.255202    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 17:30:31.255364 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.255334    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wnj5q\""
Jul 08 17:30:31.260976 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.260955    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ltxbk"]
Jul 08 17:30:31.299284 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.299236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33ca8b3b-80f6-4771-a324-91355477b5af-plugins-config-volume\") pod \"payload-processing-58f86c7798-ltxbk\" (UID: \"33ca8b3b-80f6-4771-a324-91355477b5af\") " pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:31.299387 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.299300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z45g2\" (UniqueName: \"kubernetes.io/projected/33ca8b3b-80f6-4771-a324-91355477b5af-kube-api-access-z45g2\") pod \"payload-processing-58f86c7798-ltxbk\" (UID: \"33ca8b3b-80f6-4771-a324-91355477b5af\") " pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:31.400817 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.400741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33ca8b3b-80f6-4771-a324-91355477b5af-plugins-config-volume\") pod \"payload-processing-58f86c7798-ltxbk\" (UID: \"33ca8b3b-80f6-4771-a324-91355477b5af\") " pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:31.400817 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.400788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z45g2\" (UniqueName: \"kubernetes.io/projected/33ca8b3b-80f6-4771-a324-91355477b5af-kube-api-access-z45g2\") pod \"payload-processing-58f86c7798-ltxbk\" (UID: \"33ca8b3b-80f6-4771-a324-91355477b5af\") " pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:31.401500 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.401477    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33ca8b3b-80f6-4771-a324-91355477b5af-plugins-config-volume\") pod \"payload-processing-58f86c7798-ltxbk\" (UID: \"33ca8b3b-80f6-4771-a324-91355477b5af\") " pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:31.408586 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.408566    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z45g2\" (UniqueName: \"kubernetes.io/projected/33ca8b3b-80f6-4771-a324-91355477b5af-kube-api-access-z45g2\") pod \"payload-processing-58f86c7798-ltxbk\" (UID: \"33ca8b3b-80f6-4771-a324-91355477b5af\") " pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:31.452260 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.452236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:31.564627 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.564574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:31.591059 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.590983    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"]
Jul 08 17:30:31.593452 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:30:31.593424    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29db8cca_5e24_4244_98f8_e8ba1f22be9a.slice/crio-f82e0fca6cefa204f6ba813f03879b977dc60795425940ec35891f9ede638901 WatchSource:0}: Error finding container f82e0fca6cefa204f6ba813f03879b977dc60795425940ec35891f9ede638901: Status 404 returned error can't find the container with id f82e0fca6cefa204f6ba813f03879b977dc60795425940ec35891f9ede638901
Jul 08 17:30:31.695884 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.695789    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ltxbk"]
Jul 08 17:30:31.698965 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:30:31.698933    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ca8b3b_80f6_4771_a324_91355477b5af.slice/crio-e0cfc18506e35fddbfb540c93d2dc4af86490b06b8473df5b94e1a35d78cbf84 WatchSource:0}: Error finding container e0cfc18506e35fddbfb540c93d2dc4af86490b06b8473df5b94e1a35d78cbf84: Status 404 returned error can't find the container with id e0cfc18506e35fddbfb540c93d2dc4af86490b06b8473df5b94e1a35d78cbf84
Jul 08 17:30:31.810818 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.810786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-ltxbk" event={"ID":"33ca8b3b-80f6-4771-a324-91355477b5af","Type":"ContainerStarted","Data":"e0cfc18506e35fddbfb540c93d2dc4af86490b06b8473df5b94e1a35d78cbf84"}
Jul 08 17:30:31.811926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:31.811893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9" event={"ID":"29db8cca-5e24-4244-98f8-e8ba1f22be9a","Type":"ContainerStarted","Data":"f82e0fca6cefa204f6ba813f03879b977dc60795425940ec35891f9ede638901"}
Jul 08 17:30:33.823165 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:33.823129    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-ltxbk" event={"ID":"33ca8b3b-80f6-4771-a324-91355477b5af","Type":"ContainerStarted","Data":"cde2a1b994ccf3147b81afff39398a28b5c228d8709d2d44b12d768ee5d397f8"}
Jul 08 17:30:33.823573 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:33.823202    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:33.824674 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:33.824654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9" event={"ID":"29db8cca-5e24-4244-98f8-e8ba1f22be9a","Type":"ContainerStarted","Data":"9d57e628425fe45ccd0c6d41d8585d1cda30e9d7a776419605d52830feac1156"}
Jul 08 17:30:33.824805 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:33.824771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:33.841960 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:33.841926    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-ltxbk" podStartSLOduration=1.503450094 podStartE2EDuration="2.841912696s" totalImagesPullingTime="1.338462602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:30:33.841017573 +0000 UTC m=+868.763608929" watchObservedRunningTime="2026-07-08 17:30:33.841912696 +0000 UTC m=+868.764504051"
Jul 08 17:30:33.866458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:33.866421    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9" podStartSLOduration=1.784125741 podStartE2EDuration="3.866408067s" totalImagesPullingTime="2.082282326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:30:33.865634154 +0000 UTC m=+868.788225514" watchObservedRunningTime="2026-07-08 17:30:33.866408067 +0000 UTC m=+868.788999422"
Jul 08 17:30:39.835587 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:39.835559    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6db8bd4f89-5fxp9"
Jul 08 17:30:41.425928 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:41.425854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:30:41.525440 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:41.525407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:30:44.831134 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:44.831102    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-ltxbk"
Jul 08 17:30:53.002100 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:30:53.002050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:31:00.834570 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.834441    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"]
Jul 08 17:31:00.838335 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.838301    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:00.842639 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.842610    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 17:31:00.842639 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.842630    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 17:31:00.842846 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.842661    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 17:31:00.842846 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.842620    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mzzmx\""
Jul 08 17:31:00.852548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.852514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"]
Jul 08 17:31:00.863825 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.863767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:31:00.964580 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.964545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:00.964765 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.964603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:00.964765 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.964630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:00.964765 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.964657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfhz2\" (UniqueName: \"kubernetes.io/projected/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-kube-api-access-pfhz2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:00.964939 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.964767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:00.964939 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:00.964801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066042 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066042 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066322 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066322 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066322 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066322 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfhz2\" (UniqueName: \"kubernetes.io/projected/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-kube-api-access-pfhz2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066542 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066487    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066542 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.066627 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.066583    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.068597 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.068574    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.068745 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.068730    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.074914 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.074894    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfhz2\" (UniqueName: \"kubernetes.io/projected/9b8d05b6-7cf3-438a-80a6-de66ac17dab2-kube-api-access-pfhz2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7hqn9\" (UID: \"9b8d05b6-7cf3-438a-80a6-de66ac17dab2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.172916 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.172804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:01.315668 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.315641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"]
Jul 08 17:31:01.318085 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:31:01.318060    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8d05b6_7cf3_438a_80a6_de66ac17dab2.slice/crio-bc944fa93c7f3e1ed2d0d93633a167bb64eea6e8961619d45bfa15d8a0e8381a WatchSource:0}: Error finding container bc944fa93c7f3e1ed2d0d93633a167bb64eea6e8961619d45bfa15d8a0e8381a: Status 404 returned error can't find the container with id bc944fa93c7f3e1ed2d0d93633a167bb64eea6e8961619d45bfa15d8a0e8381a
Jul 08 17:31:01.951922 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:01.951885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9" event={"ID":"9b8d05b6-7cf3-438a-80a6-de66ac17dab2","Type":"ContainerStarted","Data":"bc944fa93c7f3e1ed2d0d93633a167bb64eea6e8961619d45bfa15d8a0e8381a"}
Jul 08 17:31:02.958082 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:02.958049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9" event={"ID":"9b8d05b6-7cf3-438a-80a6-de66ac17dab2","Type":"ContainerStarted","Data":"4c176418591c363eb7cb1f0520bd5b70d81d29931e8639536fffcf284422c01c"}
Jul 08 17:31:02.976701 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:02.976653    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9" podStartSLOduration=1.9384351610000001 podStartE2EDuration="2.976637851s" totalImagesPullingTime="1.03820269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:31:02.975628058 +0000 UTC m=+897.898219520" watchObservedRunningTime="2026-07-08 17:31:02.976637851 +0000 UTC m=+897.899229205"
Jul 08 17:31:05.560439 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:05.560407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:31:11.173654 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:11.173610    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:11.177028 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:11.173674    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:11.186326 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:11.186305    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:12.013185 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:12.013153    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7hqn9"
Jul 08 17:31:14.546139 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:14.546099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:31:28.567032 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:28.566999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:31:43.542959 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:31:43.542924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:32:02.558585 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.558549    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"]
Jul 08 17:32:02.561981 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.561966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.565379 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.565352    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 08 17:32:02.584125 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.584096    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"]
Jul 08 17:32:02.666710 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.666673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.666860 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.666726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e768e0a2-517e-4f29-9a38-2964d7909e5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.666860 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.666805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.666860 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.666852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.666983 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.666875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlwf\" (UniqueName: \"kubernetes.io/projected/e768e0a2-517e-4f29-9a38-2964d7909e5e-kube-api-access-jjlwf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.666983 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.666903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.721012 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.720983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:32:02.768182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.768349 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e768e0a2-517e-4f29-9a38-2964d7909e5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.768349 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.768472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.768472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlwf\" (UniqueName: \"kubernetes.io/projected/e768e0a2-517e-4f29-9a38-2964d7909e5e-kube-api-access-jjlwf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.768585 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.768643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768602    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.768699 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768662    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.768823 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.768805    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.770684 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.770662    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e768e0a2-517e-4f29-9a38-2964d7909e5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.770990 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.770975    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e768e0a2-517e-4f29-9a38-2964d7909e5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.777211 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.777187    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlwf\" (UniqueName: \"kubernetes.io/projected/e768e0a2-517e-4f29-9a38-2964d7909e5e-kube-api-access-jjlwf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r429b\" (UID: \"e768e0a2-517e-4f29-9a38-2964d7909e5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:02.872092 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:02.872031    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:03.003354 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:03.003329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"]
Jul 08 17:32:03.005882 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:32:03.005855    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode768e0a2_517e_4f29_9a38_2964d7909e5e.slice/crio-250e5c65a16d98f7816459f5554c11fad7ab38d5c2c6dc531e1d6463934867e2 WatchSource:0}: Error finding container 250e5c65a16d98f7816459f5554c11fad7ab38d5c2c6dc531e1d6463934867e2: Status 404 returned error can't find the container with id 250e5c65a16d98f7816459f5554c11fad7ab38d5c2c6dc531e1d6463934867e2
Jul 08 17:32:03.007111 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:03.007095    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:32:03.226651 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:03.226623    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b" event={"ID":"e768e0a2-517e-4f29-9a38-2964d7909e5e","Type":"ContainerStarted","Data":"250e5c65a16d98f7816459f5554c11fad7ab38d5c2c6dc531e1d6463934867e2"}
Jul 08 17:32:04.232137 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:04.232103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b" event={"ID":"e768e0a2-517e-4f29-9a38-2964d7909e5e","Type":"ContainerStarted","Data":"765d8347350e9641b3881f1d271cecf86358143dd253f239af27a61f14316e4d"}
Jul 08 17:32:04.251233 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:04.251181    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b" podStartSLOduration=2.060361269 podStartE2EDuration="2.251165111s" totalImagesPullingTime="190.803842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:32:04.249379603 +0000 UTC m=+959.171970960" watchObservedRunningTime="2026-07-08 17:32:04.251165111 +0000 UTC m=+959.173756466"
Jul 08 17:32:12.689574 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:12.689533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:32:12.872657 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:12.872624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:12.872813 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:12.872702    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:12.885220 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:12.885196    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:32:13.289328 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:32:13.289304    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r429b"
Jul 08 17:33:02.413530 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:33:02.413487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:33:02.536050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:33:02.536018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:33:03.836139 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:33:03.836105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:33:03.933578 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:33:03.933548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:33:07.553112 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:33:07.553078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:33:07.655041 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:33:07.655011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:34:05.703081 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:05.703005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:34:16.809362 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:16.809328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:34:16.930642 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:16.930609    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-lbfj5"]
Jul 08 17:34:16.930843 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:16.930800    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5" podUID="36493548-3882-4dbb-804c-551300d6b738" containerName="manager" containerID="cri-o://152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397" gracePeriod=30
Jul 08 17:34:17.180600 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.180581    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:34:17.280565 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.280524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9wns\" (UniqueName: \"kubernetes.io/projected/36493548-3882-4dbb-804c-551300d6b738-kube-api-access-c9wns\") pod \"36493548-3882-4dbb-804c-551300d6b738\" (UID: \"36493548-3882-4dbb-804c-551300d6b738\") "
Jul 08 17:34:17.280740 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.280584    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36493548-3882-4dbb-804c-551300d6b738-webhook-cert\") pod \"36493548-3882-4dbb-804c-551300d6b738\" (UID: \"36493548-3882-4dbb-804c-551300d6b738\") "
Jul 08 17:34:17.282686 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.282655    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36493548-3882-4dbb-804c-551300d6b738-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "36493548-3882-4dbb-804c-551300d6b738" (UID: "36493548-3882-4dbb-804c-551300d6b738"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:34:17.282802 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.282661    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36493548-3882-4dbb-804c-551300d6b738-kube-api-access-c9wns" (OuterVolumeSpecName: "kube-api-access-c9wns") pod "36493548-3882-4dbb-804c-551300d6b738" (UID: "36493548-3882-4dbb-804c-551300d6b738"). InnerVolumeSpecName "kube-api-access-c9wns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:34:17.381369 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.381296    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36493548-3882-4dbb-804c-551300d6b738-webhook-cert\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:34:17.381369 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.381331    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9wns\" (UniqueName: \"kubernetes.io/projected/36493548-3882-4dbb-804c-551300d6b738-kube-api-access-c9wns\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:34:17.817313 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.817256    2578 generic.go:356] "Generic (PLEG): container finished" podID="36493548-3882-4dbb-804c-551300d6b738" containerID="152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397" exitCode=0
Jul 08 17:34:17.817313 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.817298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5" event={"ID":"36493548-3882-4dbb-804c-551300d6b738","Type":"ContainerDied","Data":"152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397"}
Jul 08 17:34:17.817873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.817331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5"
Jul 08 17:34:17.817873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.817376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cf8f76d6f-lbfj5" event={"ID":"36493548-3882-4dbb-804c-551300d6b738","Type":"ContainerDied","Data":"a02e66aff44f196bb3b1f1ff3cab7ef7768559990e8059fd4dfe44c32d340121"}
Jul 08 17:34:17.817873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.817400    2578 scope.go:117] "RemoveContainer" containerID="152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397"
Jul 08 17:34:17.826682 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.826664    2578 scope.go:117] "RemoveContainer" containerID="152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397"
Jul 08 17:34:17.826959 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:34:17.826941    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397\": container with ID starting with 152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397 not found: ID does not exist" containerID="152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397"
Jul 08 17:34:17.827025 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.826969    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397"} err="failed to get container status \"152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397\": rpc error: code = NotFound desc = could not find container \"152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397\": container with ID starting with 152dd792d95ea95ffa83183e11dd594b5ae928e7ecbdbfde0048c1f010ea1397 not found: ID does not exist"
Jul 08 17:34:17.836747 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.836726    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-lbfj5"]
Jul 08 17:34:17.840950 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:17.840932    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-lbfj5"]
Jul 08 17:34:18.551833 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.551789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:34:18.682040 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.682008    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-q989p"]
Jul 08 17:34:18.682367 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.682354    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36493548-3882-4dbb-804c-551300d6b738" containerName="manager"
Jul 08 17:34:18.682419 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.682369    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="36493548-3882-4dbb-804c-551300d6b738" containerName="manager"
Jul 08 17:34:18.682454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.682439    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="36493548-3882-4dbb-804c-551300d6b738" containerName="manager"
Jul 08 17:34:18.686607 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.686590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:18.690378 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.690360    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 17:34:18.690490 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.690397    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bvgdb\""
Jul 08 17:34:18.690490 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.690459    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 17:34:18.694097 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.694070    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-q989p"]
Jul 08 17:34:18.799008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.798982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8be3c529-5f87-4138-8b96-20c143f548a7-webhook-cert\") pod \"maas-controller-5cf8f76d6f-q989p\" (UID: \"8be3c529-5f87-4138-8b96-20c143f548a7\") " pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:18.799008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.799009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d24l\" (UniqueName: \"kubernetes.io/projected/8be3c529-5f87-4138-8b96-20c143f548a7-kube-api-access-5d24l\") pod \"maas-controller-5cf8f76d6f-q989p\" (UID: \"8be3c529-5f87-4138-8b96-20c143f548a7\") " pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:18.899449 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.899384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8be3c529-5f87-4138-8b96-20c143f548a7-webhook-cert\") pod \"maas-controller-5cf8f76d6f-q989p\" (UID: \"8be3c529-5f87-4138-8b96-20c143f548a7\") " pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:18.899449 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.899411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d24l\" (UniqueName: \"kubernetes.io/projected/8be3c529-5f87-4138-8b96-20c143f548a7-kube-api-access-5d24l\") pod \"maas-controller-5cf8f76d6f-q989p\" (UID: \"8be3c529-5f87-4138-8b96-20c143f548a7\") " pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:18.902108 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.902077    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8be3c529-5f87-4138-8b96-20c143f548a7-webhook-cert\") pod \"maas-controller-5cf8f76d6f-q989p\" (UID: \"8be3c529-5f87-4138-8b96-20c143f548a7\") " pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:18.914580 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.914555    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d24l\" (UniqueName: \"kubernetes.io/projected/8be3c529-5f87-4138-8b96-20c143f548a7-kube-api-access-5d24l\") pod \"maas-controller-5cf8f76d6f-q989p\" (UID: \"8be3c529-5f87-4138-8b96-20c143f548a7\") " pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:18.998210 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:18.998185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:19.128758 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:19.128731    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cf8f76d6f-q989p"]
Jul 08 17:34:19.132334 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:34:19.132308    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be3c529_5f87_4138_8b96_20c143f548a7.slice/crio-39260be5d170d69788d1c96447b12f171293b4656f12e02ee93446ea5cf8e032 WatchSource:0}: Error finding container 39260be5d170d69788d1c96447b12f171293b4656f12e02ee93446ea5cf8e032: Status 404 returned error can't find the container with id 39260be5d170d69788d1c96447b12f171293b4656f12e02ee93446ea5cf8e032
Jul 08 17:34:19.590031 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:19.590009    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36493548-3882-4dbb-804c-551300d6b738" path="/var/lib/kubelet/pods/36493548-3882-4dbb-804c-551300d6b738/volumes"
Jul 08 17:34:19.828964 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:19.828869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cf8f76d6f-q989p" event={"ID":"8be3c529-5f87-4138-8b96-20c143f548a7","Type":"ContainerStarted","Data":"63d00fddcdeaa4959bef2b28a84bf3360321aee440c1cc203a364f163a8c09d5"}
Jul 08 17:34:19.828964 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:19.828919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cf8f76d6f-q989p" event={"ID":"8be3c529-5f87-4138-8b96-20c143f548a7","Type":"ContainerStarted","Data":"39260be5d170d69788d1c96447b12f171293b4656f12e02ee93446ea5cf8e032"}
Jul 08 17:34:19.829156 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:19.828987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:34:19.846821 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:19.846700    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cf8f76d6f-q989p" podStartSLOduration=1.404141916 podStartE2EDuration="1.846679391s" totalImagesPullingTime="442.537475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:19.845745379 +0000 UTC m=+1094.768336735" watchObservedRunningTime="2026-07-08 17:34:19.846679391 +0000 UTC m=+1094.769270752"
Jul 08 17:34:30.839532 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:34:30.839501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cf8f76d6f-q989p"
Jul 08 17:35:01.965741 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:01.965706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:02.065348 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:02.065314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:02.339392 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:02.339360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:08.120417 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:08.120373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:08.192414 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:08.192384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:08.400310 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:08.400209    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:08.540100 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:08.540070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:08.647624 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:08.647589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:14.406704 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:14.406665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:14.541400 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:14.541362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:35:46.364884 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:35:46.364848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:36:40.215094 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:36:40.215056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:39:41.509733 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:39:41.509697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:40:25.358025 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:40:25.357940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:40:44.627923 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:40:44.627892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:40:59.915244 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:40:59.915207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:41:00.016409 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:41:00.016377    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:41:10.295126 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:41:10.295097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:01.417384 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:01.417299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:08.778421 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:08.778381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:17.048531 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:17.048486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:22.249018 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:22.248982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:25.301950 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:25.301911    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:25.402472 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:25.402440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:25.805769 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:25.805739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:31.482967 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:31.482932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:31.585169 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:31.585144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:31.708258 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:31.708215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:31.765602 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:31.765538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:32.918009 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:32.917952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:32.971381 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:32.971355    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"]
Jul 08 17:46:32.974785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:32.974769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:32.977646 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:32.977628    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-068fee65-serving-cert\""
Jul 08 17:46:32.990841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:32.990817    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"]
Jul 08 17:46:32.994030 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:32.994007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a57331-e9b5-49f3-be36-f143da669c39-openshift-service-ca\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:32.994141 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:32.994073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxkpv\" (UniqueName: \"kubernetes.io/projected/06a57331-e9b5-49f3-be36-f143da669c39-kube-api-access-rxkpv\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:32.994205 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:32.994160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:33.008508 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.008429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:33.091491 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.091464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:33.094544 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.094525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a57331-e9b5-49f3-be36-f143da669c39-openshift-service-ca\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:33.094619 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.094566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxkpv\" (UniqueName: \"kubernetes.io/projected/06a57331-e9b5-49f3-be36-f143da669c39-kube-api-access-rxkpv\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:33.094619 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.094599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:33.094724 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:46:33.094702    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-serving-cert: secret "maas-api-e2e-ait-068fee65-serving-cert" not found
Jul 08 17:46:33.094782 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:46:33.094760    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls podName:06a57331-e9b5-49f3-be36-f143da669c39 nodeName:}" failed. No retries permitted until 2026-07-08 17:46:33.594745594 +0000 UTC m=+1828.517336929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls") pod "maas-api-e2e-ait-068fee65-555c855b85-j495f" (UID: "06a57331-e9b5-49f3-be36-f143da669c39") : secret "maas-api-e2e-ait-068fee65-serving-cert" not found
Jul 08 17:46:33.095121 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.095103    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a57331-e9b5-49f3-be36-f143da669c39-openshift-service-ca\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:33.105579 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.105551    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxkpv\" (UniqueName: \"kubernetes.io/projected/06a57331-e9b5-49f3-be36-f143da669c39-kube-api-access-rxkpv\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:33.541172 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.541133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:33.598514 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.598487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:33.600739 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.600716    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls\") pod \"maas-api-e2e-ait-068fee65-555c855b85-j495f\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:33.642396 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.642364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:33.745318 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.745286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:33.887682 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:33.887612    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:34.020933 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:34.020770    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"]
Jul 08 17:46:34.023617 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:46:34.023591    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a57331_e9b5_49f3_be36_f143da669c39.slice/crio-05a0bca22efdd8d38039451906ab7d4ba1f60acb3f0e026c75f05d1afd011267 WatchSource:0}: Error finding container 05a0bca22efdd8d38039451906ab7d4ba1f60acb3f0e026c75f05d1afd011267: Status 404 returned error can't find the container with id 05a0bca22efdd8d38039451906ab7d4ba1f60acb3f0e026c75f05d1afd011267
Jul 08 17:46:34.025100 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:34.025079    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:46:35.020120 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:35.020082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f" event={"ID":"06a57331-e9b5-49f3-be36-f143da669c39","Type":"ContainerStarted","Data":"77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b"}
Jul 08 17:46:35.020322 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:35.020304    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:35.020385 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:35.020348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f" event={"ID":"06a57331-e9b5-49f3-be36-f143da669c39","Type":"ContainerStarted","Data":"05a0bca22efdd8d38039451906ab7d4ba1f60acb3f0e026c75f05d1afd011267"}
Jul 08 17:46:35.040541 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:35.040496    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f" podStartSLOduration=2.5820306950000003 podStartE2EDuration="3.040482997s" totalImagesPullingTime="458.452302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:35.038677709 +0000 UTC m=+1829.961269062" watchObservedRunningTime="2026-07-08 17:46:35.040482997 +0000 UTC m=+1829.963074377"
Jul 08 17:46:35.499741 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:35.499714    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:38.017768 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.017732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:38.214064 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.214021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:38.316658 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.316633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:38.341291 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.341235    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"]
Jul 08 17:46:38.341533 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.341504    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f" podUID="06a57331-e9b5-49f3-be36-f143da669c39" containerName="maas-api" containerID="cri-o://77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b" gracePeriod=30
Jul 08 17:46:38.417612 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.417581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:38.577634 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.577585    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:38.642574 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.642552    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a57331-e9b5-49f3-be36-f143da669c39-openshift-service-ca\") pod \"06a57331-e9b5-49f3-be36-f143da669c39\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") "
Jul 08 17:46:38.642695 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.642597    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxkpv\" (UniqueName: \"kubernetes.io/projected/06a57331-e9b5-49f3-be36-f143da669c39-kube-api-access-rxkpv\") pod \"06a57331-e9b5-49f3-be36-f143da669c39\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") "
Jul 08 17:46:38.642695 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.642631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls\") pod \"06a57331-e9b5-49f3-be36-f143da669c39\" (UID: \"06a57331-e9b5-49f3-be36-f143da669c39\") "
Jul 08 17:46:38.642872 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.642853    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a57331-e9b5-49f3-be36-f143da669c39-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06a57331-e9b5-49f3-be36-f143da669c39" (UID: "06a57331-e9b5-49f3-be36-f143da669c39"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:46:38.644771 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.644747    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06a57331-e9b5-49f3-be36-f143da669c39" (UID: "06a57331-e9b5-49f3-be36-f143da669c39"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:46:38.644874 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.644808    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a57331-e9b5-49f3-be36-f143da669c39-kube-api-access-rxkpv" (OuterVolumeSpecName: "kube-api-access-rxkpv") pod "06a57331-e9b5-49f3-be36-f143da669c39" (UID: "06a57331-e9b5-49f3-be36-f143da669c39"). InnerVolumeSpecName "kube-api-access-rxkpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:46:38.743609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.743585    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a57331-e9b5-49f3-be36-f143da669c39-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:46:38.743609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.743605    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxkpv\" (UniqueName: \"kubernetes.io/projected/06a57331-e9b5-49f3-be36-f143da669c39-kube-api-access-rxkpv\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:46:38.743740 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:38.743614    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06a57331-e9b5-49f3-be36-f143da669c39-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:46:39.038005 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.037973    2578 generic.go:356] "Generic (PLEG): container finished" podID="06a57331-e9b5-49f3-be36-f143da669c39" containerID="77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b" exitCode=0
Jul 08 17:46:39.038396 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.038019    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"
Jul 08 17:46:39.038396 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.038070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f" event={"ID":"06a57331-e9b5-49f3-be36-f143da669c39","Type":"ContainerDied","Data":"77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b"}
Jul 08 17:46:39.038396 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.038115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f" event={"ID":"06a57331-e9b5-49f3-be36-f143da669c39","Type":"ContainerDied","Data":"05a0bca22efdd8d38039451906ab7d4ba1f60acb3f0e026c75f05d1afd011267"}
Jul 08 17:46:39.038396 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.038136    2578 scope.go:117] "RemoveContainer" containerID="77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b"
Jul 08 17:46:39.046997 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.046983    2578 scope.go:117] "RemoveContainer" containerID="77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b"
Jul 08 17:46:39.047229 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:46:39.047213    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b\": container with ID starting with 77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b not found: ID does not exist" containerID="77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b"
Jul 08 17:46:39.047318 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.047238    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b"} err="failed to get container status \"77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b\": rpc error: code = NotFound desc = could not find container \"77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b\": container with ID starting with 77d5c71015dd8a29f43db6297d4b193e0fbc4f7fef3a503714afb2b5fa46081b not found: ID does not exist"
Jul 08 17:46:39.059354 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.059331    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"]
Jul 08 17:46:39.069951 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.069930    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-068fee65-555c855b85-j495f"]
Jul 08 17:46:39.589233 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.589198    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a57331-e9b5-49f3-be36-f143da669c39" path="/var/lib/kubelet/pods/06a57331-e9b5-49f3-be36-f143da669c39/volumes"
Jul 08 17:46:39.814220 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:39.814183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:44.647920 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:44.647878    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:44.714177 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:44.714147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:44.906743 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:44.906659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:45.078425 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:45.078396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:46.129910 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.129858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:46.222238 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.222207    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"]
Jul 08 17:46:46.222590 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.222577    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a57331-e9b5-49f3-be36-f143da669c39" containerName="maas-api"
Jul 08 17:46:46.222647 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.222591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a57331-e9b5-49f3-be36-f143da669c39" containerName="maas-api"
Jul 08 17:46:46.222647 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.222637    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a57331-e9b5-49f3-be36-f143da669c39" containerName="maas-api"
Jul 08 17:46:46.225977 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.225949    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.229904 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.229880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7f7fa9dc-serving-cert\""
Jul 08 17:46:46.242353 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.242328    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"]
Jul 08 17:46:46.251727 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.251700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:46.303658 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.303629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwn76\" (UniqueName: \"kubernetes.io/projected/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-kube-api-access-bwn76\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.303766 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.303717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-openshift-service-ca\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.303841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.303789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.350172 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.350152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:46.405182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.405109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwn76\" (UniqueName: \"kubernetes.io/projected/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-kube-api-access-bwn76\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.405182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.405160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-openshift-service-ca\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.405390 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.405196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.405390 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:46:46.405303    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-serving-cert: secret "maas-api-e2e-ait-7f7fa9dc-serving-cert" not found
Jul 08 17:46:46.405390 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:46:46.405365    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls podName:8ee07b6c-9fa7-4aea-aa8f-a267518c8c77 nodeName:}" failed. No retries permitted until 2026-07-08 17:46:46.90535025 +0000 UTC m=+1841.827941582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls") pod "maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc" (UID: "8ee07b6c-9fa7-4aea-aa8f-a267518c8c77") : secret "maas-api-e2e-ait-7f7fa9dc-serving-cert" not found
Jul 08 17:46:46.405869 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.405846    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-openshift-service-ca\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.414018 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.413997    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwn76\" (UniqueName: \"kubernetes.io/projected/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-kube-api-access-bwn76\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.524108 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.524062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:46.787583 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.787551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:46.884635 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.884608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:46.908213 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.908191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:46.910654 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:46.910629    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls\") pod \"maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:47.137553 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:47.137462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:47.275894 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:47.275841    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"]
Jul 08 17:46:47.278322 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:46:47.278294    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee07b6c_9fa7_4aea_aa8f_a267518c8c77.slice/crio-c3e1f2c2fddb76cd85f1da2a6ab7b7b830928cf0e6fe9a9d970aaa72fca9fc1d WatchSource:0}: Error finding container c3e1f2c2fddb76cd85f1da2a6ab7b7b830928cf0e6fe9a9d970aaa72fca9fc1d: Status 404 returned error can't find the container with id c3e1f2c2fddb76cd85f1da2a6ab7b7b830928cf0e6fe9a9d970aaa72fca9fc1d
Jul 08 17:46:48.052495 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:48.052462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:48.078489 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:48.078461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc" event={"ID":"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77","Type":"ContainerStarted","Data":"dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9"}
Jul 08 17:46:48.078611 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:48.078511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc" event={"ID":"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77","Type":"ContainerStarted","Data":"c3e1f2c2fddb76cd85f1da2a6ab7b7b830928cf0e6fe9a9d970aaa72fca9fc1d"}
Jul 08 17:46:48.078611 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:48.078534    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:48.103996 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:48.103953    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc" podStartSLOduration=1.7201058009999999 podStartE2EDuration="2.103937529s" totalImagesPullingTime="383.831728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:48.102167478 +0000 UTC m=+1843.024758834" watchObservedRunningTime="2026-07-08 17:46:48.103937529 +0000 UTC m=+1843.026528885"
Jul 08 17:46:51.200473 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:51.200439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:51.774614 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:51.774585    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"]
Jul 08 17:46:51.774813 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:51.774785    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc" podUID="8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" containerName="maas-api" containerID="cri-o://dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9" gracePeriod=30
Jul 08 17:46:51.806951 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:51.806905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:52.018359 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.018338    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:52.096638 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.096610    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" containerID="dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9" exitCode=0
Jul 08 17:46:52.096754 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.096650    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"
Jul 08 17:46:52.096754 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.096653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc" event={"ID":"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77","Type":"ContainerDied","Data":"dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9"}
Jul 08 17:46:52.096754 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.096699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc" event={"ID":"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77","Type":"ContainerDied","Data":"c3e1f2c2fddb76cd85f1da2a6ab7b7b830928cf0e6fe9a9d970aaa72fca9fc1d"}
Jul 08 17:46:52.096754 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.096720    2578 scope.go:117] "RemoveContainer" containerID="dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9"
Jul 08 17:46:52.104426 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.104409    2578 scope.go:117] "RemoveContainer" containerID="dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9"
Jul 08 17:46:52.104700 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:46:52.104683    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9\": container with ID starting with dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9 not found: ID does not exist" containerID="dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9"
Jul 08 17:46:52.104755 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.104708    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9"} err="failed to get container status \"dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9\": rpc error: code = NotFound desc = could not find container \"dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9\": container with ID starting with dc496b8d915730908bea4bc2219721b04b408191bf20d3155b5f5b5ce44183f9 not found: ID does not exist"
Jul 08 17:46:52.155539 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.155522    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-openshift-service-ca\") pod \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") "
Jul 08 17:46:52.155622 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.155577    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwn76\" (UniqueName: \"kubernetes.io/projected/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-kube-api-access-bwn76\") pod \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") "
Jul 08 17:46:52.155622 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.155600    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls\") pod \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\" (UID: \"8ee07b6c-9fa7-4aea-aa8f-a267518c8c77\") "
Jul 08 17:46:52.155877 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.155856    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" (UID: "8ee07b6c-9fa7-4aea-aa8f-a267518c8c77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:46:52.157488 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.157471    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-kube-api-access-bwn76" (OuterVolumeSpecName: "kube-api-access-bwn76") pod "8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" (UID: "8ee07b6c-9fa7-4aea-aa8f-a267518c8c77"). InnerVolumeSpecName "kube-api-access-bwn76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:46:52.157692 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.157674    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" (UID: "8ee07b6c-9fa7-4aea-aa8f-a267518c8c77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:46:52.257142 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.257120    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:46:52.257142 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.257140    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwn76\" (UniqueName: \"kubernetes.io/projected/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-kube-api-access-bwn76\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:46:52.257459 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.257150    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:46:52.418104 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.418079    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"]
Jul 08 17:46:52.423008 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:52.422990    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7f7fa9dc-77ff58b75c-sglhc"]
Jul 08 17:46:53.590221 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:53.590192    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" path="/var/lib/kubelet/pods/8ee07b6c-9fa7-4aea-aa8f-a267518c8c77/volumes"
Jul 08 17:46:57.438935 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:57.438896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:46:57.545858 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:46:57.545825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:03.317156 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:03.317118    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:03.379145 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:03.379109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:03.520845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:03.520811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:04.640539 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.640507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:04.700188 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.700155    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"]
Jul 08 17:47:04.700587 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.700572    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" containerName="maas-api"
Jul 08 17:47:04.700587 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.700588    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" containerName="maas-api"
Jul 08 17:47:04.700693 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.700666    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ee07b6c-9fa7-4aea-aa8f-a267518c8c77" containerName="maas-api"
Jul 08 17:47:04.704877 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.704859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:04.707486 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.707465    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8af199d6-serving-cert\""
Jul 08 17:47:04.718454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.718392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"]
Jul 08 17:47:04.722025 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.721993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:04.797844 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.797808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:04.850763 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.850737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4fdh\" (UniqueName: \"kubernetes.io/projected/325de354-a004-42fc-9df3-0ee737dd5fcf-kube-api-access-s4fdh\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:04.850903 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.850776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325de354-a004-42fc-9df3-0ee737dd5fcf-openshift-service-ca\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:04.850903 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.850796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:04.951529 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.951467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4fdh\" (UniqueName: \"kubernetes.io/projected/325de354-a004-42fc-9df3-0ee737dd5fcf-kube-api-access-s4fdh\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:04.951529 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.951507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325de354-a004-42fc-9df3-0ee737dd5fcf-openshift-service-ca\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:04.951676 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.951533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:04.951676 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:47:04.951664    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-serving-cert: secret "maas-api-e2e-derive-8af199d6-serving-cert" not found
Jul 08 17:47:04.951757 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:47:04.951735    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls podName:325de354-a004-42fc-9df3-0ee737dd5fcf nodeName:}" failed. No retries permitted until 2026-07-08 17:47:05.451716314 +0000 UTC m=+1860.374307654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls") pod "maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf" (UID: "325de354-a004-42fc-9df3-0ee737dd5fcf") : secret "maas-api-e2e-derive-8af199d6-serving-cert" not found
Jul 08 17:47:04.952094 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.952075    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325de354-a004-42fc-9df3-0ee737dd5fcf-openshift-service-ca\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:04.963712 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:04.963691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4fdh\" (UniqueName: \"kubernetes.io/projected/325de354-a004-42fc-9df3-0ee737dd5fcf-kube-api-access-s4fdh\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:05.031143 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:05.031115    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:05.127041 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:05.127008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:05.250888 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:05.250819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:05.387741 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:05.387713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:05.456324 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:05.456295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:05.458845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:05.458824    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls\") pod \"maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:05.616391 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:05.616363    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:05.762957 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:05.762931    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"]
Jul 08 17:47:05.767012 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:47:05.766987    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325de354_a004_42fc_9df3_0ee737dd5fcf.slice/crio-93a8841d4b791f8cbeeecc6c9850de35ea8d1a85b7d3996eb2f7f13ea7beb7bb WatchSource:0}: Error finding container 93a8841d4b791f8cbeeecc6c9850de35ea8d1a85b7d3996eb2f7f13ea7beb7bb: Status 404 returned error can't find the container with id 93a8841d4b791f8cbeeecc6c9850de35ea8d1a85b7d3996eb2f7f13ea7beb7bb
Jul 08 17:47:06.159957 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:06.159924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf" event={"ID":"325de354-a004-42fc-9df3-0ee737dd5fcf","Type":"ContainerStarted","Data":"93a8841d4b791f8cbeeecc6c9850de35ea8d1a85b7d3996eb2f7f13ea7beb7bb"}
Jul 08 17:47:07.166062 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:07.166027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf" event={"ID":"325de354-a004-42fc-9df3-0ee737dd5fcf","Type":"ContainerStarted","Data":"79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5"}
Jul 08 17:47:07.166448 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:07.166144    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:07.184769 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:07.184724    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf" podStartSLOduration=2.322982405 podStartE2EDuration="3.184710802s" totalImagesPullingTime="861.728397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:07.18295763 +0000 UTC m=+1862.105548987" watchObservedRunningTime="2026-07-08 17:47:07.184710802 +0000 UTC m=+1862.107302156"
Jul 08 17:47:09.310952 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.310915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:09.413667 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.413589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:09.423718 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.423685    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"]
Jul 08 17:47:09.423991 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.423963    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf" podUID="325de354-a004-42fc-9df3-0ee737dd5fcf" containerName="maas-api" containerID="cri-o://79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5" gracePeriod=30
Jul 08 17:47:09.477471 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.477438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:09.667878 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.667857    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:09.792375 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.792346    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls\") pod \"325de354-a004-42fc-9df3-0ee737dd5fcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") "
Jul 08 17:47:09.792529 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.792445    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325de354-a004-42fc-9df3-0ee737dd5fcf-openshift-service-ca\") pod \"325de354-a004-42fc-9df3-0ee737dd5fcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") "
Jul 08 17:47:09.792529 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.792493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4fdh\" (UniqueName: \"kubernetes.io/projected/325de354-a004-42fc-9df3-0ee737dd5fcf-kube-api-access-s4fdh\") pod \"325de354-a004-42fc-9df3-0ee737dd5fcf\" (UID: \"325de354-a004-42fc-9df3-0ee737dd5fcf\") "
Jul 08 17:47:09.792754 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.792730    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/325de354-a004-42fc-9df3-0ee737dd5fcf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "325de354-a004-42fc-9df3-0ee737dd5fcf" (UID: "325de354-a004-42fc-9df3-0ee737dd5fcf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:47:09.794564 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.794545    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325de354-a004-42fc-9df3-0ee737dd5fcf-kube-api-access-s4fdh" (OuterVolumeSpecName: "kube-api-access-s4fdh") pod "325de354-a004-42fc-9df3-0ee737dd5fcf" (UID: "325de354-a004-42fc-9df3-0ee737dd5fcf"). InnerVolumeSpecName "kube-api-access-s4fdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:47:09.794643 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.794578    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "325de354-a004-42fc-9df3-0ee737dd5fcf" (UID: "325de354-a004-42fc-9df3-0ee737dd5fcf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:47:09.893340 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.893250    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325de354-a004-42fc-9df3-0ee737dd5fcf-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:47:09.893340 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.893294    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325de354-a004-42fc-9df3-0ee737dd5fcf-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:47:09.893340 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:09.893308    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4fdh\" (UniqueName: \"kubernetes.io/projected/325de354-a004-42fc-9df3-0ee737dd5fcf-kube-api-access-s4fdh\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:47:10.179899 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.179821    2578 generic.go:356] "Generic (PLEG): container finished" podID="325de354-a004-42fc-9df3-0ee737dd5fcf" containerID="79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5" exitCode=0
Jul 08 17:47:10.179899 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.179863    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"
Jul 08 17:47:10.180071 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.179900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf" event={"ID":"325de354-a004-42fc-9df3-0ee737dd5fcf","Type":"ContainerDied","Data":"79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5"}
Jul 08 17:47:10.180071 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.179950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf" event={"ID":"325de354-a004-42fc-9df3-0ee737dd5fcf","Type":"ContainerDied","Data":"93a8841d4b791f8cbeeecc6c9850de35ea8d1a85b7d3996eb2f7f13ea7beb7bb"}
Jul 08 17:47:10.180071 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.179972    2578 scope.go:117] "RemoveContainer" containerID="79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5"
Jul 08 17:47:10.194765 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.194745    2578 scope.go:117] "RemoveContainer" containerID="79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5"
Jul 08 17:47:10.194997 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:47:10.194981    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5\": container with ID starting with 79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5 not found: ID does not exist" containerID="79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5"
Jul 08 17:47:10.195045 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.195007    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5"} err="failed to get container status \"79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5\": rpc error: code = NotFound desc = could not find container \"79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5\": container with ID starting with 79877ca5e0f6b32e3e7d95e395cec7c29e1e1477c3f37e5bb815dc0a6bd3efb5 not found: ID does not exist"
Jul 08 17:47:10.207512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.207490    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"]
Jul 08 17:47:10.211728 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:10.211708    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8af199d6-f5b44b8fc-7gfcf"]
Jul 08 17:47:11.425762 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:11.425735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:11.589910 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:11.589871    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="325de354-a004-42fc-9df3-0ee737dd5fcf" path="/var/lib/kubelet/pods/325de354-a004-42fc-9df3-0ee737dd5fcf/volumes"
Jul 08 17:47:15.101062 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:15.101028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:15.165356 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:15.165329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:15.611286 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:15.611238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:15.715791 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:15.715739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:15.810878 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:15.810853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:17.781244 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:17.781201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:23.439567 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:23.439532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:23.502442 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:23.502414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:23.624922 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:23.624891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:23.727083 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:23.726995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:24.182652 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:24.182617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:50.203405 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:50.203366    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:55.895677 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:55.895647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:56.003338 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:56.003303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:47:56.128428 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:47:56.128398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:12.072583 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:12.072548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:17.731874 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:17.731820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:17.800225 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:17.800189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:17.888630 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:17.888599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:17.951433 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:17.951407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:28.605248 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:28.605202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:29.498548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:29.498515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:33.368828 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:33.368791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:33.469722 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:33.469692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:35.158911 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:35.158876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:35.261479 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:35.261444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:35.356926 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:35.356893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:35.458091 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:35.458005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:36.329468 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:36.329435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:36.423365 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:36.423332    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:36.524006 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:36.523978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:38.264169 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:38.264134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:44.018784 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:44.018745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:44.119508 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:44.119467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:44.763511 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:44.763481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:50.524833 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:50.524799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:50.605169 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:50.605135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:50.791882 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:50.791854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:51.112807 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:51.112721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:51.379476 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:51.379385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:54.242279 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.242232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:54.340083 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.340044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:54.448386 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.448360    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"]
Jul 08 17:48:54.448763 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.448750    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325de354-a004-42fc-9df3-0ee737dd5fcf" containerName="maas-api"
Jul 08 17:48:54.448814 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.448766    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="325de354-a004-42fc-9df3-0ee737dd5fcf" containerName="maas-api"
Jul 08 17:48:54.448852 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.448818    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="325de354-a004-42fc-9df3-0ee737dd5fcf" containerName="maas-api"
Jul 08 17:48:54.451844 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.451829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.454156 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.454138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1028bef5-serving-cert\""
Jul 08 17:48:54.466436 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.466411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"]
Jul 08 17:48:54.481681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.481628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:54.569199 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.569175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nnl6\" (UniqueName: \"kubernetes.io/projected/a56fb6b3-790c-438e-aae6-5308609e7f78-kube-api-access-6nnl6\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.569329 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.569212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a56fb6b3-790c-438e-aae6-5308609e7f78-openshift-service-ca\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.569329 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.569243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.670674 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.670652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nnl6\" (UniqueName: \"kubernetes.io/projected/a56fb6b3-790c-438e-aae6-5308609e7f78-kube-api-access-6nnl6\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.670785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.670690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a56fb6b3-790c-438e-aae6-5308609e7f78-openshift-service-ca\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.670785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.670719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.670899 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:48:54.670826    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-serving-cert: secret "maas-api-e2e-mt-1028bef5-serving-cert" not found
Jul 08 17:48:54.670899 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:48:54.670879    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls podName:a56fb6b3-790c-438e-aae6-5308609e7f78 nodeName:}" failed. No retries permitted until 2026-07-08 17:48:55.170862008 +0000 UTC m=+1970.093453345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls") pod "maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg" (UID: "a56fb6b3-790c-438e-aae6-5308609e7f78") : secret "maas-api-e2e-mt-1028bef5-serving-cert" not found
Jul 08 17:48:54.671344 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.671327    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a56fb6b3-790c-438e-aae6-5308609e7f78-openshift-service-ca\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.685671 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.685648    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nnl6\" (UniqueName: \"kubernetes.io/projected/a56fb6b3-790c-438e-aae6-5308609e7f78-kube-api-access-6nnl6\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:54.869422 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.869358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:54.998336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:54.998308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:55.102086 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:55.102038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:55.176312 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:55.176211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:55.178786 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:55.178765    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls\") pod \"maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:55.361582 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:55.361559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:55.494549 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:55.491121    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"]
Jul 08 17:48:55.497859 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:48:55.497833    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56fb6b3_790c_438e_aae6_5308609e7f78.slice/crio-b298c11a03d6f35623842537ab0c9b5631b6b78bc5eefa5d62ab221562e8ee2b WatchSource:0}: Error finding container b298c11a03d6f35623842537ab0c9b5631b6b78bc5eefa5d62ab221562e8ee2b: Status 404 returned error can't find the container with id b298c11a03d6f35623842537ab0c9b5631b6b78bc5eefa5d62ab221562e8ee2b
Jul 08 17:48:55.635332 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:55.635303    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg" event={"ID":"a56fb6b3-790c-438e-aae6-5308609e7f78","Type":"ContainerStarted","Data":"b298c11a03d6f35623842537ab0c9b5631b6b78bc5eefa5d62ab221562e8ee2b"}
Jul 08 17:48:56.641586 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:56.641509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg" event={"ID":"a56fb6b3-790c-438e-aae6-5308609e7f78","Type":"ContainerStarted","Data":"522eb99e5d66054268167fac4c7c472e85b338b805b608bcd3aa965116f188dc"}
Jul 08 17:48:56.641905 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:56.641647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:48:56.659031 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:56.658990    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg" podStartSLOduration=2.053235001 podStartE2EDuration="2.658976539s" totalImagesPullingTime="605.741538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:48:56.657876763 +0000 UTC m=+1971.580468118" watchObservedRunningTime="2026-07-08 17:48:56.658976539 +0000 UTC m=+1971.581567949"
Jul 08 17:48:58.776370 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:58.776338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:59.474580 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:59.474543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:59.535772 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:59.535740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:48:59.956555 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:48:59.956525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:02.650627 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:02.650594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:49:05.775320 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:05.775260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:05.854548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:05.854518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:06.206337 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.206304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:06.534790 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.534762    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"]
Jul 08 17:49:06.535003 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.534971    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg" podUID="a56fb6b3-790c-438e-aae6-5308609e7f78" containerName="maas-api" containerID="cri-o://522eb99e5d66054268167fac4c7c472e85b338b805b608bcd3aa965116f188dc" gracePeriod=30
Jul 08 17:49:06.562024 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.561999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:06.662725 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.662691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:06.684616 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.684585    2578 generic.go:356] "Generic (PLEG): container finished" podID="a56fb6b3-790c-438e-aae6-5308609e7f78" containerID="522eb99e5d66054268167fac4c7c472e85b338b805b608bcd3aa965116f188dc" exitCode=0
Jul 08 17:49:06.684738 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.684649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg" event={"ID":"a56fb6b3-790c-438e-aae6-5308609e7f78","Type":"ContainerDied","Data":"522eb99e5d66054268167fac4c7c472e85b338b805b608bcd3aa965116f188dc"}
Jul 08 17:49:06.780373 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.780352    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:49:06.863107 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.863050    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a56fb6b3-790c-438e-aae6-5308609e7f78-openshift-service-ca\") pod \"a56fb6b3-790c-438e-aae6-5308609e7f78\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") "
Jul 08 17:49:06.863209 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.863120    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nnl6\" (UniqueName: \"kubernetes.io/projected/a56fb6b3-790c-438e-aae6-5308609e7f78-kube-api-access-6nnl6\") pod \"a56fb6b3-790c-438e-aae6-5308609e7f78\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") "
Jul 08 17:49:06.863209 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.863170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls\") pod \"a56fb6b3-790c-438e-aae6-5308609e7f78\" (UID: \"a56fb6b3-790c-438e-aae6-5308609e7f78\") "
Jul 08 17:49:06.863449 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.863428    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a56fb6b3-790c-438e-aae6-5308609e7f78-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a56fb6b3-790c-438e-aae6-5308609e7f78" (UID: "a56fb6b3-790c-438e-aae6-5308609e7f78"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:49:06.865179 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.865150    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a56fb6b3-790c-438e-aae6-5308609e7f78" (UID: "a56fb6b3-790c-438e-aae6-5308609e7f78"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:49:06.865311 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.865198    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a56fb6b3-790c-438e-aae6-5308609e7f78-kube-api-access-6nnl6" (OuterVolumeSpecName: "kube-api-access-6nnl6") pod "a56fb6b3-790c-438e-aae6-5308609e7f78" (UID: "a56fb6b3-790c-438e-aae6-5308609e7f78"). InnerVolumeSpecName "kube-api-access-6nnl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:49:06.964300 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.964260    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nnl6\" (UniqueName: \"kubernetes.io/projected/a56fb6b3-790c-438e-aae6-5308609e7f78-kube-api-access-6nnl6\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:49:06.964300 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.964300    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a56fb6b3-790c-438e-aae6-5308609e7f78-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:49:06.964428 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:06.964309    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a56fb6b3-790c-438e-aae6-5308609e7f78-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:49:07.689632 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:07.689604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg" event={"ID":"a56fb6b3-790c-438e-aae6-5308609e7f78","Type":"ContainerDied","Data":"b298c11a03d6f35623842537ab0c9b5631b6b78bc5eefa5d62ab221562e8ee2b"}
Jul 08 17:49:07.689632 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:07.689620    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"
Jul 08 17:49:07.689861 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:07.689658    2578 scope.go:117] "RemoveContainer" containerID="522eb99e5d66054268167fac4c7c472e85b338b805b608bcd3aa965116f188dc"
Jul 08 17:49:07.707082 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:07.707058    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"]
Jul 08 17:49:07.712075 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:07.712055    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1028bef5-547b9b899b-cg5mg"]
Jul 08 17:49:09.589879 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:09.589852    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a56fb6b3-790c-438e-aae6-5308609e7f78" path="/var/lib/kubelet/pods/a56fb6b3-790c-438e-aae6-5308609e7f78/volumes"
Jul 08 17:49:12.275844 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:12.275807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:12.378010 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:12.377979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:12.562760 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:12.562728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:12.940077 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:12.939968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:13.038708 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:13.038681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:13.169103 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:13.169079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:18.837874 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:18.837836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:18.906711 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:18.906679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:19.001587 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:19.001560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:19.094158 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:19.094086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:19.236513 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:19.236475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:25.078505 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:25.078469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:25.148385 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:25.148355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:32.043807 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:32.043766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:32.466642 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:32.466560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:32.566280 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:32.566241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:35.434429 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.434397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:35.500252 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.500223    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"]
Jul 08 17:49:35.500616 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.500603    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a56fb6b3-790c-438e-aae6-5308609e7f78" containerName="maas-api"
Jul 08 17:49:35.500659 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.500618    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56fb6b3-790c-438e-aae6-5308609e7f78" containerName="maas-api"
Jul 08 17:49:35.500692 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.500674    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a56fb6b3-790c-438e-aae6-5308609e7f78" containerName="maas-api"
Jul 08 17:49:35.504100 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.504081    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.506772 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.506753    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-525288bb-serving-cert\""
Jul 08 17:49:35.515899 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.515873    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"]
Jul 08 17:49:35.518313 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.518244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:35.586115 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.586096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.586223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.586163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k9d5\" (UniqueName: \"kubernetes.io/projected/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-kube-api-access-7k9d5\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.586223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.586210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-openshift-service-ca\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.591479 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.591456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:35.687352 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.687291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k9d5\" (UniqueName: \"kubernetes.io/projected/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-kube-api-access-7k9d5\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.687352 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.687341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-openshift-service-ca\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.687504 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.687370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.687504 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:49:35.687446    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-serving-cert: secret "maas-api-e2e-mt-525288bb-serving-cert" not found
Jul 08 17:49:35.687610 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:49:35.687514    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls podName:391b11ed-0c29-4a16-8d5e-1c17afe6cee5 nodeName:}" failed. No retries permitted until 2026-07-08 17:49:36.187495543 +0000 UTC m=+2011.110086880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls") pod "maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r" (UID: "391b11ed-0c29-4a16-8d5e-1c17afe6cee5") : secret "maas-api-e2e-mt-525288bb-serving-cert" not found
Jul 08 17:49:35.687962 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.687943    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-openshift-service-ca\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.702020 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.701994    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k9d5\" (UniqueName: \"kubernetes.io/projected/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-kube-api-access-7k9d5\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:35.976649 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:35.976580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:36.123870 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:36.123837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:36.191873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:36.191848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:36.194459 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:36.194439    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls\") pod \"maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:36.229957 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:36.229902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:36.415404 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:36.415374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:36.545779 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:36.545710    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"]
Jul 08 17:49:36.548041 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:49:36.548014    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391b11ed_0c29_4a16_8d5e_1c17afe6cee5.slice/crio-51bf43745251851d1ff36fa27d7da071fd03fad0ddb8190d83e8f4a0410d292e WatchSource:0}: Error finding container 51bf43745251851d1ff36fa27d7da071fd03fad0ddb8190d83e8f4a0410d292e: Status 404 returned error can't find the container with id 51bf43745251851d1ff36fa27d7da071fd03fad0ddb8190d83e8f4a0410d292e
Jul 08 17:49:36.816342 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:36.816312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r" event={"ID":"391b11ed-0c29-4a16-8d5e-1c17afe6cee5","Type":"ContainerStarted","Data":"51bf43745251851d1ff36fa27d7da071fd03fad0ddb8190d83e8f4a0410d292e"}
Jul 08 17:49:37.821991 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:37.821954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r" event={"ID":"391b11ed-0c29-4a16-8d5e-1c17afe6cee5","Type":"ContainerStarted","Data":"5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521"}
Jul 08 17:49:37.822392 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:37.822049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:37.841971 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:37.841915    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r" podStartSLOduration=2.415450442 podStartE2EDuration="2.841901986s" totalImagesPullingTime="426.451544ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:49:37.841375294 +0000 UTC m=+2012.763966654" watchObservedRunningTime="2026-07-08 17:49:37.841901986 +0000 UTC m=+2012.764493339"
Jul 08 17:49:39.978550 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:39.978512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:41.410545 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:41.410510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:41.511502 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:41.511470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:43.831025 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:43.830997    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:49:57.389835 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:57.389794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:57.693568 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:57.693444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:49:57.792211 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:49:57.792180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:50:10.077725 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:10.077689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:50:17.693801 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:17.693751    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:50:18.017347 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.017227    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"]
Jul 08 17:50:18.017512 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.017487    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r" podUID="391b11ed-0c29-4a16-8d5e-1c17afe6cee5" containerName="maas-api" containerID="cri-o://5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521" gracePeriod=30
Jul 08 17:50:18.047865 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.047832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:50:18.266894 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.266873    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:50:18.314691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.314668    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls\") pod \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") "
Jul 08 17:50:18.314822 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.314765    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k9d5\" (UniqueName: \"kubernetes.io/projected/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-kube-api-access-7k9d5\") pod \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") "
Jul 08 17:50:18.314822 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.314786    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-openshift-service-ca\") pod \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\" (UID: \"391b11ed-0c29-4a16-8d5e-1c17afe6cee5\") "
Jul 08 17:50:18.315187 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.315159    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "391b11ed-0c29-4a16-8d5e-1c17afe6cee5" (UID: "391b11ed-0c29-4a16-8d5e-1c17afe6cee5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:50:18.316677 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.316648    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "391b11ed-0c29-4a16-8d5e-1c17afe6cee5" (UID: "391b11ed-0c29-4a16-8d5e-1c17afe6cee5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:50:18.316879 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.316863    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-kube-api-access-7k9d5" (OuterVolumeSpecName: "kube-api-access-7k9d5") pod "391b11ed-0c29-4a16-8d5e-1c17afe6cee5" (UID: "391b11ed-0c29-4a16-8d5e-1c17afe6cee5"). InnerVolumeSpecName "kube-api-access-7k9d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:50:18.415872 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.415850    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:50:18.415872 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.415872    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:50:18.415991 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.415881    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k9d5\" (UniqueName: \"kubernetes.io/projected/391b11ed-0c29-4a16-8d5e-1c17afe6cee5-kube-api-access-7k9d5\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:50:18.997815 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.997780    2578 generic.go:356] "Generic (PLEG): container finished" podID="391b11ed-0c29-4a16-8d5e-1c17afe6cee5" containerID="5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521" exitCode=0
Jul 08 17:50:18.998182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.997826    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"
Jul 08 17:50:18.998182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.997866    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r" event={"ID":"391b11ed-0c29-4a16-8d5e-1c17afe6cee5","Type":"ContainerDied","Data":"5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521"}
Jul 08 17:50:18.998182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.997919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r" event={"ID":"391b11ed-0c29-4a16-8d5e-1c17afe6cee5","Type":"ContainerDied","Data":"51bf43745251851d1ff36fa27d7da071fd03fad0ddb8190d83e8f4a0410d292e"}
Jul 08 17:50:18.998182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:18.997943    2578 scope.go:117] "RemoveContainer" containerID="5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521"
Jul 08 17:50:19.006822 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:19.006806    2578 scope.go:117] "RemoveContainer" containerID="5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521"
Jul 08 17:50:19.007043 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:50:19.007027    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521\": container with ID starting with 5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521 not found: ID does not exist" containerID="5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521"
Jul 08 17:50:19.007095 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:19.007048    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521"} err="failed to get container status \"5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521\": rpc error: code = NotFound desc = could not find container \"5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521\": container with ID starting with 5377aff77acce39bd738dcd3ee9a3fc8399cf40c5d6e1a6e9ecebf7c5f162521 not found: ID does not exist"
Jul 08 17:50:19.018404 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:19.018373    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"]
Jul 08 17:50:19.024788 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:19.024769    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-525288bb-65cdb68cd9-ww74r"]
Jul 08 17:50:19.590461 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:19.590429    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="391b11ed-0c29-4a16-8d5e-1c17afe6cee5" path="/var/lib/kubelet/pods/391b11ed-0c29-4a16-8d5e-1c17afe6cee5/volumes"
Jul 08 17:50:23.868188 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:23.868138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:50:28.949444 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:28.949415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:50:29.439761 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:50:29.439722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:04.995874 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:04.995837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:06.678189 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:06.678152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:11.232974 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:11.232935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:11.307681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:11.307653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:11.538084 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:11.538054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:13.699908 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:13.699876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:13.800177 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:13.800148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:13.931969 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:13.931940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:14.058166 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:14.058132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:14.154011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:14.153980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:15.649680 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:15.649644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:21.333336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:21.333299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:21.432167 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:21.432131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:22.063847 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:22.063813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:27.755216 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:27.755185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:27.856522 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:27.856490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:27.959865 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:27.959835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:38.459529 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:38.459494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:38.841127 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:38.841083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:51:59.842852 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:51:59.842777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:05.619463 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:05.619419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:05.713485 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:05.713451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:06.025006 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:06.024939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:06.353168 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:06.353128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:06.453934 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:06.453903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:09.280536 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.280498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:09.383287 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.383246    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:09.434887 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.434850    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"]
Jul 08 17:52:09.435223 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.435210    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391b11ed-0c29-4a16-8d5e-1c17afe6cee5" containerName="maas-api"
Jul 08 17:52:09.435282 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.435225    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="391b11ed-0c29-4a16-8d5e-1c17afe6cee5" containerName="maas-api"
Jul 08 17:52:09.435320 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.435310    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="391b11ed-0c29-4a16-8d5e-1c17afe6cee5" containerName="maas-api"
Jul 08 17:52:09.438318 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.438302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.440735 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.440708    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a1ffe7-serving-cert\""
Jul 08 17:52:09.449007 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.448984    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"]
Jul 08 17:52:09.479231 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.479204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:09.528896 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.528862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84ffg\" (UniqueName: \"kubernetes.io/projected/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-kube-api-access-84ffg\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.529089 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.528908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.529089 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.528943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.629425 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.629369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84ffg\" (UniqueName: \"kubernetes.io/projected/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-kube-api-access-84ffg\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.629425 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.629405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.629554 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.629437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.629554 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:52:09.629526    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-serving-cert: secret "maas-api-e2e-inf-a-a1ffe7-serving-cert" not found
Jul 08 17:52:09.629616 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:52:09.629592    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls podName:f5f160c8-ff6c-4f55-9807-4c12cd96f7d9 nodeName:}" failed. No retries permitted until 2026-07-08 17:52:10.129576771 +0000 UTC m=+2165.052168103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls") pod "maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2" (UID: "f5f160c8-ff6c-4f55-9807-4c12cd96f7d9") : secret "maas-api-e2e-inf-a-a1ffe7-serving-cert" not found
Jul 08 17:52:09.630016 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.629999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.638155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.638129    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84ffg\" (UniqueName: \"kubernetes.io/projected/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-kube-api-access-84ffg\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:09.825438 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.825402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:09.927551 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:09.927487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:10.133868 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:10.133833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:10.136239 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:10.136213    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls\") pod \"maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:10.348697 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:10.348674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:10.476137 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:10.476115    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"]
Jul 08 17:52:10.478910 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:52:10.478870    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f160c8_ff6c_4f55_9807_4c12cd96f7d9.slice/crio-17bfc285d1f00b3c8262a3e5447342e0d2aeb8300f845e59aa9a5e0548bc8316 WatchSource:0}: Error finding container 17bfc285d1f00b3c8262a3e5447342e0d2aeb8300f845e59aa9a5e0548bc8316: Status 404 returned error can't find the container with id 17bfc285d1f00b3c8262a3e5447342e0d2aeb8300f845e59aa9a5e0548bc8316
Jul 08 17:52:10.480143 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:10.480123    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:52:10.550375 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:10.550350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:11.473380 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:11.473292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2" event={"ID":"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9","Type":"ContainerStarted","Data":"f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407"}
Jul 08 17:52:11.473380 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:11.473352    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:11.473380 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:11.473369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2" event={"ID":"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9","Type":"ContainerStarted","Data":"17bfc285d1f00b3c8262a3e5447342e0d2aeb8300f845e59aa9a5e0548bc8316"}
Jul 08 17:52:11.489862 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:11.489595    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2" podStartSLOduration=1.914933558 podStartE2EDuration="2.489578394s" totalImagesPullingTime="574.644836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:52:11.489472943 +0000 UTC m=+2166.412064296" watchObservedRunningTime="2026-07-08 17:52:11.489578394 +0000 UTC m=+2166.412169755"
Jul 08 17:52:13.835383 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:13.835339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:14.193744 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:14.193662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:15.006232 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:15.006197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:15.105952 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:15.105925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:17.333182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.333147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:17.394610 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.394579    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"]
Jul 08 17:52:17.398345 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.398320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.402487 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.402467    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-446c79-serving-cert\""
Jul 08 17:52:17.410538 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.410510    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"]
Jul 08 17:52:17.426863 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.426828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:17.482567 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.482545    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:52:17.487120 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.487099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkv8v\" (UniqueName: \"kubernetes.io/projected/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-kube-api-access-gkv8v\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.487206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.487168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.487206 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.487192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.503739 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.503709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:17.587714 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.587637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.587714 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.587666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.587945 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.587757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkv8v\" (UniqueName: \"kubernetes.io/projected/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-kube-api-access-gkv8v\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.588452 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.588428    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.590163 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.590140    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-maas-api-tls\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.601132 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.601113    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkv8v\" (UniqueName: \"kubernetes.io/projected/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-kube-api-access-gkv8v\") pod \"maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.709300 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.709251    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:17.855451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.855427    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"]
Jul 08 17:52:17.858096 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:52:17.858065    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4f703d_a7ae_4724_a3a4_fb0d6091e7fb.slice/crio-b641f574a85a4dc4d8b2a1e9af69484558f7b5e250fb665f0c3349319bd88a89 WatchSource:0}: Error finding container b641f574a85a4dc4d8b2a1e9af69484558f7b5e250fb665f0c3349319bd88a89: Status 404 returned error can't find the container with id b641f574a85a4dc4d8b2a1e9af69484558f7b5e250fb665f0c3349319bd88a89
Jul 08 17:52:17.989937 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:17.989901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:18.086974 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:18.086951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:18.505481 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:18.505409    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq" event={"ID":"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb","Type":"ContainerStarted","Data":"b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca"}
Jul 08 17:52:18.505481 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:18.505453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq" event={"ID":"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb","Type":"ContainerStarted","Data":"b641f574a85a4dc4d8b2a1e9af69484558f7b5e250fb665f0c3349319bd88a89"}
Jul 08 17:52:18.505871 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:18.505532    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:18.525003 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:18.524961    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq" podStartSLOduration=1.132338006 podStartE2EDuration="1.524945878s" totalImagesPullingTime="392.607872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:52:18.524193199 +0000 UTC m=+2173.446784554" watchObservedRunningTime="2026-07-08 17:52:18.524945878 +0000 UTC m=+2173.447537229"
Jul 08 17:52:21.856892 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:21.856854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:24.514586 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:24.514562    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:52:27.090944 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:27.090902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:31.427781 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:31.427731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:31.529154 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:31.529125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:38.664739 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:38.664706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:38.766835 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:38.766807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:52:59.460466 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:52:59.460425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:20.921675 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:20.921640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:22.057041 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:22.056996    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:22.232451 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:22.232406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:22.688832 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:22.688801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:22.993072 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:22.992998    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:23.111453 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.111421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:23.209375 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.209348    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"]
Jul 08 17:53:23.209584 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.209539    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2" podUID="f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" containerName="maas-api" containerID="cri-o://f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407" gracePeriod=30
Jul 08 17:53:23.272383 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.272315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:23.451676 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.451656    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:53:23.486336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.486315    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-openshift-service-ca\") pod \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") "
Jul 08 17:53:23.486440 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.486405    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls\") pod \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") "
Jul 08 17:53:23.486490 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.486450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84ffg\" (UniqueName: \"kubernetes.io/projected/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-kube-api-access-84ffg\") pod \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\" (UID: \"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9\") "
Jul 08 17:53:23.486678 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.486648    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" (UID: "f5f160c8-ff6c-4f55-9807-4c12cd96f7d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:53:23.488640 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.488615    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-kube-api-access-84ffg" (OuterVolumeSpecName: "kube-api-access-84ffg") pod "f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" (UID: "f5f160c8-ff6c-4f55-9807-4c12cd96f7d9"). InnerVolumeSpecName "kube-api-access-84ffg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:53:23.488736 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.488661    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" (UID: "f5f160c8-ff6c-4f55-9807-4c12cd96f7d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:53:23.587166 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.587142    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:53:23.587249 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.587169    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84ffg\" (UniqueName: \"kubernetes.io/projected/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-kube-api-access-84ffg\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:53:23.587249 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.587186    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:53:23.788020 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.787990    2578 generic.go:356] "Generic (PLEG): container finished" podID="f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" containerID="f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407" exitCode=0
Jul 08 17:53:23.788134 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.788039    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"
Jul 08 17:53:23.788134 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.788067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2" event={"ID":"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9","Type":"ContainerDied","Data":"f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407"}
Jul 08 17:53:23.788134 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.788115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2" event={"ID":"f5f160c8-ff6c-4f55-9807-4c12cd96f7d9","Type":"ContainerDied","Data":"17bfc285d1f00b3c8262a3e5447342e0d2aeb8300f845e59aa9a5e0548bc8316"}
Jul 08 17:53:23.788237 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.788144    2578 scope.go:117] "RemoveContainer" containerID="f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407"
Jul 08 17:53:23.795859 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.795843    2578 scope.go:117] "RemoveContainer" containerID="f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407"
Jul 08 17:53:23.796089 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:53:23.796070    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407\": container with ID starting with f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407 not found: ID does not exist" containerID="f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407"
Jul 08 17:53:23.796142 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.796099    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407"} err="failed to get container status \"f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407\": rpc error: code = NotFound desc = could not find container \"f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407\": container with ID starting with f11204e1d7c2fcc73a565cfa3abe2c49cc794e0f80680d34b41f3aa606ff4407 not found: ID does not exist"
Jul 08 17:53:23.806517 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.806490    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"]
Jul 08 17:53:23.810854 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:23.810836    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1ffe7-5dddd89ccc-rslt2"]
Jul 08 17:53:25.590448 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:25.590410    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" path="/var/lib/kubelet/pods/f5f160c8-ff6c-4f55-9807-4c12cd96f7d9/volumes"
Jul 08 17:53:27.052976 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:27.052888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:53:27.719646 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:53:27.719614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:04.880192 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:04.880162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:05.225380 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:05.225301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:05.657281 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:05.657241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:06.143176 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.143133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:06.242152 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.242120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:06.340566 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.340535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:06.417998 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.417934    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"]
Jul 08 17:54:06.418204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.418174    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq" podUID="9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" containerName="maas-api" containerID="cri-o://b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca" gracePeriod=30
Jul 08 17:54:06.460098 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.460074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:06.666880 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.666861    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:54:06.798141 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.798111    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-maas-api-tls\") pod \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") "
Jul 08 17:54:06.798309 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.798153    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkv8v\" (UniqueName: \"kubernetes.io/projected/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-kube-api-access-gkv8v\") pod \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") "
Jul 08 17:54:06.798309 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.798209    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-openshift-service-ca\") pod \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\" (UID: \"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb\") "
Jul 08 17:54:06.798609 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.798586    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" (UID: "9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:54:06.800041 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.800018    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" (UID: "9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:54:06.800153 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.800131    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-kube-api-access-gkv8v" (OuterVolumeSpecName: "kube-api-access-gkv8v") pod "9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" (UID: "9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb"). InnerVolumeSpecName "kube-api-access-gkv8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:54:06.898857 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.898837    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:06.898857 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.898856    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkv8v\" (UniqueName: \"kubernetes.io/projected/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-kube-api-access-gkv8v\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:06.898978 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.898866    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:06.973322 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.973295    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" containerID="b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca" exitCode=0
Jul 08 17:54:06.973407 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.973391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq" event={"ID":"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb","Type":"ContainerDied","Data":"b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca"}
Jul 08 17:54:06.973449 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.973411    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"
Jul 08 17:54:06.973482 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.973473    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq" event={"ID":"9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb","Type":"ContainerDied","Data":"b641f574a85a4dc4d8b2a1e9af69484558f7b5e250fb665f0c3349319bd88a89"}
Jul 08 17:54:06.973511 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.973501    2578 scope.go:117] "RemoveContainer" containerID="b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca"
Jul 08 17:54:06.982247 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.982233    2578 scope.go:117] "RemoveContainer" containerID="b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca"
Jul 08 17:54:06.982529 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:54:06.982512    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca\": container with ID starting with b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca not found: ID does not exist" containerID="b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca"
Jul 08 17:54:06.982583 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:06.982538    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca"} err="failed to get container status \"b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca\": rpc error: code = NotFound desc = could not find container \"b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca\": container with ID starting with b45c692b0a72b6226c5c0d84887e54155b1408d10b30d024322bf63d8ea132ca not found: ID does not exist"
Jul 08 17:54:07.000573 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:07.000552    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"]
Jul 08 17:54:07.016655 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:07.016632    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-446c79-7cdd7755f5-9gjmq"]
Jul 08 17:54:07.590473 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:07.590449    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" path="/var/lib/kubelet/pods/9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb/volumes"
Jul 08 17:54:12.062854 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:12.062819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:12.165631 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:12.165598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:12.386944 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:12.386866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:13.008074 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:13.008035    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:13.340636 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:13.340606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:13.658683 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:13.658611    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:16.010518 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.010486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:16.086248 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.086222    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"]
Jul 08 17:54:16.086588 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.086571    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" containerName="maas-api"
Jul 08 17:54:16.086588 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.086586    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" containerName="maas-api"
Jul 08 17:54:16.086748 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.086600    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" containerName="maas-api"
Jul 08 17:54:16.086748 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.086606    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" containerName="maas-api"
Jul 08 17:54:16.086748 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.086674    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c4f703d-a7ae-4724-a3a4-fb0d6091e7fb" containerName="maas-api"
Jul 08 17:54:16.086748 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.086686    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5f160c8-ff6c-4f55-9807-4c12cd96f7d9" containerName="maas-api"
Jul 08 17:54:16.089705 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.089685    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.099100 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.099083    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7e76ff-serving-cert\""
Jul 08 17:54:16.118739 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.118708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:16.186294 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.186257    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"]
Jul 08 17:54:16.272511 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.272445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-openshift-service-ca\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.272511 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.272480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xj42\" (UniqueName: \"kubernetes.io/projected/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-kube-api-access-2xj42\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.272658 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.272512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-maas-api-tls\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.332898 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.332869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:16.373442 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.373418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-openshift-service-ca\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.373529 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.373451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xj42\" (UniqueName: \"kubernetes.io/projected/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-kube-api-access-2xj42\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.373529 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.373487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-maas-api-tls\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.374007 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.373988    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-openshift-service-ca\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.375853 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.375834    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-maas-api-tls\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.381335 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.381311    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xj42\" (UniqueName: \"kubernetes.io/projected/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-kube-api-access-2xj42\") pod \"maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.399143 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.399121    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:16.416905 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.416879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:16.533306 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.533259    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"]
Jul 08 17:54:16.536345 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:54:16.536316    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a25bdfb_743f_46a8_8d2b_f9ae776a3f1f.slice/crio-72d7d29c5afe348501c9306c6c2ab548a3ebe3504a3bf9dfa582d2aab717534d WatchSource:0}: Error finding container 72d7d29c5afe348501c9306c6c2ab548a3ebe3504a3bf9dfa582d2aab717534d: Status 404 returned error can't find the container with id 72d7d29c5afe348501c9306c6c2ab548a3ebe3504a3bf9dfa582d2aab717534d
Jul 08 17:54:16.718834 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.718805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:16.822659 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:16.822592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:17.018187 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:17.018157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv" event={"ID":"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f","Type":"ContainerStarted","Data":"72d7d29c5afe348501c9306c6c2ab548a3ebe3504a3bf9dfa582d2aab717534d"}
Jul 08 17:54:18.024635 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:18.024604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv" event={"ID":"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f","Type":"ContainerStarted","Data":"9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32"}
Jul 08 17:54:18.025011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:18.024756    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:18.046656 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:18.046617    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv" podStartSLOduration=1.571580269 podStartE2EDuration="2.046605548s" totalImagesPullingTime="475.025279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:18.045149461 +0000 UTC m=+2292.967740817" watchObservedRunningTime="2026-07-08 17:54:18.046605548 +0000 UTC m=+2292.969196902"
Jul 08 17:54:20.601414 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:20.601384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:21.092653 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:21.092617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:21.437318 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:21.437229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:21.965035 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:21.965001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:24.033215 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.033187    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:24.118321 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.118227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:24.226334 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.226302    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"]
Jul 08 17:54:24.229657 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.229641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.232909 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.232885    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e3904d-serving-cert\""
Jul 08 17:54:24.252329 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.252306    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"]
Jul 08 17:54:24.309333 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.309243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:24.332372 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.332348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841ac851-ac4b-45ea-862a-64d6d1f1e255-openshift-service-ca\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.332477 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.332394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz872\" (UniqueName: \"kubernetes.io/projected/841ac851-ac4b-45ea-862a-64d6d1f1e255-kube-api-access-gz872\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.332550 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.332528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.411714 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.411684    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:24.433834 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.433804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841ac851-ac4b-45ea-862a-64d6d1f1e255-openshift-service-ca\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.433921 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.433845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz872\" (UniqueName: \"kubernetes.io/projected/841ac851-ac4b-45ea-862a-64d6d1f1e255-kube-api-access-gz872\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.434050 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.434029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.434176 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:54:24.434162    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-serving-cert: secret "maas-api-e2e-api-b-e3904d-serving-cert" not found
Jul 08 17:54:24.434244 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:54:24.434233    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls podName:841ac851-ac4b-45ea-862a-64d6d1f1e255 nodeName:}" failed. No retries permitted until 2026-07-08 17:54:24.934211607 +0000 UTC m=+2299.856802955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls") pod "maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j" (UID: "841ac851-ac4b-45ea-862a-64d6d1f1e255") : secret "maas-api-e2e-api-b-e3904d-serving-cert" not found
Jul 08 17:54:24.434551 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.434533    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841ac851-ac4b-45ea-862a-64d6d1f1e255-openshift-service-ca\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.443768 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.443750    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz872\" (UniqueName: \"kubernetes.io/projected/841ac851-ac4b-45ea-862a-64d6d1f1e255-kube-api-access-gz872\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.654076 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.654007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:24.822744 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.822715    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:24.923773 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.923707    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:24.937929 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.937904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:24.940352 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:24.940334    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls\") pod \"maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:25.139549 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:25.139521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:25.269215 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:25.269192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"]
Jul 08 17:54:25.271173 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:54:25.271143    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841ac851_ac4b_45ea_862a_64d6d1f1e255.slice/crio-68a1d513aa1c1edb5e4fd097449322db5dd5bda9bdfada2f859baf78a664aa68 WatchSource:0}: Error finding container 68a1d513aa1c1edb5e4fd097449322db5dd5bda9bdfada2f859baf78a664aa68: Status 404 returned error can't find the container with id 68a1d513aa1c1edb5e4fd097449322db5dd5bda9bdfada2f859baf78a664aa68
Jul 08 17:54:26.061449 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:26.061419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j" event={"ID":"841ac851-ac4b-45ea-862a-64d6d1f1e255","Type":"ContainerStarted","Data":"d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127"}
Jul 08 17:54:26.061615 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:26.061476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j" event={"ID":"841ac851-ac4b-45ea-862a-64d6d1f1e255","Type":"ContainerStarted","Data":"68a1d513aa1c1edb5e4fd097449322db5dd5bda9bdfada2f859baf78a664aa68"}
Jul 08 17:54:26.061615 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:26.061503    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:26.080168 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:26.080124    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j" podStartSLOduration=1.607527817 podStartE2EDuration="2.080110504s" totalImagesPullingTime="472.582687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:26.078994645 +0000 UTC m=+2301.001586003" watchObservedRunningTime="2026-07-08 17:54:26.080110504 +0000 UTC m=+2301.002701858"
Jul 08 17:54:28.580989 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:28.580960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:32.071651 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:32.071624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:37.011509 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:37.011477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:37.430915 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:37.430870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:37.531220 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:37.531192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:37.662036 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:37.662011    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"]
Jul 08 17:54:37.662197 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:37.662178    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv" podUID="5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" containerName="maas-api" containerID="cri-o://9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32" gracePeriod=30
Jul 08 17:54:37.711594 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:37.711520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:37.904873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:37.904845    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:38.039752 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.039729    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xj42\" (UniqueName: \"kubernetes.io/projected/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-kube-api-access-2xj42\") pod \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") "
Jul 08 17:54:38.040120 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.039771    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-maas-api-tls\") pod \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") "
Jul 08 17:54:38.040120 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.039814    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-openshift-service-ca\") pod \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\" (UID: \"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f\") "
Jul 08 17:54:38.040227 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.040212    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" (UID: "5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:54:38.041784 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.041759    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-kube-api-access-2xj42" (OuterVolumeSpecName: "kube-api-access-2xj42") pod "5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" (UID: "5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f"). InnerVolumeSpecName "kube-api-access-2xj42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:54:38.041865 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.041828    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" (UID: "5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:54:38.116495 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.116464    2578 generic.go:356] "Generic (PLEG): container finished" podID="5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" containerID="9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32" exitCode=0
Jul 08 17:54:38.116593 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.116492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv" event={"ID":"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f","Type":"ContainerDied","Data":"9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32"}
Jul 08 17:54:38.116593 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.116513    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"
Jul 08 17:54:38.116593 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.116544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv" event={"ID":"5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f","Type":"ContainerDied","Data":"72d7d29c5afe348501c9306c6c2ab548a3ebe3504a3bf9dfa582d2aab717534d"}
Jul 08 17:54:38.116593 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.116565    2578 scope.go:117] "RemoveContainer" containerID="9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32"
Jul 08 17:54:38.126934 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.126910    2578 scope.go:117] "RemoveContainer" containerID="9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32"
Jul 08 17:54:38.127399 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:54:38.127376    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32\": container with ID starting with 9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32 not found: ID does not exist" containerID="9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32"
Jul 08 17:54:38.127467 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.127410    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32"} err="failed to get container status \"9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32\": rpc error: code = NotFound desc = could not find container \"9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32\": container with ID starting with 9a5b5b260cf1aadf8e6ea91e70cec4684df06052235bcf1ade567deaaecbef32 not found: ID does not exist"
Jul 08 17:54:38.137188 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.137170    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"]
Jul 08 17:54:38.140614 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.140593    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e76ff-786fc8c9f-bhxsv"]
Jul 08 17:54:38.140884 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.140867    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xj42\" (UniqueName: \"kubernetes.io/projected/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-kube-api-access-2xj42\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:38.140939 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.140889    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:38.140939 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:38.140898    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:39.589691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:39.589658    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" path="/var/lib/kubelet/pods/5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f/volumes"
Jul 08 17:54:42.310210 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:42.310179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:42.414826 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:42.414790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:43.303330 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:43.303298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:43.403871 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:43.403847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:43.650942 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:43.650853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:44.061637 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:44.061605    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:44.462931 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:44.462856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:44.563675 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:44.563646    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:44.663420 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:44.663395    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:44.725665 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:44.725583    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"]
Jul 08 17:54:44.725823 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:44.725794    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j" podUID="841ac851-ac4b-45ea-862a-64d6d1f1e255" containerName="maas-api" containerID="cri-o://d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127" gracePeriod=30
Jul 08 17:54:44.761548 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:44.761524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:44.977149 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:44.977094    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:45.100390 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.100362    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz872\" (UniqueName: \"kubernetes.io/projected/841ac851-ac4b-45ea-862a-64d6d1f1e255-kube-api-access-gz872\") pod \"841ac851-ac4b-45ea-862a-64d6d1f1e255\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") "
Jul 08 17:54:45.100558 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.100465    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841ac851-ac4b-45ea-862a-64d6d1f1e255-openshift-service-ca\") pod \"841ac851-ac4b-45ea-862a-64d6d1f1e255\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") "
Jul 08 17:54:45.100558 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.100503    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls\") pod \"841ac851-ac4b-45ea-862a-64d6d1f1e255\" (UID: \"841ac851-ac4b-45ea-862a-64d6d1f1e255\") "
Jul 08 17:54:45.100828 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.100801    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841ac851-ac4b-45ea-862a-64d6d1f1e255-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "841ac851-ac4b-45ea-862a-64d6d1f1e255" (UID: "841ac851-ac4b-45ea-862a-64d6d1f1e255"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:54:45.102581 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.102560    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "841ac851-ac4b-45ea-862a-64d6d1f1e255" (UID: "841ac851-ac4b-45ea-862a-64d6d1f1e255"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:54:45.102691 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.102674    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841ac851-ac4b-45ea-862a-64d6d1f1e255-kube-api-access-gz872" (OuterVolumeSpecName: "kube-api-access-gz872") pod "841ac851-ac4b-45ea-862a-64d6d1f1e255" (UID: "841ac851-ac4b-45ea-862a-64d6d1f1e255"). InnerVolumeSpecName "kube-api-access-gz872". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:54:45.149787 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.149759    2578 generic.go:356] "Generic (PLEG): container finished" podID="841ac851-ac4b-45ea-862a-64d6d1f1e255" containerID="d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127" exitCode=0
Jul 08 17:54:45.149913 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.149798    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"
Jul 08 17:54:45.149913 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.149804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j" event={"ID":"841ac851-ac4b-45ea-862a-64d6d1f1e255","Type":"ContainerDied","Data":"d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127"}
Jul 08 17:54:45.149913 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.149857    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j" event={"ID":"841ac851-ac4b-45ea-862a-64d6d1f1e255","Type":"ContainerDied","Data":"68a1d513aa1c1edb5e4fd097449322db5dd5bda9bdfada2f859baf78a664aa68"}
Jul 08 17:54:45.149913 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.149886    2578 scope.go:117] "RemoveContainer" containerID="d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127"
Jul 08 17:54:45.158836 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.158822    2578 scope.go:117] "RemoveContainer" containerID="d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127"
Jul 08 17:54:45.159122 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:54:45.159106    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127\": container with ID starting with d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127 not found: ID does not exist" containerID="d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127"
Jul 08 17:54:45.159165 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.159130    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127"} err="failed to get container status \"d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127\": rpc error: code = NotFound desc = could not find container \"d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127\": container with ID starting with d9a1b62f873e0d1528ea465afd96849253747fc6171d120527fcd0633ca67127 not found: ID does not exist"
Jul 08 17:54:45.175728 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.175704    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"]
Jul 08 17:54:45.182108 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.182090    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e3904d-7b9bdcc76b-zst2j"]
Jul 08 17:54:45.201528 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.201506    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841ac851-ac4b-45ea-862a-64d6d1f1e255-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:45.201528 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.201525    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841ac851-ac4b-45ea-862a-64d6d1f1e255-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:45.201648 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.201536    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz872\" (UniqueName: \"kubernetes.io/projected/841ac851-ac4b-45ea-862a-64d6d1f1e255-kube-api-access-gz872\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:54:45.591139 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:45.591109    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="841ac851-ac4b-45ea-862a-64d6d1f1e255" path="/var/lib/kubelet/pods/841ac851-ac4b-45ea-862a-64d6d1f1e255/volumes"
Jul 08 17:54:50.223370 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:50.223329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:50.323367 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:50.323319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:50.508852 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:50.508761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:51.096865 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:51.096839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:51.413923 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:51.413843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:51.583785 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:51.583747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:54.252350 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.252312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:54.399801 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.399765    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"]
Jul 08 17:54:54.400114 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.400102    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" containerName="maas-api"
Jul 08 17:54:54.400155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.400116    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" containerName="maas-api"
Jul 08 17:54:54.400155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.400140    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841ac851-ac4b-45ea-862a-64d6d1f1e255" containerName="maas-api"
Jul 08 17:54:54.400155 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.400146    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="841ac851-ac4b-45ea-862a-64d6d1f1e255" containerName="maas-api"
Jul 08 17:54:54.400247 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.400196    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="841ac851-ac4b-45ea-862a-64d6d1f1e255" containerName="maas-api"
Jul 08 17:54:54.400247 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.400203    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a25bdfb-743f-46a8-8d2b-f9ae776a3f1f" containerName="maas-api"
Jul 08 17:54:54.404230 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.404210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.407936 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.407919    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-67c226-serving-cert\""
Jul 08 17:54:54.414951 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.414910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:54.424741 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.424721    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"]
Jul 08 17:54:54.476915 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.476883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwd7j\" (UniqueName: \"kubernetes.io/projected/21933afa-f409-4278-84ae-9e1b02a40e50-kube-api-access-hwd7j\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.477023 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.476928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21933afa-f409-4278-84ae-9e1b02a40e50-openshift-service-ca\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.477023 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.476994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21933afa-f409-4278-84ae-9e1b02a40e50-maas-api-tls\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.530399 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.530372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:54.577903 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.577879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwd7j\" (UniqueName: \"kubernetes.io/projected/21933afa-f409-4278-84ae-9e1b02a40e50-kube-api-access-hwd7j\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.578020 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.577910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21933afa-f409-4278-84ae-9e1b02a40e50-openshift-service-ca\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.578020 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.577958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21933afa-f409-4278-84ae-9e1b02a40e50-maas-api-tls\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.578592 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.578573    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21933afa-f409-4278-84ae-9e1b02a40e50-openshift-service-ca\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.580534 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.580515    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21933afa-f409-4278-84ae-9e1b02a40e50-maas-api-tls\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.594723 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.594694    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwd7j\" (UniqueName: \"kubernetes.io/projected/21933afa-f409-4278-84ae-9e1b02a40e50-kube-api-access-hwd7j\") pod \"maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.649442 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.649415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:54.713256 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.713236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:54.850003 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.849836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"]
Jul 08 17:54:54.852768 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:54:54.852745    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21933afa_f409_4278_84ae_9e1b02a40e50.slice/crio-9a26fe118b88d3f21991036282a96743b001775b217fc8a17d084b6b5c3483dd WatchSource:0}: Error finding container 9a26fe118b88d3f21991036282a96743b001775b217fc8a17d084b6b5c3483dd: Status 404 returned error can't find the container with id 9a26fe118b88d3f21991036282a96743b001775b217fc8a17d084b6b5c3483dd
Jul 08 17:54:54.885419 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.885375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:54.983162 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:54.983140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:55.194546 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:55.194469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6" event={"ID":"21933afa-f409-4278-84ae-9e1b02a40e50","Type":"ContainerStarted","Data":"9a26fe118b88d3f21991036282a96743b001775b217fc8a17d084b6b5c3483dd"}
Jul 08 17:54:56.199441 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:56.199408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6" event={"ID":"21933afa-f409-4278-84ae-9e1b02a40e50","Type":"ContainerStarted","Data":"1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7"}
Jul 08 17:54:56.199808 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:56.199541    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:54:56.215681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:56.215631    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6" podStartSLOduration=1.8165679479999999 podStartE2EDuration="2.215613318s" totalImagesPullingTime="399.04537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:56.215334744 +0000 UTC m=+2331.137926099" watchObservedRunningTime="2026-07-08 17:54:56.215613318 +0000 UTC m=+2331.138204673"
Jul 08 17:54:58.771602 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:58.771522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:59.113735 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:59.113702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:59.448701 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:59.448596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:54:59.810713 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:54:59.810676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:02.210650 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.210619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:55:02.266479 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.266438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:02.330849 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.330822    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"]
Jul 08 17:55:02.334417 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.334397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.337192 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.337170    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-9fde78-serving-cert\""
Jul 08 17:55:02.346808 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.346782    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"]
Jul 08 17:55:02.373841 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.373804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:02.439873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.439844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.439994 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.439941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.439994 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.439969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz4bc\" (UniqueName: \"kubernetes.io/projected/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-kube-api-access-pz4bc\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.469627 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.469561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:02.541084 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.541057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.541204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.541110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.541204 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.541176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz4bc\" (UniqueName: \"kubernetes.io/projected/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-kube-api-access-pz4bc\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.541347 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:55:02.541209    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-serving-cert: secret "maas-api-e2e-shared-b-9fde78-serving-cert" not found
Jul 08 17:55:02.541347 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:55:02.541294    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls podName:ca6f5c18-000a-4c9a-9cfc-67f22fc6b132 nodeName:}" failed. No retries permitted until 2026-07-08 17:55:03.041248201 +0000 UTC m=+2337.963839549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls") pod "maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7" (UID: "ca6f5c18-000a-4c9a-9cfc-67f22fc6b132") : secret "maas-api-e2e-shared-b-9fde78-serving-cert" not found
Jul 08 17:55:02.541848 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.541827    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.553936 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.553909    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz4bc\" (UniqueName: \"kubernetes.io/projected/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-kube-api-access-pz4bc\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:02.706492 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:02.706466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:03.016976 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:03.016945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:03.044369 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:03.044349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:03.046797 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:03.046769    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls\") pod \"maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:03.225884 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:03.225847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:03.247293 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:03.247254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:03.383845 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:03.383820    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"]
Jul 08 17:55:03.386119 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:55:03.386083    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6f5c18_000a_4c9a_9cfc_67f22fc6b132.slice/crio-b414603936bbe05677cd4678d42cf8c4541c541c66abcccafc7cf2e3035059eb WatchSource:0}: Error finding container b414603936bbe05677cd4678d42cf8c4541c541c66abcccafc7cf2e3035059eb: Status 404 returned error can't find the container with id b414603936bbe05677cd4678d42cf8c4541c541c66abcccafc7cf2e3035059eb
Jul 08 17:55:04.235314 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:04.235225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7" event={"ID":"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132","Type":"ContainerStarted","Data":"d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28"}
Jul 08 17:55:04.235314 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:04.235301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7" event={"ID":"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132","Type":"ContainerStarted","Data":"b414603936bbe05677cd4678d42cf8c4541c541c66abcccafc7cf2e3035059eb"}
Jul 08 17:55:04.235709 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:04.235351    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:04.255887 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:04.255838    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7" podStartSLOduration=1.74710396 podStartE2EDuration="2.255819005s" totalImagesPullingTime="508.715045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:55:04.254514685 +0000 UTC m=+2339.177106035" watchObservedRunningTime="2026-07-08 17:55:04.255819005 +0000 UTC m=+2339.178410361"
Jul 08 17:55:06.772876 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:06.772826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:10.245364 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:10.245339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:55:15.836879 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:15.836816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:15.937986 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:15.937959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:24.935128 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:24.935091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:55:25.045499 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:55:25.045471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:56:26.729112 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:56:26.729021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:56:27.801189 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:56:27.801157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:56:58.287402 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:56:58.287343    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:56:58.388034 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:56:58.387991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:57:06.485220 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:57:06.485179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:07.560304 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:07.560253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:07.661519 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:07.661478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:12.151260 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:12.151217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:12.582645 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:12.582606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:12.681058 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:12.681023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:12.822198 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:12.822163    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"]
Jul 08 17:58:12.822503 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:12.822456    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6" podUID="21933afa-f409-4278-84ae-9e1b02a40e50" containerName="maas-api" containerID="cri-o://1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7" gracePeriod=30
Jul 08 17:58:12.997850 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:12.997818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:13.063589 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.063558    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:58:13.065984 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.065963    2578 generic.go:356] "Generic (PLEG): container finished" podID="21933afa-f409-4278-84ae-9e1b02a40e50" containerID="1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7" exitCode=0
Jul 08 17:58:13.066098 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.065997    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"
Jul 08 17:58:13.066098 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.066039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6" event={"ID":"21933afa-f409-4278-84ae-9e1b02a40e50","Type":"ContainerDied","Data":"1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7"}
Jul 08 17:58:13.066172 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.066097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6" event={"ID":"21933afa-f409-4278-84ae-9e1b02a40e50","Type":"ContainerDied","Data":"9a26fe118b88d3f21991036282a96743b001775b217fc8a17d084b6b5c3483dd"}
Jul 08 17:58:13.066172 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.066110    2578 scope.go:117] "RemoveContainer" containerID="1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7"
Jul 08 17:58:13.074119 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.074100    2578 scope.go:117] "RemoveContainer" containerID="1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7"
Jul 08 17:58:13.074394 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:58:13.074378    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7\": container with ID starting with 1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7 not found: ID does not exist" containerID="1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7"
Jul 08 17:58:13.074469 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.074403    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7"} err="failed to get container status \"1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7\": rpc error: code = NotFound desc = could not find container \"1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7\": container with ID starting with 1d56e07ea94d2dd7fc6318a08d45b7db673f59b81ec9608cf02ac6e9de0746d7 not found: ID does not exist"
Jul 08 17:58:13.096001 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.095955    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwd7j\" (UniqueName: \"kubernetes.io/projected/21933afa-f409-4278-84ae-9e1b02a40e50-kube-api-access-hwd7j\") pod \"21933afa-f409-4278-84ae-9e1b02a40e50\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") "
Jul 08 17:58:13.096088 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.096025    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21933afa-f409-4278-84ae-9e1b02a40e50-openshift-service-ca\") pod \"21933afa-f409-4278-84ae-9e1b02a40e50\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") "
Jul 08 17:58:13.096088 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.096079    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21933afa-f409-4278-84ae-9e1b02a40e50-maas-api-tls\") pod \"21933afa-f409-4278-84ae-9e1b02a40e50\" (UID: \"21933afa-f409-4278-84ae-9e1b02a40e50\") "
Jul 08 17:58:13.096378 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.096358    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21933afa-f409-4278-84ae-9e1b02a40e50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21933afa-f409-4278-84ae-9e1b02a40e50" (UID: "21933afa-f409-4278-84ae-9e1b02a40e50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:58:13.098090 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.098062    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21933afa-f409-4278-84ae-9e1b02a40e50-kube-api-access-hwd7j" (OuterVolumeSpecName: "kube-api-access-hwd7j") pod "21933afa-f409-4278-84ae-9e1b02a40e50" (UID: "21933afa-f409-4278-84ae-9e1b02a40e50"). InnerVolumeSpecName "kube-api-access-hwd7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:58:13.098316 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.098244    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21933afa-f409-4278-84ae-9e1b02a40e50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21933afa-f409-4278-84ae-9e1b02a40e50" (UID: "21933afa-f409-4278-84ae-9e1b02a40e50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:58:13.197552 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.197528    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwd7j\" (UniqueName: \"kubernetes.io/projected/21933afa-f409-4278-84ae-9e1b02a40e50-kube-api-access-hwd7j\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:58:13.197552 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.197548    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21933afa-f409-4278-84ae-9e1b02a40e50-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:58:13.197842 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.197558    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21933afa-f409-4278-84ae-9e1b02a40e50-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:58:13.389681 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.389654    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"]
Jul 08 17:58:13.395275 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.395245    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-67c226-588cdc7dd9-bbxr6"]
Jul 08 17:58:13.591097 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:13.591070    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21933afa-f409-4278-84ae-9e1b02a40e50" path="/var/lib/kubelet/pods/21933afa-f409-4278-84ae-9e1b02a40e50/volumes"
Jul 08 17:58:18.323161 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:18.323122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:18.421438 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:18.421400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:18.634369 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:18.634247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:19.114740 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:19.114701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:19.592044 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:19.592007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:19.743137 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:19.743097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:19.832839 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:19.832807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:19.992293 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:19.992204    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"]
Jul 08 17:58:19.992483 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:19.992439    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7" podUID="ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" containerName="maas-api" containerID="cri-o://d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28" gracePeriod=30
Jul 08 17:58:20.032342 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.032306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:20.238090 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.238067    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:58:20.248735 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.248675    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls\") pod \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") "
Jul 08 17:58:20.248735 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.248729    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-openshift-service-ca\") pod \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") "
Jul 08 17:58:20.248906 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.248771    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz4bc\" (UniqueName: \"kubernetes.io/projected/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-kube-api-access-pz4bc\") pod \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\" (UID: \"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132\") "
Jul 08 17:58:20.249073 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.249052    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" (UID: "ca6f5c18-000a-4c9a-9cfc-67f22fc6b132"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:58:20.250719 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.250699    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" (UID: "ca6f5c18-000a-4c9a-9cfc-67f22fc6b132"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:58:20.250812 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.250794    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-kube-api-access-pz4bc" (OuterVolumeSpecName: "kube-api-access-pz4bc") pod "ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" (UID: "ca6f5c18-000a-4c9a-9cfc-67f22fc6b132"). InnerVolumeSpecName "kube-api-access-pz4bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:58:20.349700 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.349678    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-maas-api-tls\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:58:20.349700 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.349699    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-openshift-service-ca\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:58:20.349838 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:20.349709    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz4bc\" (UniqueName: \"kubernetes.io/projected/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132-kube-api-access-pz4bc\") on node \"ip-10-0-133-199.ec2.internal\" DevicePath \"\""
Jul 08 17:58:21.105559 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.105520    2578 generic.go:356] "Generic (PLEG): container finished" podID="ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" containerID="d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28" exitCode=0
Jul 08 17:58:21.105947 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.105570    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"
Jul 08 17:58:21.105947 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.105608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7" event={"ID":"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132","Type":"ContainerDied","Data":"d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28"}
Jul 08 17:58:21.105947 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.105664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7" event={"ID":"ca6f5c18-000a-4c9a-9cfc-67f22fc6b132","Type":"ContainerDied","Data":"b414603936bbe05677cd4678d42cf8c4541c541c66abcccafc7cf2e3035059eb"}
Jul 08 17:58:21.105947 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.105692    2578 scope.go:117] "RemoveContainer" containerID="d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28"
Jul 08 17:58:21.114098 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.114081    2578 scope.go:117] "RemoveContainer" containerID="d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28"
Jul 08 17:58:21.114376 ip-10-0-133-199 kubenswrapper[2578]: E0708 17:58:21.114358    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28\": container with ID starting with d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28 not found: ID does not exist" containerID="d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28"
Jul 08 17:58:21.114458 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.114384    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28"} err="failed to get container status \"d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28\": rpc error: code = NotFound desc = could not find container \"d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28\": container with ID starting with d46384fbb0cbf8373a96619db445015c163d41ff31085658330e0914e1d02d28 not found: ID does not exist"
Jul 08 17:58:21.126547 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.126523    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"]
Jul 08 17:58:21.130976 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.130958    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9fde78-7cdb847d99-t8ww7"]
Jul 08 17:58:21.590286 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:21.590239    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" path="/var/lib/kubelet/pods/ca6f5c18-000a-4c9a-9cfc-67f22fc6b132/volumes"
Jul 08 17:58:25.312916 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:25.312885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:25.375212 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:25.375182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:25.588873 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:25.588777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:31.744280 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:31.744232    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cf8f76d6f-q989p_8be3c529-5f87-4138-8b96-20c143f548a7/manager/0.log"
Jul 08 17:58:32.448234 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:32.448203    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-564755f94b-hbg2h_ef92054f-759e-4b4c-9d4e-3dcb4a76ed45/copy-manifests/0.log"
Jul 08 17:58:32.455612 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:32.455581    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-564755f94b-hbg2h_ef92054f-759e-4b4c-9d4e-3dcb4a76ed45/manager/0.log"
Jul 08 17:58:35.348861 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:35.348835    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zbwsq_e9c5072a-e7a3-4878-aaca-c65cb79bf2f6/discovery/0.log"
Jul 08 17:58:35.987410 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:35.987379    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ltxbk_33ca8b3b-80f6-4771-a324-91355477b5af/payload-processing/0.log"
Jul 08 17:58:36.596201 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:36.596163    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7hqn9_9b8d05b6-7cf3-438a-80a6-de66ac17dab2/main/0.log"
Jul 08 17:58:36.981248 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:36.981157    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-r429b_e768e0a2-517e-4f29-9a38-2964d7909e5e/main/0.log"
Jul 08 17:58:41.679381 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:41.679338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:41.756011 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:41.755972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log" limit=1024
Jul 08 17:58:44.699558 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:44.699533    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5xwp6_591bcf3a-6a57-4037-a724-4f5bbdbf9fbb/global-pull-secret-syncer/0.log"
Jul 08 17:58:44.836687 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:44.836654    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kb96p_fad3367b-2fd7-472a-a236-e4e95f32b840/konnectivity-agent/0.log"
Jul 08 17:58:44.950756 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:44.950669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-199.ec2.internal_96cd401c532546b6d9df4d9d4f78a0b0/haproxy/0.log"
Jul 08 17:58:51.390136 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.390105    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4d41f3a-8d5c-4b03-9992-74def02af6a7/alertmanager/0.log"
Jul 08 17:58:51.414956 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.414927    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4d41f3a-8d5c-4b03-9992-74def02af6a7/config-reloader/0.log"
Jul 08 17:58:51.434660 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.434641    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4d41f3a-8d5c-4b03-9992-74def02af6a7/kube-rbac-proxy-web/0.log"
Jul 08 17:58:51.454081 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.454060    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4d41f3a-8d5c-4b03-9992-74def02af6a7/kube-rbac-proxy/0.log"
Jul 08 17:58:51.489029 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.489005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4d41f3a-8d5c-4b03-9992-74def02af6a7/kube-rbac-proxy-metric/0.log"
Jul 08 17:58:51.512739 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.512720    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4d41f3a-8d5c-4b03-9992-74def02af6a7/prom-label-proxy/0.log"
Jul 08 17:58:51.532596 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.532575    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4d41f3a-8d5c-4b03-9992-74def02af6a7/init-config-reloader/0.log"
Jul 08 17:58:51.785972 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.785944    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8hdlm_42efd990-d9e2-4e2d-bdfd-fde081ea76cd/node-exporter/0.log"
Jul 08 17:58:51.810660 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.810640    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8hdlm_42efd990-d9e2-4e2d-bdfd-fde081ea76cd/kube-rbac-proxy/0.log"
Jul 08 17:58:51.833471 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:51.833457    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8hdlm_42efd990-d9e2-4e2d-bdfd-fde081ea76cd/init-textfile/0.log"
Jul 08 17:58:52.157474 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.157402    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32778a17-26a3-42f9-b071-b1c6b05ff5e9/prometheus/0.log"
Jul 08 17:58:52.178637 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.178620    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32778a17-26a3-42f9-b071-b1c6b05ff5e9/config-reloader/0.log"
Jul 08 17:58:52.204337 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.204320    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32778a17-26a3-42f9-b071-b1c6b05ff5e9/thanos-sidecar/0.log"
Jul 08 17:58:52.230164 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.230143    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32778a17-26a3-42f9-b071-b1c6b05ff5e9/kube-rbac-proxy-web/0.log"
Jul 08 17:58:52.259000 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.258983    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32778a17-26a3-42f9-b071-b1c6b05ff5e9/kube-rbac-proxy/0.log"
Jul 08 17:58:52.283083 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.283060    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32778a17-26a3-42f9-b071-b1c6b05ff5e9/kube-rbac-proxy-thanos/0.log"
Jul 08 17:58:52.307071 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.307046    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32778a17-26a3-42f9-b071-b1c6b05ff5e9/init-config-reloader/0.log"
Jul 08 17:58:52.388802 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.388781    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-7cwsv_13d843e5-044b-426b-99d0-296e21ad7696/prometheus-operator-admission-webhook/0.log"
Jul 08 17:58:52.498126 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.498054    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcffbb844-x54kt_2321f7be-60e1-4f36-9b57-abdb09373e5b/thanos-query/0.log"
Jul 08 17:58:52.517309 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.517285    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcffbb844-x54kt_2321f7be-60e1-4f36-9b57-abdb09373e5b/kube-rbac-proxy-web/0.log"
Jul 08 17:58:52.536660 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.536638    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcffbb844-x54kt_2321f7be-60e1-4f36-9b57-abdb09373e5b/kube-rbac-proxy/0.log"
Jul 08 17:58:52.557901 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.557879    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcffbb844-x54kt_2321f7be-60e1-4f36-9b57-abdb09373e5b/prom-label-proxy/0.log"
Jul 08 17:58:52.582278 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.582257    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcffbb844-x54kt_2321f7be-60e1-4f36-9b57-abdb09373e5b/kube-rbac-proxy-rules/0.log"
Jul 08 17:58:52.606714 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:52.606692    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcffbb844-x54kt_2321f7be-60e1-4f36-9b57-abdb09373e5b/kube-rbac-proxy-metrics/0.log"
Jul 08 17:58:54.684174 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.684137    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"]
Jul 08 17:58:54.684544 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.684481    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" containerName="maas-api"
Jul 08 17:58:54.684544 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.684492    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" containerName="maas-api"
Jul 08 17:58:54.684544 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.684503    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21933afa-f409-4278-84ae-9e1b02a40e50" containerName="maas-api"
Jul 08 17:58:54.684544 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.684509    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21933afa-f409-4278-84ae-9e1b02a40e50" containerName="maas-api"
Jul 08 17:58:54.684686 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.684574    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca6f5c18-000a-4c9a-9cfc-67f22fc6b132" containerName="maas-api"
Jul 08 17:58:54.684686 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.684584    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21933afa-f409-4278-84ae-9e1b02a40e50" containerName="maas-api"
Jul 08 17:58:54.687706 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.687684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.690231 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.690209    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksr2v\"/\"openshift-service-ca.crt\""
Jul 08 17:58:54.691342 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.691328    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ksr2v\"/\"default-dockercfg-wqkzb\""
Jul 08 17:58:54.691404 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.691343    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksr2v\"/\"kube-root-ca.crt\""
Jul 08 17:58:54.697357 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.697334    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"]
Jul 08 17:58:54.827830 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.827785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-lib-modules\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.828014 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.827846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-podres\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.828014 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.827901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-proc\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.828014 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.827967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-sys\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.828014 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.827996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n7qq\" (UniqueName: \"kubernetes.io/projected/21739af1-e30f-457e-bd1c-25f876cc90c4-kube-api-access-5n7qq\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.928741 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n7qq\" (UniqueName: \"kubernetes.io/projected/21739af1-e30f-457e-bd1c-25f876cc90c4-kube-api-access-5n7qq\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.928904 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-lib-modules\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.928904 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-podres\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.928904 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-proc\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.928904 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-sys\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.929088 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928916    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-sys\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.929088 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928943    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-proc\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.929088 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928954    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-lib-modules\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.929088 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.928947    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/21739af1-e30f-457e-bd1c-25f876cc90c4-podres\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.936927 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.936868    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n7qq\" (UniqueName: \"kubernetes.io/projected/21739af1-e30f-457e-bd1c-25f876cc90c4-kube-api-access-5n7qq\") pod \"perf-node-gather-daemonset-4j6h5\" (UID: \"21739af1-e30f-457e-bd1c-25f876cc90c4\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:54.998489 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:54.998467    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:55.122192 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:55.122167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"]
Jul 08 17:58:55.124657 ip-10-0-133-199 kubenswrapper[2578]: W0708 17:58:55.124633    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod21739af1_e30f_457e_bd1c_25f876cc90c4.slice/crio-87e7b387e0ac3814e6b64c98e74bce10b4b6d820d023a9be33fdd806551ca530 WatchSource:0}: Error finding container 87e7b387e0ac3814e6b64c98e74bce10b4b6d820d023a9be33fdd806551ca530: Status 404 returned error can't find the container with id 87e7b387e0ac3814e6b64c98e74bce10b4b6d820d023a9be33fdd806551ca530
Jul 08 17:58:55.257063 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:55.257033    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5" event={"ID":"21739af1-e30f-457e-bd1c-25f876cc90c4","Type":"ContainerStarted","Data":"84719abee8dd47043583a9ad2fa92d9d5f5f810110f9e9586a1bde5c4d2cbf3b"}
Jul 08 17:58:55.257182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:55.257084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5" event={"ID":"21739af1-e30f-457e-bd1c-25f876cc90c4","Type":"ContainerStarted","Data":"87e7b387e0ac3814e6b64c98e74bce10b4b6d820d023a9be33fdd806551ca530"}
Jul 08 17:58:55.257182 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:55.257171    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:58:55.273724 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:55.273679    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5" podStartSLOduration=1.273666723 podStartE2EDuration="1.273666723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:58:55.271920584 +0000 UTC m=+2570.194511950" watchObservedRunningTime="2026-07-08 17:58:55.273666723 +0000 UTC m=+2570.196258076"
Jul 08 17:58:55.581124 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:55.581093    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-5xbvz_9fa36fff-aeee-4ea9-9c62-98f7038b76c6/volume-data-source-validator/0.log"
Jul 08 17:58:56.538500 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:56.538475    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l5zg6_f94bf8f8-9114-4958-96b4-ee1cbab650ad/dns/0.log"
Jul 08 17:58:56.557214 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:56.557184    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l5zg6_f94bf8f8-9114-4958-96b4-ee1cbab650ad/kube-rbac-proxy/0.log"
Jul 08 17:58:56.664975 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:56.664952    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fssdf_4b6a09c6-44cb-4149-b8e5-8b99e432c7eb/dns-node-resolver/0.log"
Jul 08 17:58:57.253978 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:57.253954    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7tvgb_487ac603-2929-4959-a10b-5d6a8e332a85/node-ca/0.log"
Jul 08 17:58:58.310988 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:58.310961    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zbwsq_e9c5072a-e7a3-4878-aaca-c65cb79bf2f6/discovery/0.log"
Jul 08 17:58:58.512741 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:58.512712    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ltxbk_33ca8b3b-80f6-4771-a324-91355477b5af/payload-processing/0.log"
Jul 08 17:58:59.229229 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:59.229196    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sh429_ef96794e-7574-42a8-807c-dfa42756254a/serve-healthcheck-canary/0.log"
Jul 08 17:58:59.821677 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:59.821647    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b5jvx_81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a/kube-rbac-proxy/0.log"
Jul 08 17:58:59.843000 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:59.842978    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b5jvx_81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a/exporter/0.log"
Jul 08 17:58:59.863314 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:58:59.863252    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b5jvx_81d7a056-3c0d-4ddc-b9ec-b6a7c91d8c7a/extractor/0.log"
Jul 08 17:59:01.271171 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:01.271147    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-4j6h5"
Jul 08 17:59:02.184906 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:02.184876    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cf8f76d6f-q989p_8be3c529-5f87-4138-8b96-20c143f548a7/manager/0.log"
Jul 08 17:59:02.452098 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:02.452005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-564755f94b-hbg2h_ef92054f-759e-4b4c-9d4e-3dcb4a76ed45/manager/0.log"
Jul 08 17:59:02.469897 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:02.469871    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-564755f94b-hbg2h_ef92054f-759e-4b4c-9d4e-3dcb4a76ed45/copy-manifests/0.log"
Jul 08 17:59:03.796807 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:03.796779    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8596cf9c79-5n6cp_ef6b76de-0aa3-435e-85b3-889bfcbdfece/manager/0.log"
Jul 08 17:59:04.671454 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:04.671426    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zbwsq_e9c5072a-e7a3-4878-aaca-c65cb79bf2f6/discovery/0.log"
Jul 08 17:59:04.873201 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:04.873168    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ltxbk_33ca8b3b-80f6-4771-a324-91355477b5af/payload-processing/0.log"
Jul 08 17:59:06.112715 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:06.112691    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zbwsq_e9c5072a-e7a3-4878-aaca-c65cb79bf2f6/discovery/0.log"
Jul 08 17:59:06.301375 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:06.301345    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ltxbk_33ca8b3b-80f6-4771-a324-91355477b5af/payload-processing/0.log"
Jul 08 17:59:10.534597 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.534567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-crtjf_5d3e1142-3ba9-4444-8d23-f08949a2ac8d/kube-multus-additional-cni-plugins/0.log"
Jul 08 17:59:10.555388 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.555360    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-crtjf_5d3e1142-3ba9-4444-8d23-f08949a2ac8d/egress-router-binary-copy/0.log"
Jul 08 17:59:10.577021 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.577000    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-crtjf_5d3e1142-3ba9-4444-8d23-f08949a2ac8d/cni-plugins/0.log"
Jul 08 17:59:10.597928 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.597906    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-crtjf_5d3e1142-3ba9-4444-8d23-f08949a2ac8d/bond-cni-plugin/0.log"
Jul 08 17:59:10.619025 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.619004    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-crtjf_5d3e1142-3ba9-4444-8d23-f08949a2ac8d/routeoverride-cni/0.log"
Jul 08 17:59:10.639297 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.639256    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-crtjf_5d3e1142-3ba9-4444-8d23-f08949a2ac8d/whereabouts-cni-bincopy/0.log"
Jul 08 17:59:10.657743 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.657721    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-crtjf_5d3e1142-3ba9-4444-8d23-f08949a2ac8d/whereabouts-cni/0.log"
Jul 08 17:59:10.843432 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.843390    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tpdks_03561e29-0643-488e-8533-0eacfe4ac2e5/kube-multus/0.log"
Jul 08 17:59:10.952185 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.952157    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sbjfl_49a1850c-d280-45ac-b710-07f9ba7846af/network-metrics-daemon/0.log"
Jul 08 17:59:10.970336 ip-10-0-133-199 kubenswrapper[2578]: I0708 17:59:10.970313    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sbjfl_49a1850c-d280-45ac-b710-07f9ba7846af/kube-rbac-proxy/0.log"