Jul 23 19:18:10.672595 ip-10-0-135-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 19:18:10.672607 ip-10-0-135-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 19:18:10.672616 ip-10-0-135-62 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 19:18:10.672979 ip-10-0-135-62 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 19:18:20.898852 ip-10-0-135-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 19:18:20.898884 ip-10-0-135-62 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5a33020d4b3b4ee48959e3728b1bca3f --
Jul 23 19:20:21.949674 ip-10-0-135-62 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 19:20:22.316824 ip-10-0-135-62 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 19:20:22.316824 ip-10-0-135-62 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 19:20:22.316824 ip-10-0-135-62 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 19:20:22.316824 ip-10-0-135-62 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 19:20:22.316824 ip-10-0-135-62 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 19:20:22.317892 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.317801    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 19:20:22.322887 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322866    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:20:22.322887 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322887    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322892    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322895    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322898    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322901    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322904    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322907    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322909    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322913    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322916    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322918    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322923    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322929    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322933    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322936    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322939    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322942    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322944    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322947    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:20:22.322960 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322950    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322953    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322956    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322958    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322961    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322964    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322966    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322970    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322973    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322976    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322978    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322981    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322983    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322986    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322988    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322991    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322993    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322995    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.322998    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:20:22.323431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323000    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323003    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323005    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323008    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323011    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323016    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323019    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323022    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323024    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323027    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323029    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323032    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323034    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323037    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323040    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323043    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323046    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323049    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323051    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323054    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:20:22.323886 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323056    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323059    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323061    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323064    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323066    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323069    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323072    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323074    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323076    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323079    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323082    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323084    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323087    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323089    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323092    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323096    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323098    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323101    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323103    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323105    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:20:22.324385 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323108    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323110    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323113    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323116    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323118    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323121    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323124    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323127    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323129    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323132    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323135    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323137    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323140    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323143    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323145    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323148    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323150    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323153    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323155    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323157    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:20:22.324861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323952    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323959    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323962    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323968    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323971    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323974    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323977    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323979    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323982    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323984    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323987    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323989    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323992    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323994    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323997    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.323999    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324001    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324005    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324008    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324010    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:20:22.325331 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324013    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324016    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324018    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324021    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324023    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324026    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324029    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324033    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324036    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324039    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324042    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324045    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324047    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324050    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324053    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324055    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324063    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324066    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324068    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:20:22.325931 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324071    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324073    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324076    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324078    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324082    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324084    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324087    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324089    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324092    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324094    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324097    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324099    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324103    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324106    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324108    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324111    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324114    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324118    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324121    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:20:22.326404 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324124    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324126    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324129    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324131    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324134    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324136    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324139    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324141    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324144    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324146    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324149    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324152    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324154    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324157    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324159    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324161    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324164    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324167    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324170    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:20:22.326866 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324174    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324178    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324180    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324183    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324186    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324189    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324191    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324194    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324197    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324199    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324201    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324204    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324207    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324209    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324211    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324214    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324216    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324218    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324221    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324223    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:20:22.327327 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324226    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324228    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324622    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324627    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324631    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324634    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324636    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324639    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324641    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324644    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324646    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324649    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324651    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324654    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324656    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324659    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324662    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324664    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324667    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324669    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:20:22.327861 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324672    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324674    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324677    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324679    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324682    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324684    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324687    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324689    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324692    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324694    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324698    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324702    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324704    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324707    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324710    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324712    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324715    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324717    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324720    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:20:22.328344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324723    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324725    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324728    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324731    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324734    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324736    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324739    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324742    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324744    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324747    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324750    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324752    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324755    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324758    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324761    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324764    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324767    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324770    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324773    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:20:22.328835 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324777    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324780    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324783    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324785    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324788    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324790    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324793    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324795    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324797    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324800    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324802    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324804    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324807    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324810    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324812    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324815    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324817    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324821    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324824    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324826    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:20:22.329337 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324829    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324831    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324834    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324837    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324839    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324842    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324844    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324847    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324849    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324851    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324854    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324856    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324858    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324861    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324864    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324866    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324869    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324871    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324874    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324876    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324879    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:20:22.329821 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324881    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.324884    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.324963    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.324970    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.324980    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.324984    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.324989    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.324993    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.324997    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325002    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325005    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325008    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325011    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325015    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325018    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325021    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325024    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325027    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325030    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325033    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325037    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325040    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325043    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325046    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 19:20:22.330344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325049    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325053    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325056    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325059    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325062    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325065    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325070    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325073    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325076    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325079    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325085    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325088    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325091    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325094    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325097    2561 flags.go:64] FLAG: --enable-server="true"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325100    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325105    2561 flags.go:64] FLAG: --event-burst="100"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325108    2561 flags.go:64] FLAG: --event-qps="50"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325111    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325114    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325117    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325120    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325123    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325126    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325129    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 23 19:20:22.330942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325131    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325134    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325137    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325140    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325142    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325145    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325148    2561 flags.go:64] FLAG: --feature-gates=""
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325151    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325154    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325157    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325160    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325163    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325166    2561 flags.go:64] FLAG: --help="false"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325170    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325173    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325176    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325178    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325185    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325188    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325191    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325194    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325197    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325200    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 19:20:22.331568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325203    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325207    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325210    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325213    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325215    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325218    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325221    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325224    2561 flags.go:64] FLAG: --lock-file=""
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325226    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325230    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325232    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325238    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325240    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325243    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325246    2561 flags.go:64] FLAG: --logging-format="text"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325252    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325256    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325259    2561 flags.go:64] FLAG: --manifest-url=""
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325261    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325266    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325268    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325273    2561 flags.go:64] FLAG: --max-pods="110"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325278    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325281    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325283    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 19:20:22.332251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325286    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325291    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325294    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325297    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325304    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325306    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325310    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325313    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325316    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325322    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325324    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325327    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325330    2561 flags.go:64] FLAG: --port="10250"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325333    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325336    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0547d2b176eb2232f"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325339    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325342    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325345    2561 flags.go:64] FLAG: --register-node="true"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325348    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325367    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325370    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325373    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325376    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325379    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325382    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 19:20:22.333326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325385    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325388    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325390    2561 flags.go:64] FLAG: --runonce="false"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325393    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325398    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325401    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325403    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325406    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325409    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325414    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325417    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325419    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325422    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325425    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325433    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325436    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325439    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325442    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325447    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325450    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325453    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325457    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325460    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325463    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325466    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 19:20:22.334334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325468    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325471    2561 flags.go:64] FLAG: --v="2"
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325475    2561 flags.go:64] FLAG: --version="false"
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325479    2561 flags.go:64] FLAG: --vmodule=""
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325483    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.325486    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325626    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325630    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325635    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325638    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325642    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325646    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325649    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325652    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325654    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325658    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325663    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325666    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325668    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325671    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:20:22.335004 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325673    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325676    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325679    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325682    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325684    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325687    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325690    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325692    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325694    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325697    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325699    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325702    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325705    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325707    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325710    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325712    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325715    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325719    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325722    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325725    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:20:22.335975 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325728    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325730    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325733    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325738    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325740    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325743    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325745    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325748    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325752    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325755    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325757    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325760    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325763    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325765    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325768    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325824    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325829    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325835    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325839    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325842    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:20:22.336772 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325845    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325848    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325851    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325853    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325856    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325858    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325861    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325864    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325866    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325869    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325872    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325874    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325876    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325879    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325881    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325884    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325886    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325889    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325891    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:20:22.337394 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325894    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325896    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325899    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325902    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325904    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325907    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325909    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325912    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325915    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325926    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325929    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325931    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325934    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325937    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325940    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325943    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325945    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325948    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325951    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325953    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:20:22.338021 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325955    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325958    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325961    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325963    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325966    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.325969    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.326665    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.334187    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.334208    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.335077    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.335097    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335188    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335199    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335205    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:20:22.338556 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335210    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335214    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335219    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335224    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335229    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335234    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335241    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335247    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335251    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335256    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335261    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335266    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335271    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335301    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335308    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335313    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335318    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335322    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335326    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335331    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:20:22.338904 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335335    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335339    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335343    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335348    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335370    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335374    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335386    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335390    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335394    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335397    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335401    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335408    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335413    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335417    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335421    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335424    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335428    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335432    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335436    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:20:22.339407 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335440    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335444    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335447    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335451    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335456    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335459    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335463    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335466    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335470    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335474    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335478    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335481    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335485    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335489    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335493    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335498    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335503    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335507    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335511    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335515    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:20:22.339871 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335520    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335524    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335528    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335532    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335536    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335540    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335544    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335548    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335552    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335556    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335561    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335565    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335569    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335572    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335576    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335580    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335586    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335590    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335594    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335598    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:20:22.340434 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335602    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335606    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335610    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335614    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335618    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335622    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335626    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335631    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335635    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335639    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335643    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335647    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335652    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335656    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335660    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335665    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:20:22.340927 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335669    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.335676    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335857    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335865    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335869    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335874    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335878    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335882    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335886    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335891    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335895    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335899    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335903    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335907    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335911    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:20:22.341317 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335915    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335920    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335924    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335928    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335932    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335936    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335940    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335944    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335948    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335952    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335957    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335961    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335965    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335970    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335973    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335978    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335982    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335985    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335989    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335993    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:20:22.341701 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.335996    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336000    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336004    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336008    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336012    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336016    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336021    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336025    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336029    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336033    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336037    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336041    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336045    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336049    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336053    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336057    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336061    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336065    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336069    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336073    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:20:22.342168 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336077    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336081    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336085    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336092    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336098    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336103    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336107    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336112    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336118    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336122    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336127    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336131    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336135    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336139    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336143    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336147    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336151    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336155    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336161    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:20:22.342663 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336166    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336172    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336178    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336182    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336186    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336191    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336196    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336200    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336205    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336209    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336213    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336218    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336222    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336226    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336230    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336234    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336238    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336242    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336246    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:20:22.343107 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336250    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336254    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336258    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336263    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336267    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336271    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336275    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:22.336279    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.336287    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.337131    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.339465    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.340977    2561 server.go:1019] "Starting client certificate rotation"
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.341079    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 19:20:22.343605 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.341105    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 19:20:22.343933 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.343464    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 19:20:22.344745 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.344728    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 19:20:22.354651 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.354630    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 23 19:20:22.356564 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.356546    2561 log.go:25] "Validated CRI v1 image API"
Jul 23 19:20:22.357414 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.357395    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 19:20:22.361928 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.361905    2561 fs.go:135] Filesystem UUIDs: map[67308e72-113e-4908-a0cd-cc90a6e29d85:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8c6456ac-b788-4244-8876-5c36d40a2628:/dev/nvme0n1p4]
Jul 23 19:20:22.361986 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.361928    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 19:20:22.367129 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.367018    2561 manager.go:216] Machine: {Timestamp:2026-07-23 19:20:22.365664759 +0000 UTC m=+0.299724900 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3085973 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e9891a11a2ae001d83f3462cb5fd4 SystemUUID:ec2e9891-a11a-2ae0-01d8-3f3462cb5fd4 BootID:5a33020d-4b3b-4ee4-8959-e3728b1bca3f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:48:3a:26:3f:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:48:3a:26:3f:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:ca:a2:bc:03:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 19:20:22.367129 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.367121    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 19:20:22.367299 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.367203    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 19:20:22.367299 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.367280    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 19:20:22.369984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.369959    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 19:20:22.370152 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.369988    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 19:20:22.370609 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.370595    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 19:20:22.370662 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.370615    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 19:20:22.370662 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.370625    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 19:20:22.371203 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.371191    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 19:20:22.372160 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.372148    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 19:20:22.374904 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.374890    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 19:20:22.375039 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.375027    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 19:20:22.375100 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.375066    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 19:20:22.375100 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.375080    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 19:20:22.375100 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.375099    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 19:20:22.375219 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.375114    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 23 19:20:22.375219 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.375127    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 19:20:22.375547 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.375532    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 19:20:22.375628 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.375554    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 19:20:22.380182 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.380148    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 19:20:22.381525 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.381512    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 19:20:22.381574 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.381544    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 19:20:22.382327 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382317    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 19:20:22.382381 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382334    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 19:20:22.382381 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382341    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 19:20:22.382381 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382346    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 19:20:22.382381 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382371    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 19:20:22.382381 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382380    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 19:20:22.382514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382389    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 19:20:22.382514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382394    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 19:20:22.382514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382401    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 19:20:22.382514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382406    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 19:20:22.382514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382414    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 19:20:22.382514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.382419    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 19:20:22.383754 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.383743    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 19:20:22.383754 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.383754    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 19:20:22.387362 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.387335    2561 server.go:1268] "Started kubelet"
Jul 23 19:20:22.387533 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.387507    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 19:20:22.387607 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.387532    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 19:20:22.387663 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.387450    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 19:20:22.387663 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.387631    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 19:20:22.387663 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.387656    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 19:20:22.387783 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.387660    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 19:20:22.388428 ip-10-0-135-62 systemd[1]: Started Kubernetes Kubelet.
Jul 23 19:20:22.389033 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.388857    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 19:20:22.389611 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.389597    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 19:20:22.392692 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.392670    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 19:20:22.394287 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.393336    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-62.ec2.internal.18c501736148fd0b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-62.ec2.internal,UID:ip-10-0-135-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-62.ec2.internal,},FirstTimestamp:2026-07-23 19:20:22.387309835 +0000 UTC m=+0.321369973,LastTimestamp:2026-07-23 19:20:22.387309835 +0000 UTC m=+0.321369973,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-62.ec2.internal,}"
Jul 23 19:20:22.394450 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.394430    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 19:20:22.394544 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.394513    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:22.394544 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.394429    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 19:20:22.394978 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.394960    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 19:20:22.395074 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395012    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 19:20:22.395074 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395025    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 19:20:22.395184 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395149    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 19:20:22.395184 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395169    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 19:20:22.395610 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395592    2561 factory.go:55] Registering systemd factory
Jul 23 19:20:22.395610 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395613    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 23 19:20:22.395826 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395807    2561 factory.go:153] Registering CRI-O factory
Jul 23 19:20:22.395826 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395826    2561 factory.go:223] Registration of the crio container factory successfully
Jul 23 19:20:22.395948 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395875    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 19:20:22.395948 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395900    2561 factory.go:103] Registering Raw factory
Jul 23 19:20:22.395948 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.395916    2561 manager.go:1196] Started watching for new ooms in manager
Jul 23 19:20:22.396832 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.396769    2561 manager.go:349] Starting recovery of all containers
Jul 23 19:20:22.397118 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.397082    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctnwt"
Jul 23 19:20:22.402634 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.402460    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 19:20:22.402634 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.402520    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 19:20:22.405400 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.405379    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctnwt"
Jul 23 19:20:22.407249 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.407232    2561 manager.go:354] Recovery completed
Jul 23 19:20:22.412915 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.412902    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:20:22.414654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.414639    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:20:22.414720 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.414673    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:20:22.414720 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.414686    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:20:22.415230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.415214    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 19:20:22.415293 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.415233    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 19:20:22.415293 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.415251    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 19:20:22.415293 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.415219    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:20:22.416006 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.415982    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:20:22.416006 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.416005    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:20:22.416099 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.416014    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:20:22.416216 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.416206    2561 policy_none.go:49] "None policy: Start"
Jul 23 19:20:22.416249 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.416221    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 19:20:22.416249 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.416230    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 19:20:22.416830 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.416763    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-62.ec2.internal.18c5017362ea43aa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-62.ec2.internal,UID:ip-10-0-135-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-62.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-62.ec2.internal,},FirstTimestamp:2026-07-23 19:20:22.414656426 +0000 UTC m=+0.348716568,LastTimestamp:2026-07-23 19:20:22.414656426 +0000 UTC m=+0.348716568,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-62.ec2.internal,}"
Jul 23 19:20:22.417166 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.417154    2561 policy_none.go:47] "Start"
Jul 23 19:20:22.452910 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.452892    2561 manager.go:337] "Starting Device Plugin manager"
Jul 23 19:20:22.452988 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.452928    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 19:20:22.452988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.452942    2561 server.go:87] "Starting device plugin registration server"
Jul 23 19:20:22.453188 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.453177    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 19:20:22.453220 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.453192    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 19:20:22.453288 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.453271    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 19:20:22.453369 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.453345    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 19:20:22.453439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.453371    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 19:20:22.455255 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.455236    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 19:20:22.455338 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.455280    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:22.553989 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.553955    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:20:22.555084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.554947    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:20:22.555084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.554983    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:20:22.555084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.555000    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:20:22.555084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.555032    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.558922 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.558900    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 19:20:22.560229 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.560216    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 19:20:22.560273 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.560253    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 19:20:22.560320 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.560274    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 19:20:22.560320 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.560315    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 19:20:22.562913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.562895    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:22.564246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.564232    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.564296 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.564253    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-62.ec2.internal\": node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:22.604028 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.603948    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:22.660613 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.660576    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal"]
Jul 23 19:20:22.660760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.660669    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:20:22.662467 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.662450    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:20:22.662569 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.662485    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:20:22.662569 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.662499    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:20:22.663738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.663722    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:20:22.663864 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.663850    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.663907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.663882    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:20:22.664505 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.664488    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:20:22.664611 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.664517    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:20:22.664611 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.664533    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:20:22.664611 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.664544    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:20:22.664611 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.664561    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:20:22.664611 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.664575    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:20:22.665575 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.665561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.665614 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.665593    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:20:22.666343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.666325    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:20:22.666429 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.666377    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:20:22.666429 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.666393    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:20:22.689985 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.689953    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-62.ec2.internal\" not found" node="ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.694415 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.694398    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-62.ec2.internal\" not found" node="ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.696450 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.696434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba989afd23a4d986924ed33d66ba0e2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal\" (UID: \"ba989afd23a4d986924ed33d66ba0e2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.696509 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.696458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba989afd23a4d986924ed33d66ba0e2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal\" (UID: \"ba989afd23a4d986924ed33d66ba0e2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.696509 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.696476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1bfa0f96230760ac8ad794fbe17eeef-config\") pod \"kube-apiserver-proxy-ip-10-0-135-62.ec2.internal\" (UID: \"d1bfa0f96230760ac8ad794fbe17eeef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.704542 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.704516    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:22.797442 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.797402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba989afd23a4d986924ed33d66ba0e2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal\" (UID: \"ba989afd23a4d986924ed33d66ba0e2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.797442 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.797442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba989afd23a4d986924ed33d66ba0e2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal\" (UID: \"ba989afd23a4d986924ed33d66ba0e2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.797661 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.797466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1bfa0f96230760ac8ad794fbe17eeef-config\") pod \"kube-apiserver-proxy-ip-10-0-135-62.ec2.internal\" (UID: \"d1bfa0f96230760ac8ad794fbe17eeef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.797661 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.797497    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1bfa0f96230760ac8ad794fbe17eeef-config\") pod \"kube-apiserver-proxy-ip-10-0-135-62.ec2.internal\" (UID: \"d1bfa0f96230760ac8ad794fbe17eeef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.797661 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.797508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba989afd23a4d986924ed33d66ba0e2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal\" (UID: \"ba989afd23a4d986924ed33d66ba0e2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.797661 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.797508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba989afd23a4d986924ed33d66ba0e2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal\" (UID: \"ba989afd23a4d986924ed33d66ba0e2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.805538 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.805508    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:22.906413 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:22.906329    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:22.991584 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.991554    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:22.997439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:22.997421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:23.007158 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:23.007123    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:23.107508 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:23.107467    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:23.208614 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:23.208533    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:23.308897 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:23.308867    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-62.ec2.internal\" not found"
Jul 23 19:20:23.340344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.340296    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 19:20:23.340929 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.340526    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 19:20:23.403959 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.403929    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:23.406277 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.406260    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:23.409754 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.409718    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 19:15:22 +0000 UTC" deadline="2028-04-10 18:27:35.426305292 +0000 UTC"
Jul 23 19:20:23.409754 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.409740    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15047h7m12.016568123s"
Jul 23 19:20:23.495712 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.495681    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:23.510679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.510656    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 19:20:23.512527 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.512500    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal"
Jul 23 19:20:23.522570 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.522549    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 19:20:23.595502 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:23.595471    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba989afd23a4d986924ed33d66ba0e2c.slice/crio-c96d85a65bf3124b793d51e9484dab68e5093b7b05ee4cb0d3e8203ba1de4b8f WatchSource:0}: Error finding container c96d85a65bf3124b793d51e9484dab68e5093b7b05ee4cb0d3e8203ba1de4b8f: Status 404 returned error can't find the container with id c96d85a65bf3124b793d51e9484dab68e5093b7b05ee4cb0d3e8203ba1de4b8f
Jul 23 19:20:23.595826 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:23.595797    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bfa0f96230760ac8ad794fbe17eeef.slice/crio-377fa57f9d8598a315dd6144e518d757ef6b8ad22221dd1f09689877a84620ed WatchSource:0}: Error finding container 377fa57f9d8598a315dd6144e518d757ef6b8ad22221dd1f09689877a84620ed: Status 404 returned error can't find the container with id 377fa57f9d8598a315dd6144e518d757ef6b8ad22221dd1f09689877a84620ed
Jul 23 19:20:23.600709 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.600693    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 19:20:23.909585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:23.909498    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:24.376697 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.376373    2561 apiserver.go:52] "Watching apiserver"
Jul 23 19:20:24.388400 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.388364    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 19:20:24.388818 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.388784    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal","openshift-multus/multus-additional-cni-plugins-s8p2g","openshift-multus/multus-g8g7b","openshift-multus/network-metrics-daemon-kfswv","openshift-network-diagnostics/network-check-target-92hfr","openshift-network-operator/iptables-alerter-hk72s","kube-system/global-pull-secret-syncer-5w2l7","kube-system/konnectivity-agent-2w7ch","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94","openshift-cluster-node-tuning-operator/tuned-8n97j","openshift-dns/node-resolver-v79w9","openshift-image-registry/node-ca-ktw85","openshift-ovn-kubernetes/ovnkube-node-pbv2r"]
Jul 23 19:20:24.392624 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.392034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:24.395860 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.395148    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v5v2x\""
Jul 23 19:20:24.395860 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.395365    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 19:20:24.395860 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.395434    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 19:20:24.395860 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.395614    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 19:20:24.398261 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.397463    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.400106 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.399341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.401563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.400275    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 19:20:24.401563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.400643    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 19:20:24.401563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.400863    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 19:20:24.401966 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.401945    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 19:20:24.402009 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.401967    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 19:20:24.402009 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.401974    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 19:20:24.402248 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.402230    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lvbpx\""
Jul 23 19:20:24.402588 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.402465    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 19:20:24.402588 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.402501    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pchw8\""
Jul 23 19:20:24.402588 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.402474    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 19:20:24.402785 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.402736    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 19:20:24.403295 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.403112    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 19:20:24.403295 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.403158    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 19:20:24.404913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.404885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.404932    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-ovnkube-config\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.404958    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-env-overrides\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.404983    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac059306-3195-4a9c-ae47-6a492fd56822-ovn-node-metrics-cert\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-systemd\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-etc-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-node-log\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5ct9\" (UniqueName: \"kubernetes.io/projected/ac059306-3195-4a9c-ae47-6a492fd56822-kube-api-access-v5ct9\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405127    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8053b455-d0e6-4260-9c77-b681a37e4034-agent-certs\") pod \"konnectivity-agent-2w7ch\" (UID: \"8053b455-d0e6-4260-9c77-b681a37e4034\") " pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-systemd-units\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-slash\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-ovn\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-cni-bin\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-ovnkube-script-lib\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8053b455-d0e6-4260-9c77-b681a37e4034-konnectivity-ca\") pod \"konnectivity-agent-2w7ch\" (UID: \"8053b455-d0e6-4260-9c77-b681a37e4034\") " pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:24.405347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-kubelet\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405872 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-var-lib-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405872 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405872 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-log-socket\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405872 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-cni-netd\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405872 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-run-netns\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.405872 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.405525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.406411 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.406388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.408896 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.408876    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 19:20:24.409093 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.409077    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 19:20:24.409323 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.409307    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mf6rp\""
Jul 23 19:20:24.409500 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.409483    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.412022 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.412000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:24.412122 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.412076    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:24.413879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.413680    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 19:20:24.414665 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.414283    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.414665 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.414343    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:24.416722 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.416695    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xhsrl\""
Jul 23 19:20:24.417566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.416925    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 19:20:24.417566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.417174    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 19:20:24.417566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.417394    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 19:20:24.418586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.418565    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:24.418723 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.418637    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:24.419994 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.419973    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.423229 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.423203    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.426105 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.426079    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 19:20:24.426421 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.426401    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 19:20:24.426851 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.426830    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vtkgp\""
Jul 23 19:20:24.427543 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.427512    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 19:20:24.427770 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.427750    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hg5hf\""
Jul 23 19:20:24.432192 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.428549    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 19:20:24.432192 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.428843    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 19:20:24.432192 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.430498    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.433165 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.433146    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 19:20:24.433675 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.433639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.433791 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.433734    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mvkpp\""
Jul 23 19:20:24.436128 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.436096    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 19:20:24.436843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.436825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b8l8k\""
Jul 23 19:20:24.436933 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.436895    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 19:20:24.437195 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.437177    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 19:20:24.446182 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.446159    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l9c9s"
Jul 23 19:20:24.455661 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.455633    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l9c9s"
Jul 23 19:20:24.496280 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.496255    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 19:20:24.506244 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506216    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:24.506400 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8053b455-d0e6-4260-9c77-b681a37e4034-agent-certs\") pod \"konnectivity-agent-2w7ch\" (UID: \"8053b455-d0e6-4260-9c77-b681a37e4034\") " pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:24.506400 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-ovnkube-script-lib\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.506400 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-device-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.506400 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25ec972a-8ec2-4b87-bd61-db6172fa0330-dbus\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.506400 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cnibin\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0668d93-93e2-4b61-be83-7398baeb4911-host-slash\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-var-lib-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cltlw\" (UniqueName: \"kubernetes.io/projected/fc796ffa-5d96-4991-9556-aa95883b8805-kube-api-access-cltlw\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-cni-multus\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506578    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-var-lib-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506590    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv24g\" (UniqueName: \"kubernetes.io/projected/33f43323-a317-4b7b-a8a8-607c51d8f076-kube-api-access-nv24g\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:24.506631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-modprobe-d\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-env-overrides\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506666    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-daemon-config\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-etc-kubernetes\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5ct9\" (UniqueName: \"kubernetes.io/projected/ac059306-3195-4a9c-ae47-6a492fd56822-kube-api-access-v5ct9\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-kubelet\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506785    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-systemd-units\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-cni-bin\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-system-cni-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0668d93-93e2-4b61-be83-7398baeb4911-iptables-alerter-script\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25ec972a-8ec2-4b87-bd61-db6172fa0330-kubelet-config\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506901    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysctl-d\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62347d60-d327-45d6-bfbb-601c7cfbd421-host\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z2lf\" (UniqueName: \"kubernetes.io/projected/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-kube-api-access-9z2lf\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.507047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-ovnkube-script-lib\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8053b455-d0e6-4260-9c77-b681a37e4034-konnectivity-ca\") pod \"konnectivity-agent-2w7ch\" (UID: \"8053b455-d0e6-4260-9c77-b681a37e4034\") " pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-kubelet\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-log-socket\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.506992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-systemd-units\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-registration-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507048    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-cni-bin\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-kubelet\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507124    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-env-overrides\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-lib-modules\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-log-socket\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-os-release\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507211    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac059306-3195-4a9c-ae47-6a492fd56822-ovn-node-metrics-cert\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-multus-certs\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-tuned\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-systemd\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-run\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.507679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-slash\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-systemd\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-slash\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507395    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b9wb\" (UniqueName: \"kubernetes.io/projected/8257bcb2-fddf-4c71-a13a-2057d818b0a3-kube-api-access-5b9wb\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-socket-dir-parent\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6nf5\" (UniqueName: \"kubernetes.io/projected/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-kube-api-access-x6nf5\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-sys\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-cni-netd\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-ovnkube-config\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507581    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507620    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-cni-netd\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8053b455-d0e6-4260-9c77-b681a37e4034-konnectivity-ca\") pod \"konnectivity-agent-2w7ch\" (UID: \"8053b455-d0e6-4260-9c77-b681a37e4034\") " pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-os-release\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-cni-bin\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.508481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-run-netns\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-netns\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14490ace-3cdb-4872-93d8-ff66007fbe39-tmp\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-run-netns\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47fm\" (UniqueName: \"kubernetes.io/projected/14490ace-3cdb-4872-93d8-ff66007fbe39-kube-api-access-b47fm\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-node-log\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-cni-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-cnibin\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-node-log\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.507995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysctl-conf\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508020    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-systemd\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-host\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plnqs\" (UniqueName: \"kubernetes.io/projected/62347d60-d327-45d6-bfbb-601c7cfbd421-kube-api-access-plnqs\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-ovn\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508127    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc796ffa-5d96-4991-9556-aa95883b8805-tmp-dir\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-socket-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-run-ovn\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508196    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwqff\" (UniqueName: \"kubernetes.io/projected/f0668d93-93e2-4b61-be83-7398baeb4911-kube-api-access-gwqff\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysconfig\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62347d60-d327-45d6-bfbb-601c7cfbd421-serviceca\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508324    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-sys-fs\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac059306-3195-4a9c-ae47-6a492fd56822-ovnkube-config\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-kubernetes\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-cni-binary-copy\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-k8s-cni-cncf-io\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-hostroot\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-var-lib-kubelet\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-system-cni-dir\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.509828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.510722 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-etc-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.510722 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc796ffa-5d96-4991-9556-aa95883b8805-hosts-file\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.510722 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-conf-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.510722 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.508747    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac059306-3195-4a9c-ae47-6a492fd56822-etc-openvswitch\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.510931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.510827    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8053b455-d0e6-4260-9c77-b681a37e4034-agent-certs\") pod \"konnectivity-agent-2w7ch\" (UID: \"8053b455-d0e6-4260-9c77-b681a37e4034\") " pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:24.510931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.510833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac059306-3195-4a9c-ae47-6a492fd56822-ovn-node-metrics-cert\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.519050 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.519023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5ct9\" (UniqueName: \"kubernetes.io/projected/ac059306-3195-4a9c-ae47-6a492fd56822-kube-api-access-v5ct9\") pod \"ovnkube-node-pbv2r\" (UID: \"ac059306-3195-4a9c-ae47-6a492fd56822\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.565636 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.565579    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal" event={"ID":"d1bfa0f96230760ac8ad794fbe17eeef","Type":"ContainerStarted","Data":"377fa57f9d8598a315dd6144e518d757ef6b8ad22221dd1f09689877a84620ed"}
Jul 23 19:20:24.566845 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.566810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal" event={"ID":"ba989afd23a4d986924ed33d66ba0e2c","Type":"ContainerStarted","Data":"c96d85a65bf3124b793d51e9484dab68e5093b7b05ee4cb0d3e8203ba1de4b8f"}
Jul 23 19:20:24.609046 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.609008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-cni-binary-copy\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-k8s-cni-cncf-io\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-hostroot\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-var-lib-kubelet\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-system-cni-dir\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc796ffa-5d96-4991-9556-aa95883b8805-hosts-file\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611271    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-conf-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-device-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25ec972a-8ec2-4b87-bd61-db6172fa0330-dbus\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cnibin\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0668d93-93e2-4b61-be83-7398baeb4911-host-slash\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cltlw\" (UniqueName: \"kubernetes.io/projected/fc796ffa-5d96-4991-9556-aa95883b8805-kube-api-access-cltlw\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-cni-multus\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv24g\" (UniqueName: \"kubernetes.io/projected/33f43323-a317-4b7b-a8a8-607c51d8f076-kube-api-access-nv24g\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:24.612868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611594    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-modprobe-d\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-daemon-config\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-etc-kubernetes\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-kubelet\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611724    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611753    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-system-cni-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0668d93-93e2-4b61-be83-7398baeb4911-iptables-alerter-script\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25ec972a-8ec2-4b87-bd61-db6172fa0330-kubelet-config\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysctl-d\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62347d60-d327-45d6-bfbb-601c7cfbd421-host\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z2lf\" (UniqueName: \"kubernetes.io/projected/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-kube-api-access-9z2lf\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-registration-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.611969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-lib-modules\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-os-release\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-multus-certs\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-tuned\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-system-cni-dir\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.613809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-run\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b9wb\" (UniqueName: \"kubernetes.io/projected/8257bcb2-fddf-4c71-a13a-2057d818b0a3-kube-api-access-5b9wb\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-socket-dir-parent\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-device-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612902    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-socket-dir-parent\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-etc-kubernetes\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612919    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62347d60-d327-45d6-bfbb-601c7cfbd421-host\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613038    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613099    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-lib-modules\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.612829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6nf5\" (UniqueName: \"kubernetes.io/projected/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-kube-api-access-x6nf5\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613154    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-cni-multus\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-os-release\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-sys\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613232    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-kubelet\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-hostroot\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-system-cni-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.614654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613505    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-var-lib-kubelet\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-registration-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-modprobe-d\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0668d93-93e2-4b61-be83-7398baeb4911-host-slash\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613816    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.613892    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-multus-certs\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0668d93-93e2-4b61-be83-7398baeb4911-iptables-alerter-script\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-conf-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-k8s-cni-cncf-io\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25ec972a-8ec2-4b87-bd61-db6172fa0330-kubelet-config\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-sys\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysctl-d\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-run\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-os-release\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-cni-bin\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.615518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614399    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-netns\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-os-release\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614505    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14490ace-3cdb-4872-93d8-ff66007fbe39-tmp\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-cnibin\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-var-lib-cni-bin\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25ec972a-8ec2-4b87-bd61-db6172fa0330-dbus\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc796ffa-5d96-4991-9556-aa95883b8805-hosts-file\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47fm\" (UniqueName: \"kubernetes.io/projected/14490ace-3cdb-4872-93d8-ff66007fbe39-kube-api-access-b47fm\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.614984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-cni-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-cnibin\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615044    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-daemon-config\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysctl-conf\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-systemd\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-host\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-multus-cni-dir\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plnqs\" (UniqueName: \"kubernetes.io/projected/62347d60-d327-45d6-bfbb-601c7cfbd421-kube-api-access-plnqs\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc796ffa-5d96-4991-9556-aa95883b8805-tmp-dir\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.616359 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-socket-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqff\" (UniqueName: \"kubernetes.io/projected/f0668d93-93e2-4b61-be83-7398baeb4911-kube-api-access-gwqff\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysconfig\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysconfig\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.615922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-cnibin\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616000    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc796ffa-5d96-4991-9556-aa95883b8805-tmp-dir\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616122    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-sysctl-conf\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616146    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-socket-dir\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.616173    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616182    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-systemd\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616247    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-host\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.616277    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret podName:25ec972a-8ec2-4b87-bd61-db6172fa0330 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:25.116255591 +0000 UTC m=+3.050315735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret") pod "global-pull-secret-syncer-5w2l7" (UID: "25ec972a-8ec2-4b87-bd61-db6172fa0330") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62347d60-d327-45d6-bfbb-601c7cfbd421-serviceca\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-sys-fs\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616382    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-kubernetes\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.617235 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.616440    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:24.618199 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.616521    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs podName:33f43323-a317-4b7b-a8a8-607c51d8f076 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:25.116503175 +0000 UTC m=+3.050563317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs") pod "network-metrics-daemon-kfswv" (UID: "33f43323-a317-4b7b-a8a8-607c51d8f076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:24.618199 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8257bcb2-fddf-4c71-a13a-2057d818b0a3-sys-fs\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.618199 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616816    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-kubernetes\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.618199 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.616951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-host-run-netns\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.618199 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.617251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.618199 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.617470    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62347d60-d327-45d6-bfbb-601c7cfbd421-serviceca\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.618199 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.617776    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-cni-binary-copy\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.620502 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.620094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14490ace-3cdb-4872-93d8-ff66007fbe39-tmp\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.620502 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.620137    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14490ace-3cdb-4872-93d8-ff66007fbe39-etc-tuned\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.620502 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.620238    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:24.620502 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.620255    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:24.620502 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.620271    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzq9w for pod openshift-network-diagnostics/network-check-target-92hfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:24.620502 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:24.620332    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w podName:dce479a7-1b18-4353-942d-258cbcb34c46 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:25.120313831 +0000 UTC m=+3.054373980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gzq9w" (UniqueName: "kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w") pod "network-check-target-92hfr" (UID: "dce479a7-1b18-4353-942d-258cbcb34c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:24.625637 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.625090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plnqs\" (UniqueName: \"kubernetes.io/projected/62347d60-d327-45d6-bfbb-601c7cfbd421-kube-api-access-plnqs\") pod \"node-ca-ktw85\" (UID: \"62347d60-d327-45d6-bfbb-601c7cfbd421\") " pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:24.625637 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.625230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwqff\" (UniqueName: \"kubernetes.io/projected/f0668d93-93e2-4b61-be83-7398baeb4911-kube-api-access-gwqff\") pod \"iptables-alerter-hk72s\" (UID: \"f0668d93-93e2-4b61-be83-7398baeb4911\") " pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.625637 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.625558    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv24g\" (UniqueName: \"kubernetes.io/projected/33f43323-a317-4b7b-a8a8-607c51d8f076-kube-api-access-nv24g\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:24.625861 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.625754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z2lf\" (UniqueName: \"kubernetes.io/projected/79fb69cd-51f8-4f35-bddd-5494fff1d8f5-kube-api-access-9z2lf\") pod \"multus-additional-cni-plugins-s8p2g\" (UID: \"79fb69cd-51f8-4f35-bddd-5494fff1d8f5\") " pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.625861 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.625846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6nf5\" (UniqueName: \"kubernetes.io/projected/ff708d73-b6dd-4ed4-bfa2-e386a0b85178-kube-api-access-x6nf5\") pod \"multus-g8g7b\" (UID: \"ff708d73-b6dd-4ed4-bfa2-e386a0b85178\") " pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.625976 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.625862    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b9wb\" (UniqueName: \"kubernetes.io/projected/8257bcb2-fddf-4c71-a13a-2057d818b0a3-kube-api-access-5b9wb\") pod \"aws-ebs-csi-driver-node-pfz94\" (UID: \"8257bcb2-fddf-4c71-a13a-2057d818b0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.627565 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.627511    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cltlw\" (UniqueName: \"kubernetes.io/projected/fc796ffa-5d96-4991-9556-aa95883b8805-kube-api-access-cltlw\") pod \"node-resolver-v79w9\" (UID: \"fc796ffa-5d96-4991-9556-aa95883b8805\") " pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.627664 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.627573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47fm\" (UniqueName: \"kubernetes.io/projected/14490ace-3cdb-4872-93d8-ff66007fbe39-kube-api-access-b47fm\") pod \"tuned-8n97j\" (UID: \"14490ace-3cdb-4872-93d8-ff66007fbe39\") " pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.707766 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.707712    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:24.722339 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.722312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:24.734452 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.734417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8p2g"
Jul 23 19:20:24.743606 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.743582    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:24.749090 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.749070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v79w9"
Jul 23 19:20:24.757813 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.757789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hk72s"
Jul 23 19:20:24.769654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.769630    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94"
Jul 23 19:20:24.778668 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.778629    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8n97j"
Jul 23 19:20:24.789605 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.789571    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8g7b"
Jul 23 19:20:24.795468 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:24.795446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ktw85"
Jul 23 19:20:25.122118 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:25.122061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:25.122325 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:25.122126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:25.122325 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:25.122166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:25.122325 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.122234    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:25.122325 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.122281    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:25.122567 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.122327    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:25.122567 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.122348    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:25.122567 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.122362    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzq9w for pod openshift-network-diagnostics/network-check-target-92hfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:25.122567 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.122329    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret podName:25ec972a-8ec2-4b87-bd61-db6172fa0330 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:26.12230094 +0000 UTC m=+4.056361085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret") pod "global-pull-secret-syncer-5w2l7" (UID: "25ec972a-8ec2-4b87-bd61-db6172fa0330") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:25.122567 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.122452    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs podName:33f43323-a317-4b7b-a8a8-607c51d8f076 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:26.122433907 +0000 UTC m=+4.056494043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs") pod "network-metrics-daemon-kfswv" (UID: "33f43323-a317-4b7b-a8a8-607c51d8f076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:25.122567 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.122471    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w podName:dce479a7-1b18-4353-942d-258cbcb34c46 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:26.12245959 +0000 UTC m=+4.056519719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzq9w" (UniqueName: "kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w") pod "network-check-target-92hfr" (UID: "dce479a7-1b18-4353-942d-258cbcb34c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:25.459597 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:25.459559    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 19:15:24 +0000 UTC" deadline="2027-12-25 10:35:29.869335494 +0000 UTC"
Jul 23 19:20:25.459597 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:25.459589    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12471h15m4.409750222s"
Jul 23 19:20:25.560771 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:25.560732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:25.560771 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:25.560774    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:25.561012 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.560872    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:25.561059 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:25.561015    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:25.699708 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.699675    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0668d93_93e2_4b61_be83_7398baeb4911.slice/crio-e7f692643790ec96edf97ae47bc0124033e5973e17d4180305116693ff654b1b WatchSource:0}: Error finding container e7f692643790ec96edf97ae47bc0124033e5973e17d4180305116693ff654b1b: Status 404 returned error can't find the container with id e7f692643790ec96edf97ae47bc0124033e5973e17d4180305116693ff654b1b
Jul 23 19:20:25.701173 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.701133    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc796ffa_5d96_4991_9556_aa95883b8805.slice/crio-ea14e6860117a4c9a0cda6829a323c895d00dcc98764854cf740cdea4958bb6f WatchSource:0}: Error finding container ea14e6860117a4c9a0cda6829a323c895d00dcc98764854cf740cdea4958bb6f: Status 404 returned error can't find the container with id ea14e6860117a4c9a0cda6829a323c895d00dcc98764854cf740cdea4958bb6f
Jul 23 19:20:25.703691 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.703119    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14490ace_3cdb_4872_93d8_ff66007fbe39.slice/crio-80d439aabf3ff0ae13a436846928d9142c6ed06b7d4ee1eb7a65587a9cc4e90a WatchSource:0}: Error finding container 80d439aabf3ff0ae13a436846928d9142c6ed06b7d4ee1eb7a65587a9cc4e90a: Status 404 returned error can't find the container with id 80d439aabf3ff0ae13a436846928d9142c6ed06b7d4ee1eb7a65587a9cc4e90a
Jul 23 19:20:25.709524 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.707354    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62347d60_d327_45d6_bfbb_601c7cfbd421.slice/crio-0cb00044885de7111074e4144b9068bc870d3d7ce992001dae369d406b587268 WatchSource:0}: Error finding container 0cb00044885de7111074e4144b9068bc870d3d7ce992001dae369d406b587268: Status 404 returned error can't find the container with id 0cb00044885de7111074e4144b9068bc870d3d7ce992001dae369d406b587268
Jul 23 19:20:25.710913 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.710876    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac059306_3195_4a9c_ae47_6a492fd56822.slice/crio-1e60ecced4819d34581d73764d510db19a8a0e56b8afb63f1c2ae7ec5d93a04c WatchSource:0}: Error finding container 1e60ecced4819d34581d73764d510db19a8a0e56b8afb63f1c2ae7ec5d93a04c: Status 404 returned error can't find the container with id 1e60ecced4819d34581d73764d510db19a8a0e56b8afb63f1c2ae7ec5d93a04c
Jul 23 19:20:25.712003 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.711976    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8257bcb2_fddf_4c71_a13a_2057d818b0a3.slice/crio-1c15e13d2637a49dad5907cba44375fa360ef3dc875a4311d8b487807a4d3cbd WatchSource:0}: Error finding container 1c15e13d2637a49dad5907cba44375fa360ef3dc875a4311d8b487807a4d3cbd: Status 404 returned error can't find the container with id 1c15e13d2637a49dad5907cba44375fa360ef3dc875a4311d8b487807a4d3cbd
Jul 23 19:20:25.712956 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.712851    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8053b455_d0e6_4260_9c77_b681a37e4034.slice/crio-7e87d20cd95c7b1c8268406bdc966321e91bd3a9b3e75c0f167e5d6252f70de4 WatchSource:0}: Error finding container 7e87d20cd95c7b1c8268406bdc966321e91bd3a9b3e75c0f167e5d6252f70de4: Status 404 returned error can't find the container with id 7e87d20cd95c7b1c8268406bdc966321e91bd3a9b3e75c0f167e5d6252f70de4
Jul 23 19:20:25.715011 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.714971    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff708d73_b6dd_4ed4_bfa2_e386a0b85178.slice/crio-bdd7d10fc7e1de1e4c2fd3f89fc05f63d96c413e4d4d9952e1d7249decf3a318 WatchSource:0}: Error finding container bdd7d10fc7e1de1e4c2fd3f89fc05f63d96c413e4d4d9952e1d7249decf3a318: Status 404 returned error can't find the container with id bdd7d10fc7e1de1e4c2fd3f89fc05f63d96c413e4d4d9952e1d7249decf3a318
Jul 23 19:20:25.717175 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:20:25.717057    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fb69cd_51f8_4f35_bddd_5494fff1d8f5.slice/crio-b3ecee32dce91a5c1bbd385b9b9b2a8e4d4b750c235b05136fe6aa06020a6819 WatchSource:0}: Error finding container b3ecee32dce91a5c1bbd385b9b9b2a8e4d4b750c235b05136fe6aa06020a6819: Status 404 returned error can't find the container with id b3ecee32dce91a5c1bbd385b9b9b2a8e4d4b750c235b05136fe6aa06020a6819
Jul 23 19:20:26.131947 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.131607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:26.131947 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.131885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:26.131947 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.131923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:26.131947 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.131767    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:26.132215 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.132010    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret podName:25ec972a-8ec2-4b87-bd61-db6172fa0330 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:28.131988507 +0000 UTC m=+6.066048648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret") pod "global-pull-secret-syncer-5w2l7" (UID: "25ec972a-8ec2-4b87-bd61-db6172fa0330") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:26.132215 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.132049    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:26.132215 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.132063    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:26.132215 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.132085    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:26.132215 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.132097    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzq9w for pod openshift-network-diagnostics/network-check-target-92hfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:26.132215 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.132108    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs podName:33f43323-a317-4b7b-a8a8-607c51d8f076 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:28.132095565 +0000 UTC m=+6.066155692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs") pod "network-metrics-daemon-kfswv" (UID: "33f43323-a317-4b7b-a8a8-607c51d8f076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:26.132215 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.132139    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w podName:dce479a7-1b18-4353-942d-258cbcb34c46 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:28.132126695 +0000 UTC m=+6.066186823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzq9w" (UniqueName: "kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w") pod "network-check-target-92hfr" (UID: "dce479a7-1b18-4353-942d-258cbcb34c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:26.460095 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.459991    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 19:15:24 +0000 UTC" deadline="2028-04-12 19:47:09.73064556 +0000 UTC"
Jul 23 19:20:26.460095 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.460034    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15096h26m43.27061698s"
Jul 23 19:20:26.563517 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.563476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:26.563714 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:26.563639    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:26.591497 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.591451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ktw85" event={"ID":"62347d60-d327-45d6-bfbb-601c7cfbd421","Type":"ContainerStarted","Data":"0cb00044885de7111074e4144b9068bc870d3d7ce992001dae369d406b587268"}
Jul 23 19:20:26.606738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.606699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8n97j" event={"ID":"14490ace-3cdb-4872-93d8-ff66007fbe39","Type":"ContainerStarted","Data":"80d439aabf3ff0ae13a436846928d9142c6ed06b7d4ee1eb7a65587a9cc4e90a"}
Jul 23 19:20:26.615681 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.615643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v79w9" event={"ID":"fc796ffa-5d96-4991-9556-aa95883b8805","Type":"ContainerStarted","Data":"ea14e6860117a4c9a0cda6829a323c895d00dcc98764854cf740cdea4958bb6f"}
Jul 23 19:20:26.632292 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.632189    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hk72s" event={"ID":"f0668d93-93e2-4b61-be83-7398baeb4911","Type":"ContainerStarted","Data":"e7f692643790ec96edf97ae47bc0124033e5973e17d4180305116693ff654b1b"}
Jul 23 19:20:26.644257 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.644209    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal" event={"ID":"d1bfa0f96230760ac8ad794fbe17eeef","Type":"ContainerStarted","Data":"9e5f587abe76db180b1e51095f48c2190aaa17b418a60528dca601d86271e9c4"}
Jul 23 19:20:26.650929 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.650875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" event={"ID":"79fb69cd-51f8-4f35-bddd-5494fff1d8f5","Type":"ContainerStarted","Data":"b3ecee32dce91a5c1bbd385b9b9b2a8e4d4b750c235b05136fe6aa06020a6819"}
Jul 23 19:20:26.667183 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.667106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2w7ch" event={"ID":"8053b455-d0e6-4260-9c77-b681a37e4034","Type":"ContainerStarted","Data":"7e87d20cd95c7b1c8268406bdc966321e91bd3a9b3e75c0f167e5d6252f70de4"}
Jul 23 19:20:26.682704 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.682668    2561 generic.go:356] "Generic (PLEG): container finished" podID="ba989afd23a4d986924ed33d66ba0e2c" containerID="4f138dc2f17979503638d61ce9d0033357f9c9f5ed98d84bd13bb36455285f22" exitCode=0
Jul 23 19:20:26.682854 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.682755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal" event={"ID":"ba989afd23a4d986924ed33d66ba0e2c","Type":"ContainerDied","Data":"4f138dc2f17979503638d61ce9d0033357f9c9f5ed98d84bd13bb36455285f22"}
Jul 23 19:20:26.697843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.697809    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8g7b" event={"ID":"ff708d73-b6dd-4ed4-bfa2-e386a0b85178","Type":"ContainerStarted","Data":"bdd7d10fc7e1de1e4c2fd3f89fc05f63d96c413e4d4d9952e1d7249decf3a318"}
Jul 23 19:20:26.701964 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.701903    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-62.ec2.internal" podStartSLOduration=3.701845253 podStartE2EDuration="3.701845253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:26.66254555 +0000 UTC m=+4.596605705" watchObservedRunningTime="2026-07-23 19:20:26.701845253 +0000 UTC m=+4.635905401"
Jul 23 19:20:26.717728 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.717659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94" event={"ID":"8257bcb2-fddf-4c71-a13a-2057d818b0a3","Type":"ContainerStarted","Data":"1c15e13d2637a49dad5907cba44375fa360ef3dc875a4311d8b487807a4d3cbd"}
Jul 23 19:20:26.730178 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:26.729390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"1e60ecced4819d34581d73764d510db19a8a0e56b8afb63f1c2ae7ec5d93a04c"}
Jul 23 19:20:27.561065 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:27.561031    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:27.561571 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:27.561171    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:27.561638 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:27.561602    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:27.561765 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:27.561700    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:27.739253 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:27.739059    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal" event={"ID":"ba989afd23a4d986924ed33d66ba0e2c","Type":"ContainerStarted","Data":"8ba90b444140b18e441e4dcc6afa7da80e4c11cd4742851ea224dbbee391e36e"}
Jul 23 19:20:28.149865 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:28.149822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:28.150064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:28.149880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:28.150064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:28.149921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:28.150183 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.150080    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:28.150183 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.150103    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:28.150183 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.150115    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzq9w for pod openshift-network-diagnostics/network-check-target-92hfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:28.150183 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.150176    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w podName:dce479a7-1b18-4353-942d-258cbcb34c46 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:32.1501565 +0000 UTC m=+10.084216629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzq9w" (UniqueName: "kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w") pod "network-check-target-92hfr" (UID: "dce479a7-1b18-4353-942d-258cbcb34c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:28.150429 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.150245    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:28.150429 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.150281    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret podName:25ec972a-8ec2-4b87-bd61-db6172fa0330 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:32.150269814 +0000 UTC m=+10.084329942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret") pod "global-pull-secret-syncer-5w2l7" (UID: "25ec972a-8ec2-4b87-bd61-db6172fa0330") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:28.150429 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.150335    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:28.150787 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.150760    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs podName:33f43323-a317-4b7b-a8a8-607c51d8f076 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:32.150738002 +0000 UTC m=+10.084798141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs") pod "network-metrics-daemon-kfswv" (UID: "33f43323-a317-4b7b-a8a8-607c51d8f076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:28.563885 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:28.563382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:28.563885 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:28.563523    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:29.561034 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:29.560999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:29.561211 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:29.561155    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:29.561330 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:29.561311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:29.561528 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:29.561426    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:30.561178 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:30.561142    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:30.561648 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:30.561279    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:31.560557 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:31.560510    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:31.560557 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:31.560510    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:31.560815 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:31.560656    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:31.560815 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:31.560793    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:32.187927 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:32.187878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:32.187927 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:32.187927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:32.188480 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:32.187966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:32.188480 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.188187    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:32.188480 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.188209    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:32.188480 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.188222    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzq9w for pod openshift-network-diagnostics/network-check-target-92hfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:32.188480 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.188398    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w podName:dce479a7-1b18-4353-942d-258cbcb34c46 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:40.188382816 +0000 UTC m=+18.122442942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzq9w" (UniqueName: "kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w") pod "network-check-target-92hfr" (UID: "dce479a7-1b18-4353-942d-258cbcb34c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:32.188778 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.188756    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:32.188892 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.188815    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret podName:25ec972a-8ec2-4b87-bd61-db6172fa0330 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:40.188799064 +0000 UTC m=+18.122859202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret") pod "global-pull-secret-syncer-5w2l7" (UID: "25ec972a-8ec2-4b87-bd61-db6172fa0330") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:32.188892 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.188857    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:32.188972 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.188925    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs podName:33f43323-a317-4b7b-a8a8-607c51d8f076 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:40.188907001 +0000 UTC m=+18.122967147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs") pod "network-metrics-daemon-kfswv" (UID: "33f43323-a317-4b7b-a8a8-607c51d8f076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:32.562733 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:32.561566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:32.562733 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:32.561706    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:33.560754 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:33.560716    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:33.561194 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:33.560871    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:33.561194 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:33.560937    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:33.561194 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:33.561011    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:34.560842 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:34.560793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:34.561289 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:34.560942    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:35.560956 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:35.560919    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:35.561438 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:35.561037    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:35.561438 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:35.561425    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:35.561549 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:35.561496    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:36.561484 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:36.561452    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:36.561934 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:36.561595    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:37.561088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:37.561052    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:37.561278 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:37.561098    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:37.561278 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:37.561189    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:37.561387 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:37.561341    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:38.561441 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:38.561397    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:38.561860 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:38.561605    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:39.561166 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:39.561130    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:39.561390 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:39.561176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:39.561390 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:39.561257    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:39.561516 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:39.561396    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:40.255158 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:40.255115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:40.255339 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:40.255167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:40.255339 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:40.255203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:40.255339 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.255279    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:40.255339 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.255325    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:40.255339 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.255332    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:40.255339 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.255341    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:40.255618 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.255378    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzq9w for pod openshift-network-diagnostics/network-check-target-92hfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:40.255618 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.255344    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret podName:25ec972a-8ec2-4b87-bd61-db6172fa0330 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:56.255329192 +0000 UTC m=+34.189389336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret") pod "global-pull-secret-syncer-5w2l7" (UID: "25ec972a-8ec2-4b87-bd61-db6172fa0330") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:40.255618 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.255437    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs podName:33f43323-a317-4b7b-a8a8-607c51d8f076 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:56.255420779 +0000 UTC m=+34.189480904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs") pod "network-metrics-daemon-kfswv" (UID: "33f43323-a317-4b7b-a8a8-607c51d8f076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:40.255618 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.255452    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w podName:dce479a7-1b18-4353-942d-258cbcb34c46 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:56.255443047 +0000 UTC m=+34.189503177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzq9w" (UniqueName: "kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w") pod "network-check-target-92hfr" (UID: "dce479a7-1b18-4353-942d-258cbcb34c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:40.560812 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:40.560730    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:40.560950 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:40.560876    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:41.560703 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:41.560670    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:41.561203 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:41.560687    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:41.561203 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:41.560815    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:41.561203 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:41.560872    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:42.562392 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:42.562331    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:42.562856 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:42.562472    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:43.561129 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:43.561099    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:43.561343 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:43.561236    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:43.561343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:43.561300    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:43.561463 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:43.561441    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:44.561502 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:44.561462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:44.562049 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:44.561576    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:45.561554 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.561074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:45.562342 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.561072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:45.562342 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:45.561690    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:45.562342 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:45.561760    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:45.778046 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.778007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2w7ch" event={"ID":"8053b455-d0e6-4260-9c77-b681a37e4034","Type":"ContainerStarted","Data":"6caa464e36c0ba719d1c5be559325be84f47c90446b3dcf370c4e8fd0b928102"}
Jul 23 19:20:45.779470 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.779441    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8g7b" event={"ID":"ff708d73-b6dd-4ed4-bfa2-e386a0b85178","Type":"ContainerStarted","Data":"f420c9656cdad5c4759ffc2da49f1d4639767b4503bb884eb9e83dd7e1a1810b"}
Jul 23 19:20:45.780824 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.780803    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94" event={"ID":"8257bcb2-fddf-4c71-a13a-2057d818b0a3","Type":"ContainerStarted","Data":"d5bd23a7676d79dc410f6577cbe95c8b9b81bc3f80ae554fff24e40c09be9750"}
Jul 23 19:20:45.783278 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.783261    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:20:45.783588 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.783565    2561 generic.go:356] "Generic (PLEG): container finished" podID="ac059306-3195-4a9c-ae47-6a492fd56822" containerID="3af20a672e43bf75a78c516d3625d709b79c08f0e55c86238a758322d3029421" exitCode=1
Jul 23 19:20:45.783679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.783627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"026dc103efed0aed7dc20980ac2f8d935961986901a89fde3792cdbeecc05f9b"}
Jul 23 19:20:45.783724 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.783682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"316c1c51b58efd7648ac8b41a0eefc688fc05747552e1630ff793684020cec64"}
Jul 23 19:20:45.783773 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.783729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"594121f33f60acc4c2d10e5a6353b846e255fc19e5a05af6ade2148474420321"}
Jul 23 19:20:45.783820 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.783772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"61510f9ad1c4cff3c4c641cfbb5f7b9921993f191377e7f4aca41db3d9910c2f"}
Jul 23 19:20:45.783820 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.783801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerDied","Data":"3af20a672e43bf75a78c516d3625d709b79c08f0e55c86238a758322d3029421"}
Jul 23 19:20:45.783905 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.783845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"c79f0495d8e4f152ae6870bd677d17dccc2ef94c1b0553993544cdb314ba1a74"}
Jul 23 19:20:45.785074 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.785051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ktw85" event={"ID":"62347d60-d327-45d6-bfbb-601c7cfbd421","Type":"ContainerStarted","Data":"062c85d6c3169cfad58108d15a3982ce8d91856b1cdc44a183b16fa28f2e4758"}
Jul 23 19:20:45.786421 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.786378    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8n97j" event={"ID":"14490ace-3cdb-4872-93d8-ff66007fbe39","Type":"ContainerStarted","Data":"050fd3527280e933c1725bd6ada67a9bcd1839bdb1a89219742e9e49ff784522"}
Jul 23 19:20:45.787619 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.787598    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v79w9" event={"ID":"fc796ffa-5d96-4991-9556-aa95883b8805","Type":"ContainerStarted","Data":"14215367b5f3251e9e016af784e72668fd955dbae50fbddeb80fe8fb8123e773"}
Jul 23 19:20:45.789372 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.789336    2561 generic.go:356] "Generic (PLEG): container finished" podID="79fb69cd-51f8-4f35-bddd-5494fff1d8f5" containerID="d33b685a599afb23156bde2cd1ffc12dd642b1366d43a17422e982ff8888892a" exitCode=0
Jul 23 19:20:45.789440 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.789388    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" event={"ID":"79fb69cd-51f8-4f35-bddd-5494fff1d8f5","Type":"ContainerDied","Data":"d33b685a599afb23156bde2cd1ffc12dd642b1366d43a17422e982ff8888892a"}
Jul 23 19:20:45.795240 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.795204    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-62.ec2.internal" podStartSLOduration=22.79517489 podStartE2EDuration="22.79517489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:27.754909603 +0000 UTC m=+5.688969751" watchObservedRunningTime="2026-07-23 19:20:45.79517489 +0000 UTC m=+23.729235029"
Jul 23 19:20:45.795597 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.795573    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2w7ch" podStartSLOduration=8.929550527 podStartE2EDuration="23.795565474s" totalImagesPullingTime="14.866014947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:45.794935342 +0000 UTC m=+23.728995490" watchObservedRunningTime="2026-07-23 19:20:45.795565474 +0000 UTC m=+23.729625620"
Jul 23 19:20:45.813619 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.813576    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v79w9" podStartSLOduration=4.759726562 podStartE2EDuration="23.813560501s" totalImagesPullingTime="19.053833939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:45.813537985 +0000 UTC m=+23.747598133" watchObservedRunningTime="2026-07-23 19:20:45.813560501 +0000 UTC m=+23.747620647"
Jul 23 19:20:45.820419 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.820395    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:45.830471 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.830430    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8n97j" podStartSLOduration=3.776962516 podStartE2EDuration="22.830417212s" totalImagesPullingTime="19.053454696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:45.830136062 +0000 UTC m=+23.764196209" watchObservedRunningTime="2026-07-23 19:20:45.830417212 +0000 UTC m=+23.764477362"
Jul 23 19:20:45.847514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.847463    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g8g7b" podStartSLOduration=3.764882319 podStartE2EDuration="22.847452502s" totalImagesPullingTime="19.082570183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:45.847208722 +0000 UTC m=+23.781268869" watchObservedRunningTime="2026-07-23 19:20:45.847452502 +0000 UTC m=+23.781512650"
Jul 23 19:20:45.861658 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:45.861610    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ktw85" podStartSLOduration=7.991408245 podStartE2EDuration="22.861595824s" totalImagesPullingTime="14.870187579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:45.861421586 +0000 UTC m=+23.795481734" watchObservedRunningTime="2026-07-23 19:20:45.861595824 +0000 UTC m=+23.795655970"
Jul 23 19:20:46.010851 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.010823    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:46.213135 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.213106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:46.297294 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.297263    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 19:20:46.465448 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.465329    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T19:20:46.297281808Z","UUID":"27778935-3175-4a34-9fff-8cb16310b715","Handler":null,"Name":"","Endpoint":""}
Jul 23 19:20:46.468639 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.468613    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 19:20:46.468785 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.468662    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 19:20:46.561580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.561548    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:46.562038 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:46.561677    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:46.795830 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.795733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94" event={"ID":"8257bcb2-fddf-4c71-a13a-2057d818b0a3","Type":"ContainerStarted","Data":"10c72f2360e418929d39dc35739b760c32ecaaf500fe724806bd4b16fac022b2"}
Jul 23 19:20:46.797635 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.797604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hk72s" event={"ID":"f0668d93-93e2-4b61-be83-7398baeb4911","Type":"ContainerStarted","Data":"64f5768d0df1d67d43994f6855f195fe35c5e5a66959d7c741e7ebd1e5b52657"}
Jul 23 19:20:46.813920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:46.813872    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hk72s" podStartSLOduration=4.757238504 podStartE2EDuration="23.81385789s" totalImagesPullingTime="19.056619386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:46.813531454 +0000 UTC m=+24.747591603" watchObservedRunningTime="2026-07-23 19:20:46.81385789 +0000 UTC m=+24.747918037"
Jul 23 19:20:47.420439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.420170    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:47.561152 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.561127    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:47.561303 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:47.561230    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:47.561469 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.561447    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:47.561583 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:47.561562    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:47.615312 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.615272    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:47.802196 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.802161    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94" event={"ID":"8257bcb2-fddf-4c71-a13a-2057d818b0a3","Type":"ContainerStarted","Data":"2a24ecc273e147c37ee3091ebe283ec812802e2812391b41e1a87a9063f6137f"}
Jul 23 19:20:47.805627 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.805607    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:20:47.806080 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.806041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"a8302cddf8f6f90daddb59c59866e3395756a1f20d316a1c1d44b6bd4ba1ad4e"}
Jul 23 19:20:47.809161 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.809139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:47.821627 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:47.821574    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfz94" podStartSLOduration=3.764188614 podStartE2EDuration="24.821558537s" totalImagesPullingTime="21.057369923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:47.820967704 +0000 UTC m=+25.755027853" watchObservedRunningTime="2026-07-23 19:20:47.821558537 +0000 UTC m=+25.755618684"
Jul 23 19:20:48.009961 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:48.009924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:48.219349 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:48.219305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:48.561303 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:48.561218    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:48.561483 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:48.561374    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:48.607960 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:48.607924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:49.214000 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:49.213960    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:49.418473 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:49.418440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:49.561543 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:49.561455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:49.561543 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:49.561481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:49.561773 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:49.561587    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:49.561773 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:49.561694    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:49.615863 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:49.615821    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:49.822990 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:49.822901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:50.168920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.168652    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:50.169326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.169304    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:50.221173 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.221148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:50.561040 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.560999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:50.561192 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:50.561139    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:50.673136 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.673098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:50.814876 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.814800    2561 generic.go:356] "Generic (PLEG): container finished" podID="79fb69cd-51f8-4f35-bddd-5494fff1d8f5" containerID="aa8d0cdc2694aaac8a44729b16b0fe7ae858dec799d7134df3bd0c4a8b30111b" exitCode=0
Jul 23 19:20:50.814876 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.814837    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" event={"ID":"79fb69cd-51f8-4f35-bddd-5494fff1d8f5","Type":"ContainerDied","Data":"aa8d0cdc2694aaac8a44729b16b0fe7ae858dec799d7134df3bd0c4a8b30111b"}
Jul 23 19:20:50.818721 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.818705    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:20:50.819052 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.819033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"5a951c5b6b85e4615116e5be7a8b62b890b1e09d233f3a4cfe49e2a9681ec8af"}
Jul 23 19:20:50.819256 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.819241    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:50.819344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.819276    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:50.819563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.819545    2561 scope.go:117] "RemoveContainer" containerID="3af20a672e43bf75a78c516d3625d709b79c08f0e55c86238a758322d3029421"
Jul 23 19:20:50.819739 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.819726    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2w7ch"
Jul 23 19:20:50.836764 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:50.836744    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:51.561175 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.561146    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:51.561175 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.561172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:51.561601 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:51.561274    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:51.561601 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:51.561398    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:51.822968 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.822935    2561 generic.go:356] "Generic (PLEG): container finished" podID="79fb69cd-51f8-4f35-bddd-5494fff1d8f5" containerID="120a340bcd83d82bb61fc93bc352c93c4d3534ef727590fda8abf7b3df1cdb76" exitCode=0
Jul 23 19:20:51.823128 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.823025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" event={"ID":"79fb69cd-51f8-4f35-bddd-5494fff1d8f5","Type":"ContainerDied","Data":"120a340bcd83d82bb61fc93bc352c93c4d3534ef727590fda8abf7b3df1cdb76"}
Jul 23 19:20:51.826792 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.826775    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:20:51.827132 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.827103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" event={"ID":"ac059306-3195-4a9c-ae47-6a492fd56822","Type":"ContainerStarted","Data":"2bdba0ff04726b1ec9ba0b65f7981679dcfe3f2180b1aae80e02c0091168afa4"}
Jul 23 19:20:51.827333 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.827319    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:51.827414 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.827401    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:51.843269 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.843244    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:20:51.879422 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:51.879369    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r" podStartSLOduration=10.801953759 podStartE2EDuration="29.879333797s" totalImagesPullingTime="19.077380038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:51.877927147 +0000 UTC m=+29.811987294" watchObservedRunningTime="2026-07-23 19:20:51.879333797 +0000 UTC m=+29.813393966"
Jul 23 19:20:52.561620 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:52.561584    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:52.562017 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:52.561675    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:52.831198 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:52.831168    2561 generic.go:356] "Generic (PLEG): container finished" podID="79fb69cd-51f8-4f35-bddd-5494fff1d8f5" containerID="cd68910eebc154ed1b64d11740d377a58d0e19aefc4273724c9e320cd45e5768" exitCode=0
Jul 23 19:20:52.831368 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:52.831254    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" event={"ID":"79fb69cd-51f8-4f35-bddd-5494fff1d8f5","Type":"ContainerDied","Data":"cd68910eebc154ed1b64d11740d377a58d0e19aefc4273724c9e320cd45e5768"}
Jul 23 19:20:52.859401 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:52.859343    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:52.915705 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:52.915673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:53.560480 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:53.560442    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:53.560648 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:53.560442    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:53.560648 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:53.560538    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:53.560648 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:53.560635    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:54.561539 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:54.561512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:54.561902 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:54.561613    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:55.560920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:55.560881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:55.561207 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:55.560927    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:55.561207 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:55.561019    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:55.561207 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:55.561139    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:56.277873 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:56.277836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:56.277873 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:56.277873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:56.277905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.278016    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.278117    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret podName:25ec972a-8ec2-4b87-bd61-db6172fa0330 nodeName:}" failed. No retries permitted until 2026-07-23 19:21:28.278075849 +0000 UTC m=+66.212135976 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret") pod "global-pull-secret-syncer-5w2l7" (UID: "25ec972a-8ec2-4b87-bd61-db6172fa0330") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.278017    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.278153    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.278016    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.278170    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzq9w for pod openshift-network-diagnostics/network-check-target-92hfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.278212    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs podName:33f43323-a317-4b7b-a8a8-607c51d8f076 nodeName:}" failed. No retries permitted until 2026-07-23 19:21:28.278194619 +0000 UTC m=+66.212254759 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs") pod "network-metrics-daemon-kfswv" (UID: "33f43323-a317-4b7b-a8a8-607c51d8f076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:56.278344 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.278232    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w podName:dce479a7-1b18-4353-942d-258cbcb34c46 nodeName:}" failed. No retries permitted until 2026-07-23 19:21:28.278221646 +0000 UTC m=+66.212281776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzq9w" (UniqueName: "kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w") pod "network-check-target-92hfr" (UID: "dce479a7-1b18-4353-942d-258cbcb34c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:56.561434 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:56.561149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:56.561596 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:56.561495    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:56.830989 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:56.830894    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:56.925937 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:56.925897    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:57.016926 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.016885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:57.115836 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.115748    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:57.234664 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.234390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:57.311172 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.311139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:57.412165 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.412050    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:57.561503 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.561472    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:57.561673 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:57.561594    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:57.561952 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.561930    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:57.562067 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:57.562007    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:57.780888 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.780845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:57.832714 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:57.832671    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:58.185824 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.185795    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5w2l7"]
Jul 23 19:20:58.185991 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.185950    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:58.186068 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.186006    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:58.186068 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:58.186049    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:58.188649 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.188618    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-92hfr"]
Jul 23 19:20:58.188765 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.188743    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:58.188873 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:58.188855    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:58.192680 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.192658    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kfswv"]
Jul 23 19:20:58.192815 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.192766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:58.192884 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:58.192863    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:58.282837 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.282798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:58.572579 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.572552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:58.680492 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.680461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:58.793961 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.793925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:58.850241 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.850203    2561 generic.go:356] "Generic (PLEG): container finished" podID="79fb69cd-51f8-4f35-bddd-5494fff1d8f5" containerID="dc7ebbab880ae6c8c7de6757bbbd0f121bfee1ab3e77c3e9dece5ca53705d6d2" exitCode=0
Jul 23 19:20:58.850446 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.850268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" event={"ID":"79fb69cd-51f8-4f35-bddd-5494fff1d8f5","Type":"ContainerDied","Data":"dc7ebbab880ae6c8c7de6757bbbd0f121bfee1ab3e77c3e9dece5ca53705d6d2"}
Jul 23 19:20:58.989640 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:58.989597    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:20:59.560784 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:59.560755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:20:59.560960 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:59.560755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:20:59.561005 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:59.560957    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:20:59.561005 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:59.560858    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:20:59.561005 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:59.560755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:20:59.561094 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:20:59.561049    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:20:59.855465 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:59.855381    2561 generic.go:356] "Generic (PLEG): container finished" podID="79fb69cd-51f8-4f35-bddd-5494fff1d8f5" containerID="58d33aa3f6a7cf6f08427b91eabeda0437f0d24013767c6524ff4b62d50e805a" exitCode=0
Jul 23 19:20:59.855949 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:59.855466    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" event={"ID":"79fb69cd-51f8-4f35-bddd-5494fff1d8f5","Type":"ContainerDied","Data":"58d33aa3f6a7cf6f08427b91eabeda0437f0d24013767c6524ff4b62d50e805a"}
Jul 23 19:20:59.987044 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:20:59.986869    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:00.043567 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:00.043514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:00.217058 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:00.217008    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:00.287864 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:00.287804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:00.861825 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:00.861791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" event={"ID":"79fb69cd-51f8-4f35-bddd-5494fff1d8f5","Type":"ContainerStarted","Data":"ab087113c02b134ea8405ecff71a50ac80499655e51d579b0ed99a30d3ce8705"}
Jul 23 19:21:00.886944 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:00.886885    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s8p2g" podStartSLOduration=8.779072435 podStartE2EDuration="38.886867205s" totalImagesPullingTime="30.10779477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:00.886416854 +0000 UTC m=+38.820477010" watchObservedRunningTime="2026-07-23 19:21:00.886867205 +0000 UTC m=+38.820927352"
Jul 23 19:21:01.010215 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:01.010182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:01.072413 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:01.072349    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:01.561464 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:01.561426    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:21:01.561464 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:01.561458    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:21:01.561717 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:01.561458    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:21:01.561717 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:01.561556    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfswv" podUID="33f43323-a317-4b7b-a8a8-607c51d8f076"
Jul 23 19:21:01.561717 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:01.561613    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5w2l7" podUID="25ec972a-8ec2-4b87-bd61-db6172fa0330"
Jul 23 19:21:01.561717 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:01.561685    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92hfr" podUID="dce479a7-1b18-4353-942d-258cbcb34c46"
Jul 23 19:21:02.891898 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.891870    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-62.ec2.internal" event="NodeReady"
Jul 23 19:21:02.892267 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.891988    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 19:21:02.947362 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.947315    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r8x62"]
Jul 23 19:21:02.982811 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.982782    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fmd89"]
Jul 23 19:21:02.982963 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.982900    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:02.985918 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.985892    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 19:21:02.986078 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.986061    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 19:21:02.986162 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.986147    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j4csw\""
Jul 23 19:21:02.996722 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.996705    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r8x62"]
Jul 23 19:21:02.996802 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.996734    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fmd89"]
Jul 23 19:21:02.996837 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.996822    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:02.999948 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:02.999929    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 19:21:03.000186 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.000136    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 19:21:03.000186 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.000165    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 19:21:03.000186 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.000172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v89gs\""
Jul 23 19:21:03.000379 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.000164    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 19:21:03.049883 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.049854    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f8dlm"]
Jul 23 19:21:03.077768 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.077742    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f8dlm"]
Jul 23 19:21:03.077905 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.077832    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f8dlm"
Jul 23 19:21:03.081680 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.081645    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n4phc\""
Jul 23 19:21:03.081680 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.081680    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 19:21:03.081879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.081691    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 19:21:03.081879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.081649    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 19:21:03.117765 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.117737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:03.128586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a09c36-1cb6-4144-a627-f0233c2cb178-metrics-tls\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.128586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/927e4654-6ce8-458f-954d-fc476a7c733f-crio-socket\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.128770 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrzvs\" (UniqueName: \"kubernetes.io/projected/927e4654-6ce8-458f-954d-fc476a7c733f-kube-api-access-lrzvs\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.128770 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128679    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927e4654-6ce8-458f-954d-fc476a7c733f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.128770 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20a09c36-1cb6-4144-a627-f0233c2cb178-config-volume\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.128770 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a09c36-1cb6-4144-a627-f0233c2cb178-tmp-dir\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.128770 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/927e4654-6ce8-458f-954d-fc476a7c733f-data-volume\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.128916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7n2w\" (UniqueName: \"kubernetes.io/projected/20a09c36-1cb6-4144-a627-f0233c2cb178-kube-api-access-q7n2w\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.128916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.128792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927e4654-6ce8-458f-954d-fc476a7c733f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.216267 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.216234    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:03.229818 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.229787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrzvs\" (UniqueName: \"kubernetes.io/projected/927e4654-6ce8-458f-954d-fc476a7c733f-kube-api-access-lrzvs\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.229995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.229825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fn8g\" (UniqueName: \"kubernetes.io/projected/c2296a13-9ecc-427d-b868-d885b41a86d6-kube-api-access-6fn8g\") pod \"ingress-canary-f8dlm\" (UID: \"c2296a13-9ecc-427d-b868-d885b41a86d6\") " pod="openshift-ingress-canary/ingress-canary-f8dlm"
Jul 23 19:21:03.229995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.229850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927e4654-6ce8-458f-954d-fc476a7c733f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.229995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.229883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20a09c36-1cb6-4144-a627-f0233c2cb178-config-volume\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.229995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.229904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a09c36-1cb6-4144-a627-f0233c2cb178-tmp-dir\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.229995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.229921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/927e4654-6ce8-458f-954d-fc476a7c733f-data-volume\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.229995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.229945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7n2w\" (UniqueName: \"kubernetes.io/projected/20a09c36-1cb6-4144-a627-f0233c2cb178-kube-api-access-q7n2w\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.229995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.229972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927e4654-6ce8-458f-954d-fc476a7c733f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.230337 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.230007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a09c36-1cb6-4144-a627-f0233c2cb178-metrics-tls\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.230337 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.230036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/927e4654-6ce8-458f-954d-fc476a7c733f-crio-socket\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.230337 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.230077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2296a13-9ecc-427d-b868-d885b41a86d6-cert\") pod \"ingress-canary-f8dlm\" (UID: \"c2296a13-9ecc-427d-b868-d885b41a86d6\") " pod="openshift-ingress-canary/ingress-canary-f8dlm"
Jul 23 19:21:03.230522 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.230344    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/927e4654-6ce8-458f-954d-fc476a7c733f-data-volume\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.230522 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.230374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/927e4654-6ce8-458f-954d-fc476a7c733f-crio-socket\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.230658 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.230634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927e4654-6ce8-458f-954d-fc476a7c733f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.230658 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.230652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20a09c36-1cb6-4144-a627-f0233c2cb178-config-volume\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.230827 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.230803    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a09c36-1cb6-4144-a627-f0233c2cb178-tmp-dir\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.234333 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.234311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a09c36-1cb6-4144-a627-f0233c2cb178-metrics-tls\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.234440 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.234330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927e4654-6ce8-458f-954d-fc476a7c733f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.245830 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.245802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrzvs\" (UniqueName: \"kubernetes.io/projected/927e4654-6ce8-458f-954d-fc476a7c733f-kube-api-access-lrzvs\") pod \"insights-runtime-extractor-fmd89\" (UID: \"927e4654-6ce8-458f-954d-fc476a7c733f\") " pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.245927 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.245881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7n2w\" (UniqueName: \"kubernetes.io/projected/20a09c36-1cb6-4144-a627-f0233c2cb178-kube-api-access-q7n2w\") pod \"dns-default-r8x62\" (UID: \"20a09c36-1cb6-4144-a627-f0233c2cb178\") " pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.291866 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.291829    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:03.304993 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.304969    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fmd89"
Jul 23 19:21:03.313315 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.313161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:03.331195 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.331168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2296a13-9ecc-427d-b868-d885b41a86d6-cert\") pod \"ingress-canary-f8dlm\" (UID: \"c2296a13-9ecc-427d-b868-d885b41a86d6\") " pod="openshift-ingress-canary/ingress-canary-f8dlm"
Jul 23 19:21:03.331322 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.331222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fn8g\" (UniqueName: \"kubernetes.io/projected/c2296a13-9ecc-427d-b868-d885b41a86d6-kube-api-access-6fn8g\") pod \"ingress-canary-f8dlm\" (UID: \"c2296a13-9ecc-427d-b868-d885b41a86d6\") " pod="openshift-ingress-canary/ingress-canary-f8dlm"
Jul 23 19:21:03.333665 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.333641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2296a13-9ecc-427d-b868-d885b41a86d6-cert\") pod \"ingress-canary-f8dlm\" (UID: \"c2296a13-9ecc-427d-b868-d885b41a86d6\") " pod="openshift-ingress-canary/ingress-canary-f8dlm"
Jul 23 19:21:03.341524 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.341496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fn8g\" (UniqueName: \"kubernetes.io/projected/c2296a13-9ecc-427d-b868-d885b41a86d6-kube-api-access-6fn8g\") pod \"ingress-canary-f8dlm\" (UID: \"c2296a13-9ecc-427d-b868-d885b41a86d6\") " pod="openshift-ingress-canary/ingress-canary-f8dlm"
Jul 23 19:21:03.388528 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.388481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f8dlm"
Jul 23 19:21:03.479522 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.479232    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fmd89"]
Jul 23 19:21:03.483243 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:03.483218    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927e4654_6ce8_458f_954d_fc476a7c733f.slice/crio-26d2bdf547b39b79e98a1531160a24000bc07cd07324a140b04baafa1abe2588 WatchSource:0}: Error finding container 26d2bdf547b39b79e98a1531160a24000bc07cd07324a140b04baafa1abe2588: Status 404 returned error can't find the container with id 26d2bdf547b39b79e98a1531160a24000bc07cd07324a140b04baafa1abe2588
Jul 23 19:21:03.501286 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:03.497979    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a09c36_1cb6_4144_a627_f0233c2cb178.slice/crio-78ddfd073fc65f1b15fcbe4cd6a95ba4ce16c3f5b3936608ed056ddd66e26267 WatchSource:0}: Error finding container 78ddfd073fc65f1b15fcbe4cd6a95ba4ce16c3f5b3936608ed056ddd66e26267: Status 404 returned error can't find the container with id 78ddfd073fc65f1b15fcbe4cd6a95ba4ce16c3f5b3936608ed056ddd66e26267
Jul 23 19:21:03.501286 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.498305    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r8x62"]
Jul 23 19:21:03.540457 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.540423    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f8dlm"]
Jul 23 19:21:03.543601 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:03.543577    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2296a13_9ecc_427d_b868_d885b41a86d6.slice/crio-c45c710d5a9aad35ede54b1cb0b2137495c6d58f24db1ce6c6e81e40111eda09 WatchSource:0}: Error finding container c45c710d5a9aad35ede54b1cb0b2137495c6d58f24db1ce6c6e81e40111eda09: Status 404 returned error can't find the container with id c45c710d5a9aad35ede54b1cb0b2137495c6d58f24db1ce6c6e81e40111eda09
Jul 23 19:21:03.561068 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.561038    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:21:03.561153 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.561087    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:21:03.561198 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.561180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:21:03.564249 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.564231    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 19:21:03.564450 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.564424    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 19:21:03.564592 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.564577    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 19:21:03.564639 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.564609    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9qhx\""
Jul 23 19:21:03.564788 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.564767    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k9tbr\""
Jul 23 19:21:03.565243 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.565230    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 19:21:03.869297 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.869206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f8dlm" event={"ID":"c2296a13-9ecc-427d-b868-d885b41a86d6","Type":"ContainerStarted","Data":"c45c710d5a9aad35ede54b1cb0b2137495c6d58f24db1ce6c6e81e40111eda09"}
Jul 23 19:21:03.870257 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.870229    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmd89" event={"ID":"927e4654-6ce8-458f-954d-fc476a7c733f","Type":"ContainerStarted","Data":"26d2bdf547b39b79e98a1531160a24000bc07cd07324a140b04baafa1abe2588"}
Jul 23 19:21:03.871293 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:03.871274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8x62" event={"ID":"20a09c36-1cb6-4144-a627-f0233c2cb178","Type":"ContainerStarted","Data":"78ddfd073fc65f1b15fcbe4cd6a95ba4ce16c3f5b3936608ed056ddd66e26267"}
Jul 23 19:21:04.610812 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.610736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:04.712417 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.712384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:04.784991 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.784078    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"]
Jul 23 19:21:04.800744 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.800688    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"]
Jul 23 19:21:04.800921 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.800817    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"
Jul 23 19:21:04.802141 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.802084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:04.804594 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.804390    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 19:21:04.806767 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.806380    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d9bdp\""
Jul 23 19:21:04.942811 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:04.942663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8b1a7828-d189-4eb4-b370-3b6671cdbb71-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lgm62\" (UID: \"8b1a7828-d189-4eb4-b370-3b6671cdbb71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"
Jul 23 19:21:05.043938 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:05.043530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8b1a7828-d189-4eb4-b370-3b6671cdbb71-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lgm62\" (UID: \"8b1a7828-d189-4eb4-b370-3b6671cdbb71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"
Jul 23 19:21:05.043938 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:05.043685    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 19:21:05.043938 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:05.043748    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1a7828-d189-4eb4-b370-3b6671cdbb71-tls-certificates podName:8b1a7828-d189-4eb4-b370-3b6671cdbb71 nodeName:}" failed. No retries permitted until 2026-07-23 19:21:05.543732475 +0000 UTC m=+43.477792619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8b1a7828-d189-4eb4-b370-3b6671cdbb71-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-lgm62" (UID: "8b1a7828-d189-4eb4-b370-3b6671cdbb71") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 19:21:05.324082 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:05.324016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:05.421203 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:05.421161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:05.522067 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:05.522023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:05.547216 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:05.547174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8b1a7828-d189-4eb4-b370-3b6671cdbb71-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lgm62\" (UID: \"8b1a7828-d189-4eb4-b370-3b6671cdbb71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"
Jul 23 19:21:05.550420 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:05.550389    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8b1a7828-d189-4eb4-b370-3b6671cdbb71-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lgm62\" (UID: \"8b1a7828-d189-4eb4-b370-3b6671cdbb71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"
Jul 23 19:21:05.715242 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:05.715205    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"
Jul 23 19:21:07.428190 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.428150    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64cb5d69d9-s4m7h"]
Jul 23 19:21:07.445406 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.445335    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64cb5d69d9-s4m7h"]
Jul 23 19:21:07.445652 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.445505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.451956 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.448339    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2g486\""
Jul 23 19:21:07.451956 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.448339    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 19:21:07.451956 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.449272    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 19:21:07.451956 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.449507    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 19:21:07.452866 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.452843    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 19:21:07.453273 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.453253    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 19:21:07.453447 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.453428    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 19:21:07.453532 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.453516    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 19:21:07.562852 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.562815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-config\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.562852 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.562865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-serving-cert\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.563085 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.562894    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-oauth-config\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.563085 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.562913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-oauth-serving-cert\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.563085 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.562977    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6ltk\" (UniqueName: \"kubernetes.io/projected/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-kube-api-access-x6ltk\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.563085 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.563040    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-service-ca\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.664182 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.664140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-config\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.664368 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.664188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-serving-cert\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.664368 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.664221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-oauth-config\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.664368 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.664286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-oauth-serving-cert\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.664368 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.664341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6ltk\" (UniqueName: \"kubernetes.io/projected/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-kube-api-access-x6ltk\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.664561 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.664405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-service-ca\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.664970 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.664946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-oauth-serving-cert\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.665087 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.664952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-config\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.665087 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.665059    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-service-ca\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.667257 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.667237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-oauth-config\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.667392 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.667301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-serving-cert\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.674032 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.674011    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6ltk\" (UniqueName: \"kubernetes.io/projected/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-kube-api-access-x6ltk\") pod \"console-64cb5d69d9-s4m7h\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") " pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:07.761055 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:07.760826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:10.387900 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.387860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:10.449115 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.449068    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:10.720748 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.720725    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64cb5d69d9-s4m7h"]
Jul 23 19:21:10.734476 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.734446    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"]
Jul 23 19:21:10.850630 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:10.850592    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d241f9_c4a0_4cee_9fbb_8f7f602ff2e9.slice/crio-b2d0dbdc615e4f39530c085e708f4da1c10332c0b7b0b263b086a770dfd83f1d WatchSource:0}: Error finding container b2d0dbdc615e4f39530c085e708f4da1c10332c0b7b0b263b086a770dfd83f1d: Status 404 returned error can't find the container with id b2d0dbdc615e4f39530c085e708f4da1c10332c0b7b0b263b086a770dfd83f1d
Jul 23 19:21:10.850990 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:10.850954    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1a7828_d189_4eb4_b370_3b6671cdbb71.slice/crio-4c71df9a8c09e73b23b32744bce7a08d2b1d9806bf5be7764040b7e191918ebc WatchSource:0}: Error finding container 4c71df9a8c09e73b23b32744bce7a08d2b1d9806bf5be7764040b7e191918ebc: Status 404 returned error can't find the container with id 4c71df9a8c09e73b23b32744bce7a08d2b1d9806bf5be7764040b7e191918ebc
Jul 23 19:21:10.894293 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.894220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f8dlm" event={"ID":"c2296a13-9ecc-427d-b868-d885b41a86d6","Type":"ContainerStarted","Data":"0ad10dea672099644e8d346130679423f2b26412ec25fc2ea5669364c234b3c6"}
Jul 23 19:21:10.896023 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.895977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8x62" event={"ID":"20a09c36-1cb6-4144-a627-f0233c2cb178","Type":"ContainerStarted","Data":"f01f1579ebced9a1143979505495c6d875d102850d88e47a9e0150bb234d44e8"}
Jul 23 19:21:10.897755 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.897730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cb5d69d9-s4m7h" event={"ID":"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9","Type":"ContainerStarted","Data":"b2d0dbdc615e4f39530c085e708f4da1c10332c0b7b0b263b086a770dfd83f1d"}
Jul 23 19:21:10.899128 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.899102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62" event={"ID":"8b1a7828-d189-4eb4-b370-3b6671cdbb71","Type":"ContainerStarted","Data":"4c71df9a8c09e73b23b32744bce7a08d2b1d9806bf5be7764040b7e191918ebc"}
Jul 23 19:21:10.924859 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:10.924809    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f8dlm" podStartSLOduration=0.898972446 podStartE2EDuration="7.924786231s" totalImagesPullingTime="7.025813785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:10.924473044 +0000 UTC m=+48.858533191" watchObservedRunningTime="2026-07-23 19:21:10.924786231 +0000 UTC m=+48.858846378"
Jul 23 19:21:11.905449 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:11.905409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8x62" event={"ID":"20a09c36-1cb6-4144-a627-f0233c2cb178","Type":"ContainerStarted","Data":"5ff360b0581c292077e052598f734c7814f2b0e1a52523e290b4f9770c64db6a"}
Jul 23 19:21:11.906326 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:11.906301    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:11.908958 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:11.908926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmd89" event={"ID":"927e4654-6ce8-458f-954d-fc476a7c733f","Type":"ContainerStarted","Data":"05274b67fd0b760d1426cd937e0a9fa651efa7148f80f6ef75f3867f11e77cf6"}
Jul 23 19:21:11.924941 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:11.924552    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r8x62" podStartSLOduration=2.855888113 podStartE2EDuration="9.924529394s" totalImagesPullingTime="7.068641281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:11.923429002 +0000 UTC m=+49.857489150" watchObservedRunningTime="2026-07-23 19:21:11.924529394 +0000 UTC m=+49.858589542"
Jul 23 19:21:12.170664 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.170520    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:12.232826 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.232781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:12.439808 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.438643    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bc87d868d-5b8w8"]
Jul 23 19:21:12.441536 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.441502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:12.453516 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.452972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.455409 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.455382    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc87d868d-5b8w8"]
Jul 23 19:21:12.463112 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.463085    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 19:21:12.503045 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.503006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-serving-cert\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.503233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.503062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-oauth-config\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.503233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.503089    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-console-config\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.503233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.503126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-service-ca\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.503233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.503142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7spvm\" (UniqueName: \"kubernetes.io/projected/42e375e5-395e-41a3-bdcc-771eb25d418f-kube-api-access-7spvm\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.503233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.503200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-oauth-serving-cert\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.503233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.503228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-trusted-ca-bundle\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.510301 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.510265    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.603894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-service-ca\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.603949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7spvm\" (UniqueName: \"kubernetes.io/projected/42e375e5-395e-41a3-bdcc-771eb25d418f-kube-api-access-7spvm\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.604022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-oauth-serving-cert\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.604054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-trusted-ca-bundle\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.604110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-serving-cert\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.604141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-oauth-config\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.604156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-console-config\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.604770    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-service-ca\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.604879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.604833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-console-config\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.605323 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.605175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-trusted-ca-bundle\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.605991 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.605960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-oauth-serving-cert\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.608435 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.608412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-oauth-config\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.608905 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.608887    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-serving-cert\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.613815 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.613772    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7spvm\" (UniqueName: \"kubernetes.io/projected/42e375e5-395e-41a3-bdcc-771eb25d418f-kube-api-access-7spvm\") pod \"console-bc87d868d-5b8w8\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") " pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:12.771071 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:12.771027    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:13.041060 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:13.040984    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc87d868d-5b8w8"]
Jul 23 19:21:13.044346 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:13.044321    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e375e5_395e_41a3_bdcc_771eb25d418f.slice/crio-bc7736906e68384a74cb9d8c06d5cc5376459ec7f4d39f62fb0aa6f7d426cc84 WatchSource:0}: Error finding container bc7736906e68384a74cb9d8c06d5cc5376459ec7f4d39f62fb0aa6f7d426cc84: Status 404 returned error can't find the container with id bc7736906e68384a74cb9d8c06d5cc5376459ec7f4d39f62fb0aa6f7d426cc84
Jul 23 19:21:13.059431 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:13.059404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:13.137026 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:13.136986    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:13.915782 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:13.915732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc87d868d-5b8w8" event={"ID":"42e375e5-395e-41a3-bdcc-771eb25d418f","Type":"ContainerStarted","Data":"bc7736906e68384a74cb9d8c06d5cc5376459ec7f4d39f62fb0aa6f7d426cc84"}
Jul 23 19:21:14.036194 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:14.036134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:14.135971 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:14.135934    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:16.928373 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:16.928314    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmd89" event={"ID":"927e4654-6ce8-458f-954d-fc476a7c733f","Type":"ContainerStarted","Data":"1ae53ea82f20fc9c9a3bdb645a950beeb91aa87661dc4b31e7e2bbc4b141daa8"}
Jul 23 19:21:16.930083 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:16.930052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cb5d69d9-s4m7h" event={"ID":"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9","Type":"ContainerStarted","Data":"82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d"}
Jul 23 19:21:16.932025 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:16.931998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62" event={"ID":"8b1a7828-d189-4eb4-b370-3b6671cdbb71","Type":"ContainerStarted","Data":"b34815910a970657268ffa1433b2c5d99c05ed861eba8ef89e608ed5bb105c2a"}
Jul 23 19:21:16.932170 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:16.932155    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"
Jul 23 19:21:16.933865 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:16.933841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc87d868d-5b8w8" event={"ID":"42e375e5-395e-41a3-bdcc-771eb25d418f","Type":"ContainerStarted","Data":"0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f"}
Jul 23 19:21:16.938055 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:16.938036    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62"
Jul 23 19:21:16.960685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:16.960641    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64cb5d69d9-s4m7h" podStartSLOduration=4.067266188 podStartE2EDuration="9.960626853s" totalImagesPullingTime="5.893360665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:16.960073355 +0000 UTC m=+54.894133503" watchObservedRunningTime="2026-07-23 19:21:16.960626853 +0000 UTC m=+54.894687000"
Jul 23 19:21:16.984144 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:16.981127    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bc87d868d-5b8w8" podStartSLOduration=1.3990234959999999 podStartE2EDuration="4.981107068s" totalImagesPullingTime="3.582083572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:16.97963554 +0000 UTC m=+54.913695688" watchObservedRunningTime="2026-07-23 19:21:16.981107068 +0000 UTC m=+54.915167404"
Jul 23 19:21:17.761729 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.761691    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:17.761994 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.761793    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:17.768927 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.768860    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:17.790298 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.790237    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lgm62" podStartSLOduration=7.916337713 podStartE2EDuration="13.790216845s" totalImagesPullingTime="5.873879132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:17.007503711 +0000 UTC m=+54.941563857" watchObservedRunningTime="2026-07-23 19:21:17.790216845 +0000 UTC m=+55.724276993"
Jul 23 19:21:17.831874 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.831816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:17.917013 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.916980    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"]
Jul 23 19:21:17.919169 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.919149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:17.927512 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.927489    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 19:21:17.927626 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.927549    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 19:21:17.927921 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.927906    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 19:21:17.929267 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.928641    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jqflc\""
Jul 23 19:21:17.929267 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.928672    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 19:21:17.929267 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.928796    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 19:21:17.937580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.937551    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"]
Jul 23 19:21:17.942573 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.942549    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:17.949906 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.949882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:17.950033 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.949928    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:17.950033 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.950018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca948e0-e798-4183-9797-cc8facd75bb1-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:17.950137 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.950066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjnx\" (UniqueName: \"kubernetes.io/projected/1ca948e0-e798-4183-9797-cc8facd75bb1-kube-api-access-svjnx\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:17.972288 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:17.972257    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:18.051088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.051001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca948e0-e798-4183-9797-cc8facd75bb1-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.051240 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.051102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjnx\" (UniqueName: \"kubernetes.io/projected/1ca948e0-e798-4183-9797-cc8facd75bb1-kube-api-access-svjnx\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.051240 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.051190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.051332 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.051278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.051953 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.051918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca948e0-e798-4183-9797-cc8facd75bb1-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.052765 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:18.052413    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 23 19:21:18.052765 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:18.052547    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-tls podName:1ca948e0-e798-4183-9797-cc8facd75bb1 nodeName:}" failed. No retries permitted until 2026-07-23 19:21:18.552527518 +0000 UTC m=+56.486587656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-bjbhq" (UID: "1ca948e0-e798-4183-9797-cc8facd75bb1") : secret "prometheus-operator-tls" not found
Jul 23 19:21:18.054837 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.054813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.065407 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.065380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjnx\" (UniqueName: \"kubernetes.io/projected/1ca948e0-e798-4183-9797-cc8facd75bb1-kube-api-access-svjnx\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.558220 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.558181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.561026 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.561001    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ca948e0-e798-4183-9797-cc8facd75bb1-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-bjbhq\" (UID: \"1ca948e0-e798-4183-9797-cc8facd75bb1\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:18.620715 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.620679    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:18.756394 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.756342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:18.830412 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:18.830319    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"
Jul 23 19:21:19.658922 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:19.658872    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:19.736056 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:19.736003    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:20.112304 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:20.112268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:20.181703 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:20.181669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:20.252198 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:20.252171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:20.281725 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:20.281700    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq"]
Jul 23 19:21:20.284580 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:20.284553    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca948e0_e798_4183_9797_cc8facd75bb1.slice/crio-2250b34b1cadbdd9d163cd10016d4b58a33b4710b923a6b92e4c7e0a694a949e WatchSource:0}: Error finding container 2250b34b1cadbdd9d163cd10016d4b58a33b4710b923a6b92e4c7e0a694a949e: Status 404 returned error can't find the container with id 2250b34b1cadbdd9d163cd10016d4b58a33b4710b923a6b92e4c7e0a694a949e
Jul 23 19:21:20.951857 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:20.951818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmd89" event={"ID":"927e4654-6ce8-458f-954d-fc476a7c733f","Type":"ContainerStarted","Data":"eee3e5976e39e287e5225ab434bdd5d9fcbc070a913ca50d399cdcc7aed4d15e"}
Jul 23 19:21:20.953166 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:20.953124    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq" event={"ID":"1ca948e0-e798-4183-9797-cc8facd75bb1","Type":"ContainerStarted","Data":"2250b34b1cadbdd9d163cd10016d4b58a33b4710b923a6b92e4c7e0a694a949e"}
Jul 23 19:21:20.972045 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:20.971966    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fmd89" podStartSLOduration=2.459744855 podStartE2EDuration="18.971944472s" totalImagesPullingTime="16.512199617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:21:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:20.96985398 +0000 UTC m=+58.903914128" watchObservedRunningTime="2026-07-23 19:21:20.971944472 +0000 UTC m=+58.906004613"
Jul 23 19:21:22.343887 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.343812    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:22.771644 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.771597    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:22.771828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.771687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:22.776393 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.776341    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:22.917890 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.917857    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r8x62"
Jul 23 19:21:22.963602 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.963557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq" event={"ID":"1ca948e0-e798-4183-9797-cc8facd75bb1","Type":"ContainerStarted","Data":"5620a220e027a2e4f57d6ed763b5b6b8359362df7ffe5e3f8f65bfe030ad1fd7"}
Jul 23 19:21:22.963754 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.963626    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq" event={"ID":"1ca948e0-e798-4183-9797-cc8facd75bb1","Type":"ContainerStarted","Data":"34a3ed47f2c0550096b6a0755a6b2341e80721fc0fea54ff0442aadbc80e8413"}
Jul 23 19:21:22.967950 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.967924    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:21:22.986081 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:22.986025    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bjbhq" podStartSLOduration=4.251364607 podStartE2EDuration="5.986008386s" totalImagesPullingTime="1.734643779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:22.985426953 +0000 UTC m=+60.919487100" watchObservedRunningTime="2026-07-23 19:21:22.986008386 +0000 UTC m=+60.920068533"
Jul 23 19:21:23.039270 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:23.039192    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64cb5d69d9-s4m7h"]
Jul 23 19:21:23.846043 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:23.846013    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbv2r"
Jul 23 19:21:23.971310 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:23.971273    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:24.071765 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:24.071726    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:24.826534 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:24.826473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:24.898335 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:24.898305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:25.036284 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.036249    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:25.277676 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.277644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:25.435481 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.435451    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:25.448796 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.448768    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"]
Jul 23 19:21:25.451341 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.451326    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.455610 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.455582    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"]
Jul 23 19:21:25.455720 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.455627    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 19:21:25.456163 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.456144    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 19:21:25.456163 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.456158    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ng2w5\""
Jul 23 19:21:25.457840 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.457540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.459809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.459793    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 23 19:21:25.462172 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.462156    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gs6ct\""
Jul 23 19:21:25.463084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.463062    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 23 19:21:25.463084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.463064    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 23 19:21:25.472102 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.472078    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"]
Jul 23 19:21:25.474180 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.474158    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"]
Jul 23 19:21:25.515461 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qww8d\" (UniqueName: \"kubernetes.io/projected/2612821d-a8f2-4303-9dd7-ac3855eefe54-kube-api-access-qww8d\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.515651 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.515651 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.515651 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b086f44-dd8c-42ab-9802-a616b6927a43-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.515651 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0b086f44-dd8c-42ab-9802-a616b6927a43-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.515651 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.515806 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2612821d-a8f2-4303-9dd7-ac3855eefe54-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.515806 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2hxw\" (UniqueName: \"kubernetes.io/projected/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-api-access-x2hxw\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.515806 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.515806 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.515746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.521505 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.521480    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-95nvf"]
Jul 23 19:21:25.524197 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.524182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.528802 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.528746    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 19:21:25.528926 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.528838    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q9wn7\""
Jul 23 19:21:25.529450 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.529432    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 19:21:25.530746 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.530729    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 19:21:25.586271 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.586235    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:25.616875 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.616844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-root\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617029 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.616880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017e3b4d-82e2-4db9-9095-f212a69cf50c-metrics-client-ca\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617029 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.616900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-textfile\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617029 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.616933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.617029 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.616978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.617233 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:25.617070    2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 23 19:21:25.617233 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:25.617133    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-tls podName:2612821d-a8f2-4303-9dd7-ac3855eefe54 nodeName:}" failed. No retries permitted until 2026-07-23 19:21:26.117112157 +0000 UTC m=+64.051172281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-4p8wc" (UID: "2612821d-a8f2-4303-9dd7-ac3855eefe54") : secret "openshift-state-metrics-tls" not found
Jul 23 19:21:25.617233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617070    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b086f44-dd8c-42ab-9802-a616b6927a43-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.617233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0b086f44-dd8c-42ab-9802-a616b6927a43-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.617233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.617488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2612821d-a8f2-4303-9dd7-ac3855eefe54-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.617488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2hxw\" (UniqueName: \"kubernetes.io/projected/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-api-access-x2hxw\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.617488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-sys\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-tls\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.617488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.617488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-wtmp\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94zc7\" (UniqueName: \"kubernetes.io/projected/017e3b4d-82e2-4db9-9095-f212a69cf50c-kube-api-access-94zc7\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0b086f44-dd8c-42ab-9802-a616b6927a43-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.617843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.617843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qww8d\" (UniqueName: \"kubernetes.io/projected/2612821d-a8f2-4303-9dd7-ac3855eefe54-kube-api-access-qww8d\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.617843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.617826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b086f44-dd8c-42ab-9802-a616b6927a43-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.618104 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.618005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.618104 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.618037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2612821d-a8f2-4303-9dd7-ac3855eefe54-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.619960 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.619940    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.620068 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.619966    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.620068 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.620025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.636712 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.636684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2hxw\" (UniqueName: \"kubernetes.io/projected/0b086f44-dd8c-42ab-9802-a616b6927a43-kube-api-access-x2hxw\") pod \"kube-state-metrics-56c5594674-2k8kl\" (UID: \"0b086f44-dd8c-42ab-9802-a616b6927a43\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.637925 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.637902    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qww8d\" (UniqueName: \"kubernetes.io/projected/2612821d-a8f2-4303-9dd7-ac3855eefe54-kube-api-access-qww8d\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:25.677698 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.677671    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:25.719056 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-wtmp\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719056 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719296 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94zc7\" (UniqueName: \"kubernetes.io/projected/017e3b4d-82e2-4db9-9095-f212a69cf50c-kube-api-access-94zc7\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719296 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719296 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719225    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-wtmp\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719296 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-root\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017e3b4d-82e2-4db9-9095-f212a69cf50c-metrics-client-ca\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-textfile\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-root\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-sys\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017e3b4d-82e2-4db9-9095-f212a69cf50c-sys\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719771 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-tls\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719771 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-textfile\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719868 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.719934 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.719910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017e3b4d-82e2-4db9-9095-f212a69cf50c-metrics-client-ca\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.724987 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.724960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.725124 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.724993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/017e3b4d-82e2-4db9-9095-f212a69cf50c-node-exporter-tls\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.732000 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.731982    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94zc7\" (UniqueName: \"kubernetes.io/projected/017e3b4d-82e2-4db9-9095-f212a69cf50c-kube-api-access-94zc7\") pod \"node-exporter-95nvf\" (UID: \"017e3b4d-82e2-4db9-9095-f212a69cf50c\") " pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.767058 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.767034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"
Jul 23 19:21:25.794951 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.794877    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:25.833032 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.833003    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95nvf"
Jul 23 19:21:25.843431 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:25.843404    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017e3b4d_82e2_4db9_9095_f212a69cf50c.slice/crio-391babcc260534f1551bd038b0b5a35f58585fa1b932a1ca58fb00d44fb9a343 WatchSource:0}: Error finding container 391babcc260534f1551bd038b0b5a35f58585fa1b932a1ca58fb00d44fb9a343: Status 404 returned error can't find the container with id 391babcc260534f1551bd038b0b5a35f58585fa1b932a1ca58fb00d44fb9a343
Jul 23 19:21:25.896230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.896197    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2k8kl"]
Jul 23 19:21:25.901288 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:25.901261    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b086f44_dd8c_42ab_9802_a616b6927a43.slice/crio-96d4639e2ea4122ff3b991026879e8c425980bdd496f2641fb3eb0eaf8c4db3a WatchSource:0}: Error finding container 96d4639e2ea4122ff3b991026879e8c425980bdd496f2641fb3eb0eaf8c4db3a: Status 404 returned error can't find the container with id 96d4639e2ea4122ff3b991026879e8c425980bdd496f2641fb3eb0eaf8c4db3a
Jul 23 19:21:25.921087 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.921061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:25.974812 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.974778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl" event={"ID":"0b086f44-dd8c-42ab-9802-a616b6927a43","Type":"ContainerStarted","Data":"96d4639e2ea4122ff3b991026879e8c425980bdd496f2641fb3eb0eaf8c4db3a"}
Jul 23 19:21:25.975834 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:25.975809    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nvf" event={"ID":"017e3b4d-82e2-4db9-9095-f212a69cf50c","Type":"ContainerStarted","Data":"391babcc260534f1551bd038b0b5a35f58585fa1b932a1ca58fb00d44fb9a343"}
Jul 23 19:21:26.122340 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.122254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:26.124849 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.124817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2612821d-a8f2-4303-9dd7-ac3855eefe54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4p8wc\" (UID: \"2612821d-a8f2-4303-9dd7-ac3855eefe54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:26.332976 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.332938    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:26.360953 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.360925    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"
Jul 23 19:21:26.483990 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.483953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:26.519627 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.519595    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:21:26.522370 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.522328    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.527276 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.527239    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 19:21:26.527548 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.527530    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 19:21:26.527762 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.527741    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 19:21:26.529109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.528238    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 19:21:26.529109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.528551    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 19:21:26.529109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.528712    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 19:21:26.529109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.528733    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc"]
Jul 23 19:21:26.529109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.528833    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 19:21:26.529109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.528912    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9w2c6\""
Jul 23 19:21:26.529109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.528940    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 19:21:26.529109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.529064    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 19:21:26.551286 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.551253    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:21:26.601877 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.601833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:26.633791 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.633931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.633931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6c6g\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-kube-api-access-h6c6g\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.633931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.633931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.633931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.634084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.634084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.634084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.633994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-config-out\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.634084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.634032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.634084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.634056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.634084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.634079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.634265 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.634142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-web-config\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735504 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-config-out\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-web-config\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735829 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735696    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735829 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735829 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6c6g\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-kube-api-access-h6c6g\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735829 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735829 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735973 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735973 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.735973 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.735868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.737985 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.736804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.737985 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.736814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.737985 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.737346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.739721 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.739672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-config-out\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.740646 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.740520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.741159 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.741113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-config-volume\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.741952 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.741928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.742330 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.742295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.742610 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.742488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.743886 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.743864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.744685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.744662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-web-config\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.744774 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.744710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.764332 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:26.764295    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2612821d_a8f2_4303_9dd7_ac3855eefe54.slice/crio-e0fd08532811cc14f1d935771d3f8383eaa228bb03d48a5482fd40aa48ea6265 WatchSource:0}: Error finding container e0fd08532811cc14f1d935771d3f8383eaa228bb03d48a5482fd40aa48ea6265: Status 404 returned error can't find the container with id e0fd08532811cc14f1d935771d3f8383eaa228bb03d48a5482fd40aa48ea6265
Jul 23 19:21:26.774156 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.774118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6c6g\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-kube-api-access-h6c6g\") pod \"alertmanager-main-0\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.781947 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.781922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:26.839816 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.839792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:21:26.982887 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.982847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc" event={"ID":"2612821d-a8f2-4303-9dd7-ac3855eefe54","Type":"ContainerStarted","Data":"13fcd3f5473af2273d3804b19b1a11854fbbbcaf08449ba86ff6f9ab1a9a1a74"}
Jul 23 19:21:26.983296 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.982923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc" event={"ID":"2612821d-a8f2-4303-9dd7-ac3855eefe54","Type":"ContainerStarted","Data":"3c7926342f3cc0afc7b34b4d0a574f9357b8390c28131d87b11ebacf4c0d6afc"}
Jul 23 19:21:26.983296 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.982952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc" event={"ID":"2612821d-a8f2-4303-9dd7-ac3855eefe54","Type":"ContainerStarted","Data":"e0fd08532811cc14f1d935771d3f8383eaa228bb03d48a5482fd40aa48ea6265"}
Jul 23 19:21:26.984882 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:26.984851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nvf" event={"ID":"017e3b4d-82e2-4db9-9095-f212a69cf50c","Type":"ContainerStarted","Data":"177aa0975ff5a4c748f3faa76f21a3ab733aea29a64a485b7dba32fce27921e6"}
Jul 23 19:21:27.027630 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:27.027548    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:21:27.226421 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:27.226347    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68082282_7723_4f25_8651_fd4e277a7f8a.slice/crio-bc288946c2e1c663f6a250a3531df776cf1c0b448425b7777da9035abdca4e75 WatchSource:0}: Error finding container bc288946c2e1c663f6a250a3531df776cf1c0b448425b7777da9035abdca4e75: Status 404 returned error can't find the container with id bc288946c2e1c663f6a250a3531df776cf1c0b448425b7777da9035abdca4e75
Jul 23 19:21:27.989606 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:27.989570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerStarted","Data":"bc288946c2e1c663f6a250a3531df776cf1c0b448425b7777da9035abdca4e75"}
Jul 23 19:21:27.991797 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:27.991771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl" event={"ID":"0b086f44-dd8c-42ab-9802-a616b6927a43","Type":"ContainerStarted","Data":"28e7bd9832269a0aa4525eea15583bc9cbcecb674505b89e8112a5b73fde2607"}
Jul 23 19:21:27.991943 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:27.991821    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl" event={"ID":"0b086f44-dd8c-42ab-9802-a616b6927a43","Type":"ContainerStarted","Data":"80aadae934687eca60b5d578f544401156d30840aa23f1c141348287b4ed605c"}
Jul 23 19:21:27.991943 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:27.991844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl" event={"ID":"0b086f44-dd8c-42ab-9802-a616b6927a43","Type":"ContainerStarted","Data":"91584a9e40b110eb8480fe9be4a82d5a32cef0e42cabeb34210fbe3f23276ae8"}
Jul 23 19:21:27.993991 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:27.993963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc" event={"ID":"2612821d-a8f2-4303-9dd7-ac3855eefe54","Type":"ContainerStarted","Data":"bb31d7c36a0c21c0589603b80f77bedfa0289a7178786ac1eacf7f6e15f486dd"}
Jul 23 19:21:27.995484 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:27.995458    2561 generic.go:356] "Generic (PLEG): container finished" podID="017e3b4d-82e2-4db9-9095-f212a69cf50c" containerID="177aa0975ff5a4c748f3faa76f21a3ab733aea29a64a485b7dba32fce27921e6" exitCode=0
Jul 23 19:21:27.995625 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:27.995492    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nvf" event={"ID":"017e3b4d-82e2-4db9-9095-f212a69cf50c","Type":"ContainerDied","Data":"177aa0975ff5a4c748f3faa76f21a3ab733aea29a64a485b7dba32fce27921e6"}
Jul 23 19:21:28.020319 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.020234    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-2k8kl" podStartSLOduration=1.675057919 podStartE2EDuration="3.020210936s" totalImagesPullingTime="1.345153017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:28.015089384 +0000 UTC m=+65.949149532" watchObservedRunningTime="2026-07-23 19:21:28.020210936 +0000 UTC m=+65.954271085"
Jul 23 19:21:28.045601 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.045543    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4p8wc" podStartSLOduration=2.09456033 podStartE2EDuration="3.045520267s" totalImagesPullingTime="950.959937ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:28.043008874 +0000 UTC m=+65.977069022" watchObservedRunningTime="2026-07-23 19:21:28.045520267 +0000 UTC m=+65.979580415"
Jul 23 19:21:28.355947 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.355907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:21:28.356159 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.356032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:21:28.356159 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.356060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:21:28.359570 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.359548    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 19:21:28.360269 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.360246    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 19:21:28.360371 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.360247    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 19:21:28.369040 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.368966    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 19:21:28.369254 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.369235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33f43323-a317-4b7b-a8a8-607c51d8f076-metrics-certs\") pod \"network-metrics-daemon-kfswv\" (UID: \"33f43323-a317-4b7b-a8a8-607c51d8f076\") " pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:21:28.369327 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.369311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25ec972a-8ec2-4b87-bd61-db6172fa0330-original-pull-secret\") pod \"global-pull-secret-syncer-5w2l7\" (UID: \"25ec972a-8ec2-4b87-bd61-db6172fa0330\") " pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:21:28.371875 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.371843    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:28.380223 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.380195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzq9w\" (UniqueName: \"kubernetes.io/projected/dce479a7-1b18-4353-942d-258cbcb34c46-kube-api-access-gzq9w\") pod \"network-check-target-92hfr\" (UID: \"dce479a7-1b18-4353-942d-258cbcb34c46\") " pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:21:28.459118 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.459076    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"]
Jul 23 19:21:28.475222 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.475182    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k9tbr\""
Jul 23 19:21:28.476202 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.476185    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5w2l7"
Jul 23 19:21:28.481713 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.481646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfswv"
Jul 23 19:21:28.482704 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.482681    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"]
Jul 23 19:21:28.482830 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.482818    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.486081 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.486051    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 23 19:21:28.486260 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.486137    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 23 19:21:28.489478 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.486489    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pgxsd\""
Jul 23 19:21:28.489478 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.486937    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 23 19:21:28.489478 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.486990    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 23 19:21:28.489478 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.487307    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5p1uhbn9k95h4\""
Jul 23 19:21:28.489478 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.487344    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9qhx\""
Jul 23 19:21:28.489478 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.487574    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 23 19:21:28.489933 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.489804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:28.491026 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.491005    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:21:28.557857 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.557818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.558064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.557898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-tls\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.558064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.558022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.558183 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.558079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-grpc-tls\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.558183 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.558152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.558268 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.558206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggvxg\" (UniqueName: \"kubernetes.io/projected/4bd4679d-93ce-4dcf-99a5-914213acf20c-kube-api-access-ggvxg\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.558268 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.558225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd4679d-93ce-4dcf-99a5-914213acf20c-metrics-client-ca\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.558268 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.558244    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.601176 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.601135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:28.659507 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.659424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.659507 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.659479    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.659751 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.659524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-tls\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.659751 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.659552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.659751 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.659574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-grpc-tls\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.659751 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.659610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.659751 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.659644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggvxg\" (UniqueName: \"kubernetes.io/projected/4bd4679d-93ce-4dcf-99a5-914213acf20c-kube-api-access-ggvxg\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.659751 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.659667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd4679d-93ce-4dcf-99a5-914213acf20c-metrics-client-ca\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.660770 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.660717    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd4679d-93ce-4dcf-99a5-914213acf20c-metrics-client-ca\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.662581 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.662557    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-tls\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.662714 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.662661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.662772 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.662708    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.662850 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.662826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.662921 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.662906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-grpc-tls\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.663092 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.663071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4bd4679d-93ce-4dcf-99a5-914213acf20c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.671454 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.671429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggvxg\" (UniqueName: \"kubernetes.io/projected/4bd4679d-93ce-4dcf-99a5-914213acf20c-kube-api-access-ggvxg\") pod \"thanos-querier-7fbcb98bb6-wxfsc\" (UID: \"4bd4679d-93ce-4dcf-99a5-914213acf20c\") " pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.800398 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.796848    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:28.907732 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.907703    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-92hfr"]
Jul 23 19:21:28.932856 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.932779    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kfswv"]
Jul 23 19:21:28.955706 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:28.955570    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5w2l7"]
Jul 23 19:21:29.000765 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.000729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-92hfr" event={"ID":"dce479a7-1b18-4353-942d-258cbcb34c46","Type":"ContainerStarted","Data":"0bfdb9e0503b85492fae9fe357959b16f59364ea761b2c82f94aab75462cda5e"}
Jul 23 19:21:29.002839 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.002813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nvf" event={"ID":"017e3b4d-82e2-4db9-9095-f212a69cf50c","Type":"ContainerStarted","Data":"3ea76fcee9778f4a9690e27d968193c8f87554e22acc05a37f9688a6caa42b48"}
Jul 23 19:21:29.002972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.002869    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nvf" event={"ID":"017e3b4d-82e2-4db9-9095-f212a69cf50c","Type":"ContainerStarted","Data":"ec2d53aaa140600708df7905a085ec40160950244aa0495e0ad9e86b056ffc0e"}
Jul 23 19:21:29.025712 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.025665    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"]
Jul 23 19:21:29.046103 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.046048    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-95nvf" podStartSLOduration=3.010316587 podStartE2EDuration="4.046033891s" totalImagesPullingTime="942.395229ms" totalInitContainerRuntime="93.322075ms" isStatefulPod=true podCreationTimestamp="2026-07-23 19:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:29.043519553 +0000 UTC m=+66.977579713" watchObservedRunningTime="2026-07-23 19:21:29.046033891 +0000 UTC m=+66.980094070"
Jul 23 19:21:29.132178 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:29.132142    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f43323_a317_4b7b_a8a8_607c51d8f076.slice/crio-e3461a86383ac2b1615add934b47796c5b8dd0e92eefc9353a302e0c8538b407 WatchSource:0}: Error finding container e3461a86383ac2b1615add934b47796c5b8dd0e92eefc9353a302e0c8538b407: Status 404 returned error can't find the container with id e3461a86383ac2b1615add934b47796c5b8dd0e92eefc9353a302e0c8538b407
Jul 23 19:21:29.132790 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:29.132771    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ec972a_8ec2_4b87_bd61_db6172fa0330.slice/crio-be8aa475777170955302977ec12b1ec214a4210f2732ffc1b5f4aed305475679 WatchSource:0}: Error finding container be8aa475777170955302977ec12b1ec214a4210f2732ffc1b5f4aed305475679: Status 404 returned error can't find the container with id be8aa475777170955302977ec12b1ec214a4210f2732ffc1b5f4aed305475679
Jul 23 19:21:29.133683 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:29.133659    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd4679d_93ce_4dcf_99a5_914213acf20c.slice/crio-4ab805c1f65a239a9e624a59654db36b6e528eebd0b870a1cb02430d0998b550 WatchSource:0}: Error finding container 4ab805c1f65a239a9e624a59654db36b6e528eebd0b870a1cb02430d0998b550: Status 404 returned error can't find the container with id 4ab805c1f65a239a9e624a59654db36b6e528eebd0b870a1cb02430d0998b550
Jul 23 19:21:29.235820 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.235793    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:29.337818 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.337781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:29.798721 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.798678    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"]
Jul 23 19:21:29.801674 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.801635    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.807313 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.807089    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ndssb\""
Jul 23 19:21:29.808125 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.808103    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 19:21:29.808446 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.808426    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 19:21:29.808695 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.808675    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 19:21:29.809049 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.809030    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f2psveie9hqf8\""
Jul 23 19:21:29.809114 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.809052    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 19:21:29.818252 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.818226    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"]
Jul 23 19:21:29.871245 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.871211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07ee3198-5b92-4119-a20d-9830bb8a4205-audit-log\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.871421 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.871268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-client-ca-bundle\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.871421 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.871313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7xbc\" (UniqueName: \"kubernetes.io/projected/07ee3198-5b92-4119-a20d-9830bb8a4205-kube-api-access-c7xbc\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.871421 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.871344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ee3198-5b92-4119-a20d-9830bb8a4205-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.871421 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.871400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-secret-metrics-server-client-certs\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.871650 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.871430    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07ee3198-5b92-4119-a20d-9830bb8a4205-metrics-server-audit-profiles\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.871650 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.871491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-secret-metrics-server-tls\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.972036 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.971999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-secret-metrics-server-tls\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.972217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.972081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07ee3198-5b92-4119-a20d-9830bb8a4205-audit-log\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.972217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.972115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-client-ca-bundle\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.972217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.972146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7xbc\" (UniqueName: \"kubernetes.io/projected/07ee3198-5b92-4119-a20d-9830bb8a4205-kube-api-access-c7xbc\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.972217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.972170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ee3198-5b92-4119-a20d-9830bb8a4205-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.972217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.972190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-secret-metrics-server-client-certs\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.972217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.972209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07ee3198-5b92-4119-a20d-9830bb8a4205-metrics-server-audit-profiles\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.973579 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.973550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07ee3198-5b92-4119-a20d-9830bb8a4205-metrics-server-audit-profiles\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.974166 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.974146    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07ee3198-5b92-4119-a20d-9830bb8a4205-audit-log\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.975115 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.975091    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ee3198-5b92-4119-a20d-9830bb8a4205-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.977717 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.977675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-client-ca-bundle\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.980379 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.979898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-secret-metrics-server-client-certs\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.980379 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.980315    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07ee3198-5b92-4119-a20d-9830bb8a4205-secret-metrics-server-tls\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:29.983721 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:29.983680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7xbc\" (UniqueName: \"kubernetes.io/projected/07ee3198-5b92-4119-a20d-9830bb8a4205-kube-api-access-c7xbc\") pod \"metrics-server-bb5bdbbb6-kkl7j\" (UID: \"07ee3198-5b92-4119-a20d-9830bb8a4205\") " pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:30.011408 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.010717    2561 generic.go:356] "Generic (PLEG): container finished" podID="68082282-7723-4f25-8651-fd4e277a7f8a" containerID="eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e" exitCode=0
Jul 23 19:21:30.011408 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.010830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerDied","Data":"eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e"}
Jul 23 19:21:30.014070 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.013872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc" event={"ID":"4bd4679d-93ce-4dcf-99a5-914213acf20c","Type":"ContainerStarted","Data":"4ab805c1f65a239a9e624a59654db36b6e528eebd0b870a1cb02430d0998b550"}
Jul 23 19:21:30.017236 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.017155    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfswv" event={"ID":"33f43323-a317-4b7b-a8a8-607c51d8f076","Type":"ContainerStarted","Data":"e3461a86383ac2b1615add934b47796c5b8dd0e92eefc9353a302e0c8538b407"}
Jul 23 19:21:30.019932 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.019487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5w2l7" event={"ID":"25ec972a-8ec2-4b87-bd61-db6172fa0330","Type":"ContainerStarted","Data":"be8aa475777170955302977ec12b1ec214a4210f2732ffc1b5f4aed305475679"}
Jul 23 19:21:30.085086 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.084988    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69b59f7464-hh45h"]
Jul 23 19:21:30.088182 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.088158    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.096849 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.096305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:30.106067 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.105410    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b59f7464-hh45h"]
Jul 23 19:21:30.106067 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.105994    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"]
Jul 23 19:21:30.108561 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.108545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:30.111274 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.111094    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7z7sf\""
Jul 23 19:21:30.116437 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.116414    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 19:21:30.118968 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.118769    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:30.122176 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.121942    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"]
Jul 23 19:21:30.174586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-config\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.174763 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-service-ca\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.174763 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-trusted-ca-bundle\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.174763 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-oauth-config\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.174763 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174742    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-oauth-serving-cert\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.174978 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nc8b\" (UniqueName: \"kubernetes.io/projected/e428dc45-8f63-409e-bf40-595f6d9868df-kube-api-access-7nc8b\") pod \"monitoring-plugin-7b7b7bc8bf-7trb4\" (UID: \"e428dc45-8f63-409e-bf40-595f6d9868df\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:30.174978 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8mxb\" (UniqueName: \"kubernetes.io/projected/caaf831f-30f1-48cb-add3-f7bb42ff06d9-kube-api-access-b8mxb\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.174978 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-serving-cert\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.174978 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.174953    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e428dc45-8f63-409e-bf40-595f6d9868df-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7trb4\" (UID: \"e428dc45-8f63-409e-bf40-595f6d9868df\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:30.194713 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.194682    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-config\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-service-ca\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-trusted-ca-bundle\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-oauth-config\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-oauth-serving-cert\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nc8b\" (UniqueName: \"kubernetes.io/projected/e428dc45-8f63-409e-bf40-595f6d9868df-kube-api-access-7nc8b\") pod \"monitoring-plugin-7b7b7bc8bf-7trb4\" (UID: \"e428dc45-8f63-409e-bf40-595f6d9868df\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8mxb\" (UniqueName: \"kubernetes.io/projected/caaf831f-30f1-48cb-add3-f7bb42ff06d9-kube-api-access-b8mxb\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-serving-cert\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.276391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.276373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e428dc45-8f63-409e-bf40-595f6d9868df-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7trb4\" (UID: \"e428dc45-8f63-409e-bf40-595f6d9868df\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:30.276956 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:30.276513    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 23 19:21:30.276956 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:30.276585    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e428dc45-8f63-409e-bf40-595f6d9868df-monitoring-plugin-cert podName:e428dc45-8f63-409e-bf40-595f6d9868df nodeName:}" failed. No retries permitted until 2026-07-23 19:21:30.776561821 +0000 UTC m=+68.710621966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e428dc45-8f63-409e-bf40-595f6d9868df-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-7trb4" (UID: "e428dc45-8f63-409e-bf40-595f6d9868df") : secret "monitoring-plugin-cert" not found
Jul 23 19:21:30.278982 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.277607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-oauth-serving-cert\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.278982 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.278294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-service-ca\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.278982 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.278893    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-config\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.278982 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.278935    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-trusted-ca-bundle\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.281841 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.281810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-oauth-config\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.289966 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.289930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-serving-cert\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.307093 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.306601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nc8b\" (UniqueName: \"kubernetes.io/projected/e428dc45-8f63-409e-bf40-595f6d9868df-kube-api-access-7nc8b\") pod \"monitoring-plugin-7b7b7bc8bf-7trb4\" (UID: \"e428dc45-8f63-409e-bf40-595f6d9868df\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:30.313184 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.313148    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8mxb\" (UniqueName: \"kubernetes.io/projected/caaf831f-30f1-48cb-add3-f7bb42ff06d9-kube-api-access-b8mxb\") pod \"console-69b59f7464-hh45h\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") " pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.329381 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.329319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"]
Jul 23 19:21:30.402158 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.402052    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:30.437550 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.437437    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:30.783531 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.783500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e428dc45-8f63-409e-bf40-595f6d9868df-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7trb4\" (UID: \"e428dc45-8f63-409e-bf40-595f6d9868df\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:30.792202 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.791686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e428dc45-8f63-409e-bf40-595f6d9868df-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7trb4\" (UID: \"e428dc45-8f63-409e-bf40-595f6d9868df\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:30.811735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:30.811709    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b59f7464-hh45h"]
Jul 23 19:21:30.816537 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:30.816502    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaaf831f_30f1_48cb_add3_f7bb42ff06d9.slice/crio-dca4ced13b047392bac98ae383bca6c4bfa36f0ac9724c366889b41200fb8f31 WatchSource:0}: Error finding container dca4ced13b047392bac98ae383bca6c4bfa36f0ac9724c366889b41200fb8f31: Status 404 returned error can't find the container with id dca4ced13b047392bac98ae383bca6c4bfa36f0ac9724c366889b41200fb8f31
Jul 23 19:21:31.030160 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.029257    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfswv" event={"ID":"33f43323-a317-4b7b-a8a8-607c51d8f076","Type":"ContainerStarted","Data":"afc25d41f33709aee366b981732439dd6ee944f8f72cc5d498c6ee6d56572ea4"}
Jul 23 19:21:31.030160 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.029324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfswv" event={"ID":"33f43323-a317-4b7b-a8a8-607c51d8f076","Type":"ContainerStarted","Data":"fae31a9da9d734c9a17296cd6708e4aac7f1a6b53ada7a78852c871a16c96b9d"}
Jul 23 19:21:31.034808 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.034286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j" event={"ID":"07ee3198-5b92-4119-a20d-9830bb8a4205","Type":"ContainerStarted","Data":"6da2b7357ff55dabe6da7cd492370cd1ba147c1d31c4526620158da17b724ed5"}
Jul 23 19:21:31.034808 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.034498    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:31.038802 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.038184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b59f7464-hh45h" event={"ID":"caaf831f-30f1-48cb-add3-f7bb42ff06d9","Type":"ContainerStarted","Data":"4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b"}
Jul 23 19:21:31.038802 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.038236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b59f7464-hh45h" event={"ID":"caaf831f-30f1-48cb-add3-f7bb42ff06d9","Type":"ContainerStarted","Data":"dca4ced13b047392bac98ae383bca6c4bfa36f0ac9724c366889b41200fb8f31"}
Jul 23 19:21:31.092625 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.092039    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kfswv" podStartSLOduration=66.581016221 podStartE2EDuration="1m8.092016111s" totalImagesPullingTime="1.51099989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:31.053577484 +0000 UTC m=+68.987637632" watchObservedRunningTime="2026-07-23 19:21:31.092016111 +0000 UTC m=+69.026076259"
Jul 23 19:21:31.092625 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.092307    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69b59f7464-hh45h" podStartSLOduration=1.092292891 podStartE2EDuration="1.092292891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:31.090157388 +0000 UTC m=+69.024217573" watchObservedRunningTime="2026-07-23 19:21:31.092292891 +0000 UTC m=+69.026353022"
Jul 23 19:21:31.261766 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.261732    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:31.384903 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.384861    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:31.731339 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.731299    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:21:31.735000 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.734973    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.741230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.739338    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 19:21:31.741230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.739910    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 19:21:31.741230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.740155    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 19:21:31.741230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.740244    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 19:21:31.741230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.740582    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 19:21:31.741230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.741097    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:31.741788 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.741762    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 19:21:31.742606 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.742580    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5khtsk92fvdob\""
Jul 23 19:21:31.742879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.742858    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 19:21:31.745446 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.745038    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 19:21:31.746314 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.745701    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 19:21:31.746314 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.746188    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-72bdv\""
Jul 23 19:21:31.746814 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.746784    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 19:21:31.747012 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.746996    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 19:21:31.747203 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.747190    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 19:21:31.752378 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.752331    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 19:21:31.752479 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.752409    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 19:21:31.768814 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.768784    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:21:31.895613 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.895570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.895798 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.895639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.895798 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.895730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.895798 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.895778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896065 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.895949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896065 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fw4x\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-kube-api-access-6fw4x\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896172    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-config\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896500    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.896582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.897077 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.896617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.998978 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.998711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-config\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.998978 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.998918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999212 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.998959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999212 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999212 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999413 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999413 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999413 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999413 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999413 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999681 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999681 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:31.999681 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:31.999531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.001677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.003072    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.004510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.007906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.009485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.017611    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.017766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.017874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.017926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.018385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.018906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.018943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.019012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fw4x\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-kube-api-access-6fw4x\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.019069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.019102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.019131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.023735 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.019786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.030231 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.030165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.030663 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.030343    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.031041 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.031014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.034613 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.034541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.035277 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.035223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.039270 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.038845    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.039270 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.039229    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-config\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.039860 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.039819    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.040504 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.040480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fw4x\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-kube-api-access-6fw4x\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.042010 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.041989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.042449 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.042426    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:32.052555 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.052523    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:32.151903 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.151870    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:32.243904 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:32.243870    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:35.429366 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:35.429320    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"]
Jul 23 19:21:35.432783 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:35.432748    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode428dc45_8f63_409e_bf40_595f6d9868df.slice/crio-dc9290cdbb706e76b93e2bb3124a0a006b53ec250a6a91db1520ef7de8f50a32 WatchSource:0}: Error finding container dc9290cdbb706e76b93e2bb3124a0a006b53ec250a6a91db1520ef7de8f50a32: Status 404 returned error can't find the container with id dc9290cdbb706e76b93e2bb3124a0a006b53ec250a6a91db1520ef7de8f50a32
Jul 23 19:21:35.466549 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:35.466492    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:21:35.470762 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:21:35.470722    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4525c3fe_5563_4816_9483_77bebf58fc4b.slice/crio-f0648aa8f32e856c7b07f7e912eba9820ea30a0ce8888ce5dbc10d65f8616ba8 WatchSource:0}: Error finding container f0648aa8f32e856c7b07f7e912eba9820ea30a0ce8888ce5dbc10d65f8616ba8: Status 404 returned error can't find the container with id f0648aa8f32e856c7b07f7e912eba9820ea30a0ce8888ce5dbc10d65f8616ba8
Jul 23 19:21:36.064637 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.064532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5w2l7" event={"ID":"25ec972a-8ec2-4b87-bd61-db6172fa0330","Type":"ContainerStarted","Data":"3a599175a689a5064ec688f55a735cee2568d11829033a2ba4e5079775f6c564"}
Jul 23 19:21:36.065887 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.065858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4" event={"ID":"e428dc45-8f63-409e-bf40-595f6d9868df","Type":"ContainerStarted","Data":"dc9290cdbb706e76b93e2bb3124a0a006b53ec250a6a91db1520ef7de8f50a32"}
Jul 23 19:21:36.068304 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.068263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc" event={"ID":"4bd4679d-93ce-4dcf-99a5-914213acf20c","Type":"ContainerStarted","Data":"12bc621173f92465d5c43a08691ad37c8bac826eb68deff24939d5dcea040578"}
Jul 23 19:21:36.068483 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.068340    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc" event={"ID":"4bd4679d-93ce-4dcf-99a5-914213acf20c","Type":"ContainerStarted","Data":"a43007e1741071b5d3b186e06408bba2e6ce86d985e4bd5f49f469fc604df061"}
Jul 23 19:21:36.068483 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.068408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc" event={"ID":"4bd4679d-93ce-4dcf-99a5-914213acf20c","Type":"ContainerStarted","Data":"b6f91bd7e5898b53e0ccfe226d9fd9d3cf6e99d77ee5a52b7cb8826c20892add"}
Jul 23 19:21:36.072194 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.072169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerStarted","Data":"f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1"}
Jul 23 19:21:36.072325 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.072231    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerStarted","Data":"3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584"}
Jul 23 19:21:36.072325 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.072276    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerStarted","Data":"9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13"}
Jul 23 19:21:36.072325 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.072305    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerStarted","Data":"cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a"}
Jul 23 19:21:36.072462 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.072328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerStarted","Data":"cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd"}
Jul 23 19:21:36.073690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.073664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-92hfr" event={"ID":"dce479a7-1b18-4353-942d-258cbcb34c46","Type":"ContainerStarted","Data":"7c26b15ff05b749e28a40ac6fcb9bf2750f9aa09b184057173daaced06cb6d0c"}
Jul 23 19:21:36.073775 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.073749    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:21:36.075301 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.075276    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j" event={"ID":"07ee3198-5b92-4119-a20d-9830bb8a4205","Type":"ContainerStarted","Data":"e764642a678fb157c55d103ff4f2fdc87b0c4277ef0224dcae9647b26697d8ce"}
Jul 23 19:21:36.077828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.076913    2561 generic.go:356] "Generic (PLEG): container finished" podID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca" exitCode=0
Jul 23 19:21:36.077828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.076988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerDied","Data":"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"}
Jul 23 19:21:36.077828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.077046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerStarted","Data":"f0648aa8f32e856c7b07f7e912eba9820ea30a0ce8888ce5dbc10d65f8616ba8"}
Jul 23 19:21:36.093708 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.093641    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5w2l7" podStartSLOduration=66.998103899 podStartE2EDuration="1m13.093619401s" totalImagesPullingTime="6.095515502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:36.092550913 +0000 UTC m=+74.026611062" watchObservedRunningTime="2026-07-23 19:21:36.093619401 +0000 UTC m=+74.027679561"
Jul 23 19:21:36.132036 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.131981    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-92hfr" podStartSLOduration=66.786705972 podStartE2EDuration="1m13.131964028s" totalImagesPullingTime="6.345258056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:36.130137682 +0000 UTC m=+74.064197830" watchObservedRunningTime="2026-07-23 19:21:36.131964028 +0000 UTC m=+74.066024175"
Jul 23 19:21:36.155209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:36.155147    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j" podStartSLOduration=2.494019728 podStartE2EDuration="7.155133764s" totalImagesPullingTime="4.661114036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:36.153851298 +0000 UTC m=+74.087911468" watchObservedRunningTime="2026-07-23 19:21:36.155133764 +0000 UTC m=+74.089193911"
Jul 23 19:21:37.086566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:37.086533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc" event={"ID":"4bd4679d-93ce-4dcf-99a5-914213acf20c","Type":"ContainerStarted","Data":"af5ff292dec75be5dfc59c8a6376bd49f90b0ebe2fb2cc4903c70c47e517db80"}
Jul 23 19:21:37.086914 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:37.086619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc" event={"ID":"4bd4679d-93ce-4dcf-99a5-914213acf20c","Type":"ContainerStarted","Data":"cefdae5e8944edbbc4681d5b6d1e63ade9c7257504a4afd4e41b8ee91a1fe2b0"}
Jul 23 19:21:37.090971 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:37.090946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerStarted","Data":"b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed"}
Jul 23 19:21:37.130113 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:37.130054    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.215324684 podStartE2EDuration="11.130030268s" totalImagesPullingTime="7.889283279s" totalInitContainerRuntime="25.422305ms" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:37.127501505 +0000 UTC m=+75.061561653" watchObservedRunningTime="2026-07-23 19:21:37.130030268 +0000 UTC m=+75.064090418"
Jul 23 19:21:37.858920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:37.858882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:37.929207 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:37.929170    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:38.097099 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:38.097063    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4" event={"ID":"e428dc45-8f63-409e-bf40-595f6d9868df","Type":"ContainerStarted","Data":"f073bd333f685eecd53ce39ce5dcc44c9c1d4970fd14d05306b6751aacaac32a"}
Jul 23 19:21:38.097566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:38.097324    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:38.101429 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:38.101397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc" event={"ID":"4bd4679d-93ce-4dcf-99a5-914213acf20c","Type":"ContainerStarted","Data":"7b890c539309329d31f223c93724802ef588eff26859d3b0b41589c6fb99b7aa"}
Jul 23 19:21:38.101920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:38.101901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:38.103133 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:38.103117    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4"
Jul 23 19:21:38.122559 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:38.122462    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7trb4" podStartSLOduration=6.546392443 podStartE2EDuration="8.122441955s" totalImagesPullingTime="1.576049512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:38.121098956 +0000 UTC m=+76.055159102" watchObservedRunningTime="2026-07-23 19:21:38.122441955 +0000 UTC m=+76.056502104"
Jul 23 19:21:38.150240 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:38.150182    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc" podStartSLOduration=3.0790235360000002 podStartE2EDuration="10.150161111s" totalImagesPullingTime="7.071137575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:38.148376047 +0000 UTC m=+76.082436191" watchObservedRunningTime="2026-07-23 19:21:38.150161111 +0000 UTC m=+76.084221259"
Jul 23 19:21:40.115215 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.115175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerStarted","Data":"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"}
Jul 23 19:21:40.115691 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.115246    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerStarted","Data":"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"}
Jul 23 19:21:40.115691 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.115274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerStarted","Data":"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"}
Jul 23 19:21:40.115691 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.115298    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerStarted","Data":"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"}
Jul 23 19:21:40.115691 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.115320    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerStarted","Data":"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"}
Jul 23 19:21:40.115691 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.115342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerStarted","Data":"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"}
Jul 23 19:21:40.152318 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.152265    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.846179672 podStartE2EDuration="9.152243871s" totalImagesPullingTime="3.281659107s" totalInitContainerRuntime="24.405092ms" isStatefulPod=false podCreationTimestamp="2026-07-23 19:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:40.148725437 +0000 UTC m=+78.082785575" watchObservedRunningTime="2026-07-23 19:21:40.152243871 +0000 UTC m=+78.086304020"
Jul 23 19:21:40.403013 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.402919    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:40.403013 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.403002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:40.407835 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:40.407813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:41.127368 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:41.127325    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:21:41.159719 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:41.159682    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:41.205934 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:41.205894    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc87d868d-5b8w8"]
Jul 23 19:21:41.227522 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:41.227487    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f8dlm_c2296a13-9ecc-427d-b868-d885b41a86d6/serve-healthcheck-canary/0.log"
Jul 23 19:21:41.266747 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:41.266719    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:41.362511 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:41.362474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:41.461824 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:41.461795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:41.562959 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:41.562923    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:42.053539 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:42.053493    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:21:44.113467 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:44.113436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7fbcb98bb6-wxfsc"
Jul 23 19:21:46.461623 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:46.461589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:46.562135 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:46.562098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:48.059859 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:48.059805    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64cb5d69d9-s4m7h" podUID="a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" containerName="console" containerID="cri-o://82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d" gracePeriod=15
Jul 23 19:21:48.874935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:48.874905    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:49.005573 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.005483    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6ltk\" (UniqueName: \"kubernetes.io/projected/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-kube-api-access-x6ltk\") pod \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") "
Jul 23 19:21:49.005573 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.005542    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-service-ca\") pod \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") "
Jul 23 19:21:49.005885 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.005581    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-serving-cert\") pod \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") "
Jul 23 19:21:49.005885 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.005607    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-oauth-serving-cert\") pod \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") "
Jul 23 19:21:49.005885 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.005624    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-config\") pod \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") "
Jul 23 19:21:49.005885 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.005655    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-oauth-config\") pod \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\" (UID: \"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9\") "
Jul 23 19:21:49.006136 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.006108    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-config" (OuterVolumeSpecName: "console-config") pod "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" (UID: "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:21:49.006136 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.006115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" (UID: "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:21:49.006232 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.006121    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" (UID: "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:21:49.008155 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.008130    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-kube-api-access-x6ltk" (OuterVolumeSpecName: "kube-api-access-x6ltk") pod "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" (UID: "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9"). InnerVolumeSpecName "kube-api-access-x6ltk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:21:49.008427 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.008397    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" (UID: "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:21:49.008542 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.008465    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" (UID: "a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:21:49.106985 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.106943    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-oauth-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:21:49.106985 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.106995    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6ltk\" (UniqueName: \"kubernetes.io/projected/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-kube-api-access-x6ltk\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:21:49.107439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.107007    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-service-ca\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:21:49.107439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.107016    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:21:49.107439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.107025    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-oauth-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:21:49.107439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.107032    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9-console-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:21:49.156337 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.156300    2561 generic.go:356] "Generic (PLEG): container finished" podID="a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" containerID="82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d" exitCode=0
Jul 23 19:21:49.156541 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.156374    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cb5d69d9-s4m7h"
Jul 23 19:21:49.156541 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.156387    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cb5d69d9-s4m7h" event={"ID":"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9","Type":"ContainerDied","Data":"82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d"}
Jul 23 19:21:49.156541 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.156469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cb5d69d9-s4m7h" event={"ID":"a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9","Type":"ContainerDied","Data":"b2d0dbdc615e4f39530c085e708f4da1c10332c0b7b0b263b086a770dfd83f1d"}
Jul 23 19:21:49.156541 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.156491    2561 scope.go:117] "RemoveContainer" containerID="82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d"
Jul 23 19:21:49.166095 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.166081    2561 scope.go:117] "RemoveContainer" containerID="82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d"
Jul 23 19:21:49.166334 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:21:49.166311    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d\": container with ID starting with 82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d not found: ID does not exist" containerID="82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d"
Jul 23 19:21:49.166404 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.166347    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d"} err="failed to get container status \"82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d\": rpc error: code = NotFound desc = could not find container \"82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d\": container with ID starting with 82f4295afc864da1f31143df6b3fdbd5f57d1522c98e6e1f1d17ed068f574a1d not found: ID does not exist"
Jul 23 19:21:49.180162 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.180137    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64cb5d69d9-s4m7h"]
Jul 23 19:21:49.182817 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:49.182797    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64cb5d69d9-s4m7h"]
Jul 23 19:21:50.119949 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:50.119910    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:50.120455 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:50.119981    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:21:50.566692 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:50.566656    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" path="/var/lib/kubelet/pods/a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9/volumes"
Jul 23 19:21:51.474138 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:51.474098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:58.324543 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:58.324507    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:58.427328 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:58.427295    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:21:58.495324 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:21:58.495294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:22:06.227729 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.227688    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bc87d868d-5b8w8" podUID="42e375e5-395e-41a3-bdcc-771eb25d418f" containerName="console" containerID="cri-o://0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f" gracePeriod=15
Jul 23 19:22:06.478028 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.477970    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:22:06.567101 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567069    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-trusted-ca-bundle\") pod \"42e375e5-395e-41a3-bdcc-771eb25d418f\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") "
Jul 23 19:22:06.567261 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567115    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-console-config\") pod \"42e375e5-395e-41a3-bdcc-771eb25d418f\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") "
Jul 23 19:22:06.567261 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567162    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-oauth-serving-cert\") pod \"42e375e5-395e-41a3-bdcc-771eb25d418f\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") "
Jul 23 19:22:06.567261 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567214    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-oauth-config\") pod \"42e375e5-395e-41a3-bdcc-771eb25d418f\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") "
Jul 23 19:22:06.567261 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567242    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-service-ca\") pod \"42e375e5-395e-41a3-bdcc-771eb25d418f\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") "
Jul 23 19:22:06.567462 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567263    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7spvm\" (UniqueName: \"kubernetes.io/projected/42e375e5-395e-41a3-bdcc-771eb25d418f-kube-api-access-7spvm\") pod \"42e375e5-395e-41a3-bdcc-771eb25d418f\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") "
Jul 23 19:22:06.567462 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567294    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-serving-cert\") pod \"42e375e5-395e-41a3-bdcc-771eb25d418f\" (UID: \"42e375e5-395e-41a3-bdcc-771eb25d418f\") "
Jul 23 19:22:06.567648 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567523    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42e375e5-395e-41a3-bdcc-771eb25d418f" (UID: "42e375e5-395e-41a3-bdcc-771eb25d418f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:06.567723 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567641    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-console-config" (OuterVolumeSpecName: "console-config") pod "42e375e5-395e-41a3-bdcc-771eb25d418f" (UID: "42e375e5-395e-41a3-bdcc-771eb25d418f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:06.567723 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567653    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-service-ca" (OuterVolumeSpecName: "service-ca") pod "42e375e5-395e-41a3-bdcc-771eb25d418f" (UID: "42e375e5-395e-41a3-bdcc-771eb25d418f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:06.567723 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.567682    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42e375e5-395e-41a3-bdcc-771eb25d418f" (UID: "42e375e5-395e-41a3-bdcc-771eb25d418f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:06.569494 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.569468    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42e375e5-395e-41a3-bdcc-771eb25d418f" (UID: "42e375e5-395e-41a3-bdcc-771eb25d418f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:06.569601 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.569580    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42e375e5-395e-41a3-bdcc-771eb25d418f" (UID: "42e375e5-395e-41a3-bdcc-771eb25d418f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:06.569691 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.569672    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e375e5-395e-41a3-bdcc-771eb25d418f-kube-api-access-7spvm" (OuterVolumeSpecName: "kube-api-access-7spvm") pod "42e375e5-395e-41a3-bdcc-771eb25d418f" (UID: "42e375e5-395e-41a3-bdcc-771eb25d418f"). InnerVolumeSpecName "kube-api-access-7spvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:22:06.668465 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.668422    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:06.668465 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.668455    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-trusted-ca-bundle\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:06.668465 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.668467    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-console-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:06.668465 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.668477    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-oauth-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:06.668752 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.668485    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e375e5-395e-41a3-bdcc-771eb25d418f-console-oauth-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:06.668752 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.668493    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e375e5-395e-41a3-bdcc-771eb25d418f-service-ca\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:06.668752 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:06.668503    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7spvm\" (UniqueName: \"kubernetes.io/projected/42e375e5-395e-41a3-bdcc-771eb25d418f-kube-api-access-7spvm\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:07.093658 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.093626    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-92hfr"
Jul 23 19:22:07.241741 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.241708    2561 generic.go:356] "Generic (PLEG): container finished" podID="42e375e5-395e-41a3-bdcc-771eb25d418f" containerID="0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f" exitCode=0
Jul 23 19:22:07.242156 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.241756    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc87d868d-5b8w8"
Jul 23 19:22:07.242156 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.241805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc87d868d-5b8w8" event={"ID":"42e375e5-395e-41a3-bdcc-771eb25d418f","Type":"ContainerDied","Data":"0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f"}
Jul 23 19:22:07.242156 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.241850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc87d868d-5b8w8" event={"ID":"42e375e5-395e-41a3-bdcc-771eb25d418f","Type":"ContainerDied","Data":"bc7736906e68384a74cb9d8c06d5cc5376459ec7f4d39f62fb0aa6f7d426cc84"}
Jul 23 19:22:07.242156 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.241870    2561 scope.go:117] "RemoveContainer" containerID="0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f"
Jul 23 19:22:07.250744 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.250726    2561 scope.go:117] "RemoveContainer" containerID="0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f"
Jul 23 19:22:07.251021 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:07.251003    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f\": container with ID starting with 0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f not found: ID does not exist" containerID="0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f"
Jul 23 19:22:07.251064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.251029    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f"} err="failed to get container status \"0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f\": rpc error: code = NotFound desc = could not find container \"0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f\": container with ID starting with 0f560d379305a2f39160831043fa9cb42849fce6b62db3211fbdb9ec0a5e062f not found: ID does not exist"
Jul 23 19:22:07.275737 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.275701    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc87d868d-5b8w8"]
Jul 23 19:22:07.283072 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:07.283043    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bc87d868d-5b8w8"]
Jul 23 19:22:08.566437 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:08.566400    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e375e5-395e-41a3-bdcc-771eb25d418f" path="/var/lib/kubelet/pods/42e375e5-395e-41a3-bdcc-771eb25d418f/volumes"
Jul 23 19:22:10.125772 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:10.125742    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:22:10.129672 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:10.129649    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-bb5bdbbb6-kkl7j"
Jul 23 19:22:32.053878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:32.053837    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:32.074299 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:32.074269    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:32.369793 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:32.369725    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:44.721423 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:44.721385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:22:45.115700 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:45.115623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:22:45.804470 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:45.804432    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:22:45.804862 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:45.804724    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="alertmanager" containerID="cri-o://cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd" gracePeriod=120
Jul 23 19:22:45.804862 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:45.804782    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy-metric" containerID="cri-o://f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1" gracePeriod=120
Jul 23 19:22:45.804862 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:45.804819    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy-web" containerID="cri-o://9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13" gracePeriod=120
Jul 23 19:22:45.804862 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:45.804842    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy" containerID="cri-o://3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584" gracePeriod=120
Jul 23 19:22:45.805064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:45.804883    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="prom-label-proxy" containerID="cri-o://b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed" gracePeriod=120
Jul 23 19:22:45.805064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:45.804899    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="config-reloader" containerID="cri-o://cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a" gracePeriod=120
Jul 23 19:22:46.411206 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411164    2561 generic.go:356] "Generic (PLEG): container finished" podID="68082282-7723-4f25-8651-fd4e277a7f8a" containerID="b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed" exitCode=0
Jul 23 19:22:46.411206 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411194    2561 generic.go:356] "Generic (PLEG): container finished" podID="68082282-7723-4f25-8651-fd4e277a7f8a" containerID="f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1" exitCode=0
Jul 23 19:22:46.411206 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411205    2561 generic.go:356] "Generic (PLEG): container finished" podID="68082282-7723-4f25-8651-fd4e277a7f8a" containerID="3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584" exitCode=0
Jul 23 19:22:46.411206 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411212    2561 generic.go:356] "Generic (PLEG): container finished" podID="68082282-7723-4f25-8651-fd4e277a7f8a" containerID="cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a" exitCode=0
Jul 23 19:22:46.411206 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411218    2561 generic.go:356] "Generic (PLEG): container finished" podID="68082282-7723-4f25-8651-fd4e277a7f8a" containerID="cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd" exitCode=0
Jul 23 19:22:46.411521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerDied","Data":"b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed"}
Jul 23 19:22:46.411521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411326    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerDied","Data":"f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1"}
Jul 23 19:22:46.411521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerDied","Data":"3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584"}
Jul 23 19:22:46.411521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411398    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerDied","Data":"cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a"}
Jul 23 19:22:46.411521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:46.411421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerDied","Data":"cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd"}
Jul 23 19:22:47.047686 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.047661    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.131005 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.130915    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-web\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131005 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.130972    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131202 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131005    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131202 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-config-volume\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131202 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131178    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-cluster-tls-config\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131369 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131211    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-main-db\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131369 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131245    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-metrics-client-ca\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131369 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131302    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-web-config\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131523 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131380    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-config-out\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131523 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131420    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6c6g\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-kube-api-access-h6c6g\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131523 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131453    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-main-tls\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131523 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131480    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-trusted-ca-bundle\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.131523 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131510    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-tls-assets\") pod \"68082282-7723-4f25-8651-fd4e277a7f8a\" (UID: \"68082282-7723-4f25-8651-fd4e277a7f8a\") "
Jul 23 19:22:47.132312 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.131949    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:47.132451 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.132399    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:22:47.132522 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.132471    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:47.136690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.136654    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-kube-api-access-h6c6g" (OuterVolumeSpecName: "kube-api-access-h6c6g") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "kube-api-access-h6c6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:22:47.136983 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.136942    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:47.137097 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.137013    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:22:47.137686 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.137655    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:47.137844 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.137770    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-config-volume" (OuterVolumeSpecName: "config-volume") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:47.137988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.137961    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:47.138206 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.138180    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:47.138612 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.138581    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-config-out" (OuterVolumeSpecName: "config-out") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:22:47.142387 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.142335    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:47.150631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.150597    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-web-config" (OuterVolumeSpecName: "web-config") pod "68082282-7723-4f25-8651-fd4e277a7f8a" (UID: "68082282-7723-4f25-8651-fd4e277a7f8a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:47.232746 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232714    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-web-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232746 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232741    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-config-out\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232746 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232751    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6c6g\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-kube-api-access-h6c6g\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232763    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-main-tls\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232772    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232781    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68082282-7723-4f25-8651-fd4e277a7f8a-tls-assets\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232790    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232799    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232809    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232817    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-config-volume\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232825    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68082282-7723-4f25-8651-fd4e277a7f8a-cluster-tls-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232833    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68082282-7723-4f25-8651-fd4e277a7f8a-alertmanager-main-db\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.232984 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.232841    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68082282-7723-4f25-8651-fd4e277a7f8a-metrics-client-ca\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:47.418546 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.418467    2561 generic.go:356] "Generic (PLEG): container finished" podID="68082282-7723-4f25-8651-fd4e277a7f8a" containerID="9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13" exitCode=0
Jul 23 19:22:47.418684 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.418551    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.418684 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.418550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerDied","Data":"9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13"}
Jul 23 19:22:47.418684 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.418621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68082282-7723-4f25-8651-fd4e277a7f8a","Type":"ContainerDied","Data":"bc288946c2e1c663f6a250a3531df776cf1c0b448425b7777da9035abdca4e75"}
Jul 23 19:22:47.418684 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.418679    2561 scope.go:117] "RemoveContainer" containerID="b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed"
Jul 23 19:22:47.426876 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.426859    2561 scope.go:117] "RemoveContainer" containerID="f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1"
Jul 23 19:22:47.434092 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.434074    2561 scope.go:117] "RemoveContainer" containerID="3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584"
Jul 23 19:22:47.441244 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.441220    2561 scope.go:117] "RemoveContainer" containerID="9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13"
Jul 23 19:22:47.442633 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.442611    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:22:47.447762 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.447742    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:22:47.449177 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.449160    2561 scope.go:117] "RemoveContainer" containerID="cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a"
Jul 23 19:22:47.456169 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.456152    2561 scope.go:117] "RemoveContainer" containerID="cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd"
Jul 23 19:22:47.463331 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.463314    2561 scope.go:117] "RemoveContainer" containerID="eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e"
Jul 23 19:22:47.470738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.470721    2561 scope.go:117] "RemoveContainer" containerID="b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed"
Jul 23 19:22:47.471024 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:47.471006    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed\": container with ID starting with b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed not found: ID does not exist" containerID="b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed"
Jul 23 19:22:47.471094 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.471036    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed"} err="failed to get container status \"b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed\": rpc error: code = NotFound desc = could not find container \"b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed\": container with ID starting with b4d30e628d4f130061b9719d3b4758e919e7c643c613b675f5f6fc708a4f72ed not found: ID does not exist"
Jul 23 19:22:47.471094 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.471061    2561 scope.go:117] "RemoveContainer" containerID="f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1"
Jul 23 19:22:47.471284 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:47.471268    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1\": container with ID starting with f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1 not found: ID does not exist" containerID="f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1"
Jul 23 19:22:47.471365 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.471290    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1"} err="failed to get container status \"f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1\": rpc error: code = NotFound desc = could not find container \"f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1\": container with ID starting with f3a166aeda712f7c5b902387ce8751aadde862bf96c1f523f0d8887135e0b6c1 not found: ID does not exist"
Jul 23 19:22:47.471365 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.471309    2561 scope.go:117] "RemoveContainer" containerID="3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584"
Jul 23 19:22:47.471605 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:47.471588    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584\": container with ID starting with 3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584 not found: ID does not exist" containerID="3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584"
Jul 23 19:22:47.471658 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.471612    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584"} err="failed to get container status \"3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584\": rpc error: code = NotFound desc = could not find container \"3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584\": container with ID starting with 3f73df6a6ac87440389222aca97b5108fb5cc51120f8eb438243c8886a829584 not found: ID does not exist"
Jul 23 19:22:47.471658 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.471628    2561 scope.go:117] "RemoveContainer" containerID="9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13"
Jul 23 19:22:47.471847 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:47.471832    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13\": container with ID starting with 9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13 not found: ID does not exist" containerID="9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13"
Jul 23 19:22:47.471891 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.471849    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13"} err="failed to get container status \"9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13\": rpc error: code = NotFound desc = could not find container \"9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13\": container with ID starting with 9184a9acaf5af8e9607e4409d0f967e1dc5c56dc189f06ab5cf5c0da98b7ef13 not found: ID does not exist"
Jul 23 19:22:47.471891 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.471861    2561 scope.go:117] "RemoveContainer" containerID="cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a"
Jul 23 19:22:47.472074 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:47.472057    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a\": container with ID starting with cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a not found: ID does not exist" containerID="cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a"
Jul 23 19:22:47.472121 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.472074    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a"} err="failed to get container status \"cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a\": rpc error: code = NotFound desc = could not find container \"cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a\": container with ID starting with cdc67ad4c0c02fa22e7b7f9bc3d46e7d7b089406e40b3113876132be99c0cb9a not found: ID does not exist"
Jul 23 19:22:47.472121 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.472086    2561 scope.go:117] "RemoveContainer" containerID="cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd"
Jul 23 19:22:47.472278 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:47.472257    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd\": container with ID starting with cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd not found: ID does not exist" containerID="cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd"
Jul 23 19:22:47.472317 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.472285    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd"} err="failed to get container status \"cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd\": rpc error: code = NotFound desc = could not find container \"cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd\": container with ID starting with cd422402c19b8bdbeb8d8ae78832589f7bb630d7af0955520d819e1d82d9f3fd not found: ID does not exist"
Jul 23 19:22:47.472317 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.472302    2561 scope.go:117] "RemoveContainer" containerID="eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e"
Jul 23 19:22:47.472571 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:47.472557    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e\": container with ID starting with eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e not found: ID does not exist" containerID="eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e"
Jul 23 19:22:47.472613 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.472579    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e"} err="failed to get container status \"eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e\": rpc error: code = NotFound desc = could not find container \"eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e\": container with ID starting with eaca37012f042074cf6d2342e17ad5075208326ed1c56f9e46ec0938dfc53d6e not found: ID does not exist"
Jul 23 19:22:47.478288 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478266    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:22:47.478631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478618    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" containerName="console"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478634    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" containerName="console"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478641    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy-metric"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478647    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy-metric"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478655    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="config-reloader"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478660    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="config-reloader"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478667    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="prom-label-proxy"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478673    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="prom-label-proxy"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478686    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e375e5-395e-41a3-bdcc-771eb25d418f" containerName="console"
Jul 23 19:22:47.478690 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478691    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e375e5-395e-41a3-bdcc-771eb25d418f" containerName="console"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478699    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="init-config-reloader"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478704    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="init-config-reloader"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478711    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="alertmanager"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478716    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="alertmanager"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478723    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy-web"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478729    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy-web"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478736    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478740    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478783    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy-web"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478790    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy-metric"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478797    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7d241f9-c4a0-4cee-9fbb-8f7f602ff2e9" containerName="console"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478803    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="kube-rbac-proxy"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478809    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="config-reloader"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478813    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="alertmanager"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478819    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e375e5-395e-41a3-bdcc-771eb25d418f" containerName="console"
Jul 23 19:22:47.478972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.478824    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" containerName="prom-label-proxy"
Jul 23 19:22:47.482406 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.482389    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.489404 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.488193    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 19:22:47.489404 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.488455    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 19:22:47.489404 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.488846    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 19:22:47.489404 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.489033    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 19:22:47.489404 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.489238    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 19:22:47.489821 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.489418    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9w2c6\""
Jul 23 19:22:47.489821 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.489580    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 19:22:47.489821 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.489800    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 19:22:47.490589 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.490529    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 19:22:47.493782 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.493765    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 19:22:47.503821 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.503792    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:22:47.635899 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.635865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.635906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc33efe-5aa8-478d-88d0-0d104492b3b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.635938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cc33efe-5aa8-478d-88d0-0d104492b3b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636009    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cc33efe-5aa8-478d-88d0-0d104492b3b6-config-out\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636342 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636342 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636342 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rtb9\" (UniqueName: \"kubernetes.io/projected/0cc33efe-5aa8-478d-88d0-0d104492b3b6-kube-api-access-5rtb9\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636342 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc33efe-5aa8-478d-88d0-0d104492b3b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636342 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cc33efe-5aa8-478d-88d0-0d104492b3b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636534 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.636534 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.636407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-web-config\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737333 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737551 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cc33efe-5aa8-478d-88d0-0d104492b3b6-config-out\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737551 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737675 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737675 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737675 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rtb9\" (UniqueName: \"kubernetes.io/projected/0cc33efe-5aa8-478d-88d0-0d104492b3b6-kube-api-access-5rtb9\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737816 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc33efe-5aa8-478d-88d0-0d104492b3b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737867 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cc33efe-5aa8-478d-88d0-0d104492b3b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737914 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737961 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-web-config\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.737961 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.738047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.737969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc33efe-5aa8-478d-88d0-0d104492b3b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.738047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.738028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cc33efe-5aa8-478d-88d0-0d104492b3b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.738580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.738552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cc33efe-5aa8-478d-88d0-0d104492b3b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.738807 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.738782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc33efe-5aa8-478d-88d0-0d104492b3b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.739398 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.739375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc33efe-5aa8-478d-88d0-0d104492b3b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.740534 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.740503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cc33efe-5aa8-478d-88d0-0d104492b3b6-config-out\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.740746 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.740727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.740897 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.740876    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.741189 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.741172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.741263 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.741244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.741525 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.741502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.741621 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.741603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-web-config\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.741884 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.741869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cc33efe-5aa8-478d-88d0-0d104492b3b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.742601 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.742586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cc33efe-5aa8-478d-88d0-0d104492b3b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.748424 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.748405    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rtb9\" (UniqueName: \"kubernetes.io/projected/0cc33efe-5aa8-478d-88d0-0d104492b3b6-kube-api-access-5rtb9\") pod \"alertmanager-main-0\" (UID: \"0cc33efe-5aa8-478d-88d0-0d104492b3b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.793920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.793642    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 19:22:47.942899 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:47.942524    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 19:22:47.945637 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:22:47.945614    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc33efe_5aa8_478d_88d0_0d104492b3b6.slice/crio-5da7dfc9bdcddcfceffa48d4414862d85eb952913b8481cd8d52b61ed4f051f9 WatchSource:0}: Error finding container 5da7dfc9bdcddcfceffa48d4414862d85eb952913b8481cd8d52b61ed4f051f9: Status 404 returned error can't find the container with id 5da7dfc9bdcddcfceffa48d4414862d85eb952913b8481cd8d52b61ed4f051f9
Jul 23 19:22:48.429756 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:48.429658    2561 generic.go:356] "Generic (PLEG): container finished" podID="0cc33efe-5aa8-478d-88d0-0d104492b3b6" containerID="3752a1f0207ff6bb7948bd8cdb54b2b50a1752ac1bf63ad939c479cb55daeba7" exitCode=0
Jul 23 19:22:48.429756 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:48.429740    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cc33efe-5aa8-478d-88d0-0d104492b3b6","Type":"ContainerDied","Data":"3752a1f0207ff6bb7948bd8cdb54b2b50a1752ac1bf63ad939c479cb55daeba7"}
Jul 23 19:22:48.430256 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:48.429857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cc33efe-5aa8-478d-88d0-0d104492b3b6","Type":"ContainerStarted","Data":"5da7dfc9bdcddcfceffa48d4414862d85eb952913b8481cd8d52b61ed4f051f9"}
Jul 23 19:22:48.566750 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:48.566726    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68082282-7723-4f25-8651-fd4e277a7f8a" path="/var/lib/kubelet/pods/68082282-7723-4f25-8651-fd4e277a7f8a/volumes"
Jul 23 19:22:49.437296 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:49.437261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cc33efe-5aa8-478d-88d0-0d104492b3b6","Type":"ContainerStarted","Data":"01a57e429dabb78b4419b0e40d230df542f1ece78464cc7798d85aa76a38f381"}
Jul 23 19:22:49.437738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:49.437337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cc33efe-5aa8-478d-88d0-0d104492b3b6","Type":"ContainerStarted","Data":"2b8f0a292fa9546a2af6f4fc02714040d9f0ef86571ffa2dbebe0a2dc1f33ee1"}
Jul 23 19:22:49.437738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:49.437402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cc33efe-5aa8-478d-88d0-0d104492b3b6","Type":"ContainerStarted","Data":"0f670a42b2ea2e824687579d1f40e2b63129b6f7136c068093b89997b4fda766"}
Jul 23 19:22:49.437738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:49.437449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cc33efe-5aa8-478d-88d0-0d104492b3b6","Type":"ContainerStarted","Data":"89aea45f492527283912b86059a96d933b40cfaac776f5b6f4d9201e6e9c99e2"}
Jul 23 19:22:49.437738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:49.437489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cc33efe-5aa8-478d-88d0-0d104492b3b6","Type":"ContainerStarted","Data":"0e8e9490b5d0d4f753c345112a4304393d5dd42fd7c0f8145a13b2a17c10fa5d"}
Jul 23 19:22:49.437738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:49.437524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cc33efe-5aa8-478d-88d0-0d104492b3b6","Type":"ContainerStarted","Data":"53d1c75d2afc9c8a8ab9c9d88bdbc29821edbe6f9430031db127b314e0a0968e"}
Jul 23 19:22:49.471076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:49.471014    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.456070208 podStartE2EDuration="2.47099603s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.925822ms" isStatefulPod=false podCreationTimestamp="2026-07-23 19:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:22:49.468118732 +0000 UTC m=+147.402178870" watchObservedRunningTime="2026-07-23 19:22:49.47099603 +0000 UTC m=+147.405056177"
Jul 23 19:22:50.128341 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.128304    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:22:50.128759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.128726    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="prometheus" containerID="cri-o://cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb" gracePeriod=600
Jul 23 19:22:50.128759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.128743    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b" gracePeriod=600
Jul 23 19:22:50.128931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.128780    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy" containerID="cri-o://011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8" gracePeriod=600
Jul 23 19:22:50.128931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.128751    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy-web" containerID="cri-o://7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8" gracePeriod=600
Jul 23 19:22:50.128931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.128873    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="config-reloader" containerID="cri-o://6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448" gracePeriod=600
Jul 23 19:22:50.128931 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.128918    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="thanos-sidecar" containerID="cri-o://73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393" gracePeriod=600
Jul 23 19:22:50.396800 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.396773    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.448678 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448647    2561 generic.go:356] "Generic (PLEG): container finished" podID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b" exitCode=0
Jul 23 19:22:50.448678 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448671    2561 generic.go:356] "Generic (PLEG): container finished" podID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8" exitCode=0
Jul 23 19:22:50.448678 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448680    2561 generic.go:356] "Generic (PLEG): container finished" podID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8" exitCode=0
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448688    2561 generic.go:356] "Generic (PLEG): container finished" podID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393" exitCode=0
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448696    2561 generic.go:356] "Generic (PLEG): container finished" podID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448" exitCode=0
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448705    2561 generic.go:356] "Generic (PLEG): container finished" podID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb" exitCode=0
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448737    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerDied","Data":"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"}
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerDied","Data":"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"}
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448874    2561 scope.go:117] "RemoveContainer" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.448878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerDied","Data":"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"}
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.449009    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerDied","Data":"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"}
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.449044    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerDied","Data":"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"}
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.449071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerDied","Data":"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"}
Jul 23 19:22:50.449209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.449097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4525c3fe-5563-4816-9483-77bebf58fc4b","Type":"ContainerDied","Data":"f0648aa8f32e856c7b07f7e912eba9820ea30a0ce8888ce5dbc10d65f8616ba8"}
Jul 23 19:22:50.459113 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.459090    2561 scope.go:117] "RemoveContainer" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"
Jul 23 19:22:50.468203 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.468174    2561 scope.go:117] "RemoveContainer" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"
Jul 23 19:22:50.478541 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.478379    2561 scope.go:117] "RemoveContainer" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"
Jul 23 19:22:50.486489 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.486459    2561 scope.go:117] "RemoveContainer" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"
Jul 23 19:22:50.494887 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.494862    2561 scope.go:117] "RemoveContainer" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"
Jul 23 19:22:50.502963 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.502944    2561 scope.go:117] "RemoveContainer" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"
Jul 23 19:22:50.510518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.510498    2561 scope.go:117] "RemoveContainer" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"
Jul 23 19:22:50.510798 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:50.510780    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": container with ID starting with ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b not found: ID does not exist" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"
Jul 23 19:22:50.510874 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.510811    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"} err="failed to get container status \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": rpc error: code = NotFound desc = could not find container \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": container with ID starting with ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b not found: ID does not exist"
Jul 23 19:22:50.510874 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.510829    2561 scope.go:117] "RemoveContainer" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"
Jul 23 19:22:50.511060 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:50.511043    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": container with ID starting with 011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8 not found: ID does not exist" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"
Jul 23 19:22:50.511116 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.511072    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"} err="failed to get container status \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": rpc error: code = NotFound desc = could not find container \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": container with ID starting with 011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8 not found: ID does not exist"
Jul 23 19:22:50.511116 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.511094    2561 scope.go:117] "RemoveContainer" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"
Jul 23 19:22:50.511319 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:50.511304    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": container with ID starting with 7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8 not found: ID does not exist" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"
Jul 23 19:22:50.511393 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.511323    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"} err="failed to get container status \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": rpc error: code = NotFound desc = could not find container \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": container with ID starting with 7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8 not found: ID does not exist"
Jul 23 19:22:50.511393 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.511336    2561 scope.go:117] "RemoveContainer" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"
Jul 23 19:22:50.511591 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:50.511575    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": container with ID starting with 73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393 not found: ID does not exist" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"
Jul 23 19:22:50.511635 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.511597    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"} err="failed to get container status \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": rpc error: code = NotFound desc = could not find container \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": container with ID starting with 73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393 not found: ID does not exist"
Jul 23 19:22:50.511635 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.511610    2561 scope.go:117] "RemoveContainer" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"
Jul 23 19:22:50.511799 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:50.511783    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": container with ID starting with 6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448 not found: ID does not exist" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"
Jul 23 19:22:50.511836 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.511804    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"} err="failed to get container status \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": rpc error: code = NotFound desc = could not find container \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": container with ID starting with 6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448 not found: ID does not exist"
Jul 23 19:22:50.511836 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.511825    2561 scope.go:117] "RemoveContainer" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"
Jul 23 19:22:50.512040 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:50.512025    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": container with ID starting with cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb not found: ID does not exist" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"
Jul 23 19:22:50.512075 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.512044    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"} err="failed to get container status \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": rpc error: code = NotFound desc = could not find container \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": container with ID starting with cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb not found: ID does not exist"
Jul 23 19:22:50.512075 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.512058    2561 scope.go:117] "RemoveContainer" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"
Jul 23 19:22:50.512294 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:22:50.512279    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": container with ID starting with d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca not found: ID does not exist" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"
Jul 23 19:22:50.512405 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.512299    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"} err="failed to get container status \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": rpc error: code = NotFound desc = could not find container \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": container with ID starting with d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca not found: ID does not exist"
Jul 23 19:22:50.512405 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.512311    2561 scope.go:117] "RemoveContainer" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"
Jul 23 19:22:50.512590 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.512565    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"} err="failed to get container status \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": rpc error: code = NotFound desc = could not find container \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": container with ID starting with ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b not found: ID does not exist"
Jul 23 19:22:50.512648 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.512592    2561 scope.go:117] "RemoveContainer" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"
Jul 23 19:22:50.512874 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.512853    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"} err="failed to get container status \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": rpc error: code = NotFound desc = could not find container \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": container with ID starting with 011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8 not found: ID does not exist"
Jul 23 19:22:50.512874 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.512873    2561 scope.go:117] "RemoveContainer" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"
Jul 23 19:22:50.513115 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.513097    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"} err="failed to get container status \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": rpc error: code = NotFound desc = could not find container \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": container with ID starting with 7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8 not found: ID does not exist"
Jul 23 19:22:50.513183 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.513117    2561 scope.go:117] "RemoveContainer" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"
Jul 23 19:22:50.513335 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.513319    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"} err="failed to get container status \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": rpc error: code = NotFound desc = could not find container \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": container with ID starting with 73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393 not found: ID does not exist"
Jul 23 19:22:50.513441 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.513336    2561 scope.go:117] "RemoveContainer" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"
Jul 23 19:22:50.513624 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.513598    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"} err="failed to get container status \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": rpc error: code = NotFound desc = could not find container \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": container with ID starting with 6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448 not found: ID does not exist"
Jul 23 19:22:50.513671 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.513626    2561 scope.go:117] "RemoveContainer" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"
Jul 23 19:22:50.513841 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.513823    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"} err="failed to get container status \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": rpc error: code = NotFound desc = could not find container \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": container with ID starting with cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb not found: ID does not exist"
Jul 23 19:22:50.513909 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.513842    2561 scope.go:117] "RemoveContainer" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"
Jul 23 19:22:50.514061 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514044    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"} err="failed to get container status \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": rpc error: code = NotFound desc = could not find container \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": container with ID starting with d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca not found: ID does not exist"
Jul 23 19:22:50.514106 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514063    2561 scope.go:117] "RemoveContainer" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"
Jul 23 19:22:50.514274 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514257    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"} err="failed to get container status \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": rpc error: code = NotFound desc = could not find container \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": container with ID starting with ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b not found: ID does not exist"
Jul 23 19:22:50.514343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514276    2561 scope.go:117] "RemoveContainer" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"
Jul 23 19:22:50.514500 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514485    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"} err="failed to get container status \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": rpc error: code = NotFound desc = could not find container \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": container with ID starting with 011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8 not found: ID does not exist"
Jul 23 19:22:50.514561 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514502    2561 scope.go:117] "RemoveContainer" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"
Jul 23 19:22:50.514769 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514749    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"} err="failed to get container status \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": rpc error: code = NotFound desc = could not find container \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": container with ID starting with 7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8 not found: ID does not exist"
Jul 23 19:22:50.514817 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514770    2561 scope.go:117] "RemoveContainer" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"
Jul 23 19:22:50.514965 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514947    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"} err="failed to get container status \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": rpc error: code = NotFound desc = could not find container \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": container with ID starting with 73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393 not found: ID does not exist"
Jul 23 19:22:50.515009 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.514966    2561 scope.go:117] "RemoveContainer" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"
Jul 23 19:22:50.515167 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.515151    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"} err="failed to get container status \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": rpc error: code = NotFound desc = could not find container \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": container with ID starting with 6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448 not found: ID does not exist"
Jul 23 19:22:50.515233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.515169    2561 scope.go:117] "RemoveContainer" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"
Jul 23 19:22:50.515452 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.515428    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"} err="failed to get container status \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": rpc error: code = NotFound desc = could not find container \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": container with ID starting with cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb not found: ID does not exist"
Jul 23 19:22:50.515514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.515450    2561 scope.go:117] "RemoveContainer" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"
Jul 23 19:22:50.515720 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.515699    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"} err="failed to get container status \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": rpc error: code = NotFound desc = could not find container \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": container with ID starting with d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca not found: ID does not exist"
Jul 23 19:22:50.515720 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.515718    2561 scope.go:117] "RemoveContainer" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"
Jul 23 19:22:50.515969 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.515951    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"} err="failed to get container status \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": rpc error: code = NotFound desc = could not find container \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": container with ID starting with ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b not found: ID does not exist"
Jul 23 19:22:50.516017 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.515971    2561 scope.go:117] "RemoveContainer" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"
Jul 23 19:22:50.516178 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516163    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"} err="failed to get container status \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": rpc error: code = NotFound desc = could not find container \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": container with ID starting with 011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8 not found: ID does not exist"
Jul 23 19:22:50.516229 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516179    2561 scope.go:117] "RemoveContainer" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"
Jul 23 19:22:50.516406 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516391    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"} err="failed to get container status \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": rpc error: code = NotFound desc = could not find container \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": container with ID starting with 7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8 not found: ID does not exist"
Jul 23 19:22:50.516457 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516407    2561 scope.go:117] "RemoveContainer" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"
Jul 23 19:22:50.516612 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516592    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"} err="failed to get container status \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": rpc error: code = NotFound desc = could not find container \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": container with ID starting with 73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393 not found: ID does not exist"
Jul 23 19:22:50.516682 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516614    2561 scope.go:117] "RemoveContainer" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"
Jul 23 19:22:50.516816 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516801    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"} err="failed to get container status \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": rpc error: code = NotFound desc = could not find container \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": container with ID starting with 6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448 not found: ID does not exist"
Jul 23 19:22:50.516857 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516816    2561 scope.go:117] "RemoveContainer" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"
Jul 23 19:22:50.516992 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516977    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"} err="failed to get container status \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": rpc error: code = NotFound desc = could not find container \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": container with ID starting with cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb not found: ID does not exist"
Jul 23 19:22:50.517035 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.516991    2561 scope.go:117] "RemoveContainer" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"
Jul 23 19:22:50.517173 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517155    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"} err="failed to get container status \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": rpc error: code = NotFound desc = could not find container \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": container with ID starting with d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca not found: ID does not exist"
Jul 23 19:22:50.517239 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517175    2561 scope.go:117] "RemoveContainer" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"
Jul 23 19:22:50.517410 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517391    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"} err="failed to get container status \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": rpc error: code = NotFound desc = could not find container \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": container with ID starting with ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b not found: ID does not exist"
Jul 23 19:22:50.517478 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517414    2561 scope.go:117] "RemoveContainer" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"
Jul 23 19:22:50.517598 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517581    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"} err="failed to get container status \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": rpc error: code = NotFound desc = could not find container \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": container with ID starting with 011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8 not found: ID does not exist"
Jul 23 19:22:50.517658 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517600    2561 scope.go:117] "RemoveContainer" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"
Jul 23 19:22:50.517784 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517767    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"} err="failed to get container status \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": rpc error: code = NotFound desc = could not find container \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": container with ID starting with 7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8 not found: ID does not exist"
Jul 23 19:22:50.517845 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517784    2561 scope.go:117] "RemoveContainer" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"
Jul 23 19:22:50.517970 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517955    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"} err="failed to get container status \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": rpc error: code = NotFound desc = could not find container \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": container with ID starting with 73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393 not found: ID does not exist"
Jul 23 19:22:50.518020 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.517971    2561 scope.go:117] "RemoveContainer" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"
Jul 23 19:22:50.518158 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518142    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"} err="failed to get container status \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": rpc error: code = NotFound desc = could not find container \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": container with ID starting with 6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448 not found: ID does not exist"
Jul 23 19:22:50.518197 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518159    2561 scope.go:117] "RemoveContainer" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"
Jul 23 19:22:50.518327 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518312    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"} err="failed to get container status \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": rpc error: code = NotFound desc = could not find container \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": container with ID starting with cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb not found: ID does not exist"
Jul 23 19:22:50.518407 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518327    2561 scope.go:117] "RemoveContainer" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"
Jul 23 19:22:50.518537 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518518    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"} err="failed to get container status \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": rpc error: code = NotFound desc = could not find container \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": container with ID starting with d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca not found: ID does not exist"
Jul 23 19:22:50.518605 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518539    2561 scope.go:117] "RemoveContainer" containerID="ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"
Jul 23 19:22:50.518742 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518725    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b"} err="failed to get container status \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": rpc error: code = NotFound desc = could not find container \"ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b\": container with ID starting with ea6c7a378f568d0dfefd2f1e70a4153908f3681e63f49f67059b1dd423b0b48b not found: ID does not exist"
Jul 23 19:22:50.518800 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518742    2561 scope.go:117] "RemoveContainer" containerID="011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"
Jul 23 19:22:50.518942 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518926    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8"} err="failed to get container status \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": rpc error: code = NotFound desc = could not find container \"011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8\": container with ID starting with 011ab3ab546c8e937006064b655aed51f27dc4e94925f2a1af93dc9c600d6de8 not found: ID does not exist"
Jul 23 19:22:50.519005 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.518943    2561 scope.go:117] "RemoveContainer" containerID="7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"
Jul 23 19:22:50.519116 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519100    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8"} err="failed to get container status \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": rpc error: code = NotFound desc = could not find container \"7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8\": container with ID starting with 7ec1af958554c90e2166cddaa0fe40cbe5bee1c982ee3c1db8b6b57767b1f3a8 not found: ID does not exist"
Jul 23 19:22:50.519157 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519115    2561 scope.go:117] "RemoveContainer" containerID="73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"
Jul 23 19:22:50.519287 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519271    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393"} err="failed to get container status \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": rpc error: code = NotFound desc = could not find container \"73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393\": container with ID starting with 73f863e9900908f42b87f6ad07b5814e88afb3a432b76ae63c62af78b6936393 not found: ID does not exist"
Jul 23 19:22:50.519369 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519288    2561 scope.go:117] "RemoveContainer" containerID="6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"
Jul 23 19:22:50.519515 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519499    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448"} err="failed to get container status \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": rpc error: code = NotFound desc = could not find container \"6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448\": container with ID starting with 6c0fd111c1b823d6360d46aa501053f223c6f82bc55d8506325109fda64c4448 not found: ID does not exist"
Jul 23 19:22:50.519580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519516    2561 scope.go:117] "RemoveContainer" containerID="cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"
Jul 23 19:22:50.519720 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519705    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb"} err="failed to get container status \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": rpc error: code = NotFound desc = could not find container \"cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb\": container with ID starting with cad45e976da3d6d8f07d70e021f42ed53c9d8848ea4320ee6834cf4f9c61cfcb not found: ID does not exist"
Jul 23 19:22:50.519772 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519720    2561 scope.go:117] "RemoveContainer" containerID="d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"
Jul 23 19:22:50.519975 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.519957    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca"} err="failed to get container status \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": rpc error: code = NotFound desc = could not find container \"d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca\": container with ID starting with d6638fe0b4216f061419513801dbd64495fc1dd87d0009bded56cec5acf7f2ca not found: ID does not exist"
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566232    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-kube-rbac-proxy\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-serving-certs-ca-bundle\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566375    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-1\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566411    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566451    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-grpc-tls\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-web-config\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566530    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-thanos-prometheus-http-client-file\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566563    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-kubelet-serving-ca-bundle\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566596    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-trusted-ca-bundle\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566627    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-0\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-db\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566692    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-config\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566731    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-config-out\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566761    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-tls-assets\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566837    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566869    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-tls\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566893    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fw4x\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-kube-api-access-6fw4x\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.568246 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566934    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-metrics-client-ca\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.569160 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566968    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-2\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.569160 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.566999    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-metrics-client-certs\") pod \"4525c3fe-5563-4816-9483-77bebf58fc4b\" (UID: \"4525c3fe-5563-4816-9483-77bebf58fc4b\") "
Jul 23 19:22:50.571259 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.571225    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:50.571458 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.571305    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.571869 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.571814    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.571972 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.571909    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:50.572395 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.572244    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:50.572395 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.572257    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:50.572395 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.572263    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:50.574433 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.573938    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:50.574433 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.574397    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:22:50.574776 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.574638    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:22:50.575047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.575023    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-config" (OuterVolumeSpecName: "config") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.575125 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.575105    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-kube-api-access-6fw4x" (OuterVolumeSpecName: "kube-api-access-6fw4x") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "kube-api-access-6fw4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:22:50.576233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.576182    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-config-out" (OuterVolumeSpecName: "config-out") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:22:50.576399 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.576374    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.576671 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.576640    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.576941 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.576919    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:22:50.577090 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.577069    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.577307 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.577285    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.577520 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.577498    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.588098 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.588063    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-web-config" (OuterVolumeSpecName: "web-config") pod "4525c3fe-5563-4816-9483-77bebf58fc4b" (UID: "4525c3fe-5563-4816-9483-77bebf58fc4b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668669    2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-grpc-tls\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668699    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-web-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668711    2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668721    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668732    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668741    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668749    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-db\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668758    2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.668760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668765    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4525c3fe-5563-4816-9483-77bebf58fc4b-config-out\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668774    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-tls-assets\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668782    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668791    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668799    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fw4x\" (UniqueName: \"kubernetes.io/projected/4525c3fe-5563-4816-9483-77bebf58fc4b-kube-api-access-6fw4x\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668807    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-metrics-client-ca\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668815    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668824    2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-metrics-client-certs\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668832    2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-kube-rbac-proxy\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668841    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668851    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4525c3fe-5563-4816-9483-77bebf58fc4b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.669123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.668859    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4525c3fe-5563-4816-9483-77bebf58fc4b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:22:50.775439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.775401    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:22:50.780920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.780890    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:22:50.810394 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810341    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:22:50.810696 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810681    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy-thanos"
Jul 23 19:22:50.810739 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810700    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy-thanos"
Jul 23 19:22:50.810739 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810713    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="prometheus"
Jul 23 19:22:50.810739 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810721    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="prometheus"
Jul 23 19:22:50.810739 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810733    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy-web"
Jul 23 19:22:50.810739 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810739    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy-web"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810750    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="thanos-sidecar"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810755    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="thanos-sidecar"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810765    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="init-config-reloader"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810770    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="init-config-reloader"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810779    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810788    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810799    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="config-reloader"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810804    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="config-reloader"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810850    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810861    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="thanos-sidecar"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810870    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy-thanos"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810876    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="kube-rbac-proxy-web"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810881    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="prometheus"
Jul 23 19:22:50.810907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.810888    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" containerName="config-reloader"
Jul 23 19:22:50.817196 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.817169    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.823143 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.823111    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 19:22:50.823143 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.823135    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 19:22:50.823380 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.823216    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 19:22:50.823380 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.823297    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5khtsk92fvdob\""
Jul 23 19:22:50.823704 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.823684    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 19:22:50.823804 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.823760    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 19:22:50.824281 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.824253    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 19:22:50.824517 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.824500    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 19:22:50.824569 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.824525    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 19:22:50.824693 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.824679    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 19:22:50.824782 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.824768    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 19:22:50.824912 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.824898    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 19:22:50.824949 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.824919    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 19:22:50.825580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.825555    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-72bdv\""
Jul 23 19:22:50.828290 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.828267    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 19:22:50.832983 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.832957    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:22:50.833113 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.833060    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 19:22:50.971463 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971638 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971638 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971638 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971638 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-config\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971638 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971638 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971813    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.971878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.972108 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.972108 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.972108 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.972108 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971964    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsvjv\" (UniqueName: \"kubernetes.io/projected/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-kube-api-access-gsvjv\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.972108 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:50.972108 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:50.971996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.072769 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.072729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.072769 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.072773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.072971 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.072794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.072971 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.072813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-config\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.073064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.072959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.073064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.073167 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.073167 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.073498 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073650    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073739    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsvjv\" (UniqueName: \"kubernetes.io/projected/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-kube-api-access-gsvjv\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.073986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.074019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.074343 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.074027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.076913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.075929    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.076913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.076182    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.076913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.076182    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.076913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.076397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-config\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.076913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.076424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.076913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.076604    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.076913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.076675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.076913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.076424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.077394 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.077242    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.077394 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.077271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.077722 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.077649    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.077935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.077917    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.078438 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.078420    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.079171 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.079150    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.079432 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.079414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.079559 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.079539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.085102 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.085079    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsvjv\" (UniqueName: \"kubernetes.io/projected/dc8ac976-9c87-484f-986c-ad8dafa1ea9b-kube-api-access-gsvjv\") pod \"prometheus-k8s-0\" (UID: \"dc8ac976-9c87-484f-986c-ad8dafa1ea9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.131173 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.131147    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:22:51.275057 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.275031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 19:22:51.277538 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:22:51.277497    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8ac976_9c87_484f_986c_ad8dafa1ea9b.slice/crio-e62faca6962c4083b5b9ba9c04818b7682f6216fc37e7b1d37a16ab7fdb0a566 WatchSource:0}: Error finding container e62faca6962c4083b5b9ba9c04818b7682f6216fc37e7b1d37a16ab7fdb0a566: Status 404 returned error can't find the container with id e62faca6962c4083b5b9ba9c04818b7682f6216fc37e7b1d37a16ab7fdb0a566
Jul 23 19:22:51.457860 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.457831    2561 generic.go:356] "Generic (PLEG): container finished" podID="dc8ac976-9c87-484f-986c-ad8dafa1ea9b" containerID="3b5d2134ec5003fd1b0054e68342a326b92960f1e450051f22f6fe15a6a40105" exitCode=0
Jul 23 19:22:51.458243 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.457871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc8ac976-9c87-484f-986c-ad8dafa1ea9b","Type":"ContainerDied","Data":"3b5d2134ec5003fd1b0054e68342a326b92960f1e450051f22f6fe15a6a40105"}
Jul 23 19:22:51.458243 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:51.457921    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc8ac976-9c87-484f-986c-ad8dafa1ea9b","Type":"ContainerStarted","Data":"e62faca6962c4083b5b9ba9c04818b7682f6216fc37e7b1d37a16ab7fdb0a566"}
Jul 23 19:22:52.466083 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:52.466046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc8ac976-9c87-484f-986c-ad8dafa1ea9b","Type":"ContainerStarted","Data":"0c4026a43173dd358dde41a0989c8d905f52214e9a1849d0d06d2b45984aa018"}
Jul 23 19:22:52.466576 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:52.466140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc8ac976-9c87-484f-986c-ad8dafa1ea9b","Type":"ContainerStarted","Data":"af2ead697a328958d92d4f6c0a53f018e9697eee41183c62a3b8dbdde5c07be4"}
Jul 23 19:22:52.466576 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:52.466178    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc8ac976-9c87-484f-986c-ad8dafa1ea9b","Type":"ContainerStarted","Data":"64f8de7e2b733a73ddad0bfd65f5bd0c4e2b5db9939ebb24b32ca6bb87562b75"}
Jul 23 19:22:52.466576 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:52.466204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc8ac976-9c87-484f-986c-ad8dafa1ea9b","Type":"ContainerStarted","Data":"45175c46fb27077a3dc6df48e4e70fccbbfad36d6e23a2d6385196d50f573ffa"}
Jul 23 19:22:52.466576 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:52.466226    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc8ac976-9c87-484f-986c-ad8dafa1ea9b","Type":"ContainerStarted","Data":"813721d1463b26de1e42bd368ad4c89d20ab8d893449c140d55798a4b6e0ff48"}
Jul 23 19:22:52.466576 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:52.466258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc8ac976-9c87-484f-986c-ad8dafa1ea9b","Type":"ContainerStarted","Data":"5283d2fc0fe554cbcd3f4e9d00791b85455a3c3c6edaa964a4098b843d54718f"}
Jul 23 19:22:52.508297 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:52.508241    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.489647292 podStartE2EDuration="2.508219261s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.571969ms" isStatefulPod=false podCreationTimestamp="2026-07-23 19:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:22:52.505829583 +0000 UTC m=+150.439889730" watchObservedRunningTime="2026-07-23 19:22:52.508219261 +0000 UTC m=+150.442279408"
Jul 23 19:22:52.565523 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:52.565489    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4525c3fe-5563-4816-9483-77bebf58fc4b" path="/var/lib/kubelet/pods/4525c3fe-5563-4816-9483-77bebf58fc4b/volumes"
Jul 23 19:22:54.400603 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.400572    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-756fd5db99-g89s4"]
Jul 23 19:22:54.405059 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.405039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.421750 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.421724    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-756fd5db99-g89s4"]
Jul 23 19:22:54.507948 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.507915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9pw2\" (UniqueName: \"kubernetes.io/projected/4c2fcb65-2c71-4856-a141-4aaa677dfbed-kube-api-access-v9pw2\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.508111 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.507974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-serving-cert\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.508111 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.508018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-service-ca\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.508111 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.508054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-oauth-serving-cert\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.508111 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.508079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-oauth-config\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.508111 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.508093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-trusted-ca-bundle\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.508277 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.508139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-config\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.535934 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.535904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:22:54.608874 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.608837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-config\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.608905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9pw2\" (UniqueName: \"kubernetes.io/projected/4c2fcb65-2c71-4856-a141-4aaa677dfbed-kube-api-access-v9pw2\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.608965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-serving-cert\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.608991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-service-ca\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.609012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-oauth-serving-cert\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.609037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-oauth-config\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.609058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-trusted-ca-bundle\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609587 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.609562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-config\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609745 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.609719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-service-ca\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609898 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.609875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-oauth-serving-cert\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.609964 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.609882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-trusted-ca-bundle\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.611609 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.611583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-oauth-config\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.611850 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.611829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-serving-cert\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.618702 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.618675    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:22:54.620455 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.620433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9pw2\" (UniqueName: \"kubernetes.io/projected/4c2fcb65-2c71-4856-a141-4aaa677dfbed-kube-api-access-v9pw2\") pod \"console-756fd5db99-g89s4\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") " pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.714483 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.714455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:22:54.715331 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.715316    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:22:54.848857 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:54.848764    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-756fd5db99-g89s4"]
Jul 23 19:22:54.851568 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:22:54.851540    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2fcb65_2c71_4856_a141_4aaa677dfbed.slice/crio-43c22dbf027984ce1b8b496d233c1053e6f2b63235624b56af1983e3f9bd81d0 WatchSource:0}: Error finding container 43c22dbf027984ce1b8b496d233c1053e6f2b63235624b56af1983e3f9bd81d0: Status 404 returned error can't find the container with id 43c22dbf027984ce1b8b496d233c1053e6f2b63235624b56af1983e3f9bd81d0
Jul 23 19:22:55.212661 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:55.212631    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:22:55.278267 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:55.278235    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:22:55.481028 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:55.480942    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756fd5db99-g89s4" event={"ID":"4c2fcb65-2c71-4856-a141-4aaa677dfbed","Type":"ContainerStarted","Data":"a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a"}
Jul 23 19:22:55.481028 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:55.480996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756fd5db99-g89s4" event={"ID":"4c2fcb65-2c71-4856-a141-4aaa677dfbed","Type":"ContainerStarted","Data":"43c22dbf027984ce1b8b496d233c1053e6f2b63235624b56af1983e3f9bd81d0"}
Jul 23 19:22:55.500165 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:55.500117    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-756fd5db99-g89s4" podStartSLOduration=1.500101485 podStartE2EDuration="1.500101485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:22:55.498870411 +0000 UTC m=+153.432930558" watchObservedRunningTime="2026-07-23 19:22:55.500101485 +0000 UTC m=+153.434161631"
Jul 23 19:22:56.131548 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:22:56.131512    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:23:04.716224 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:04.716184    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:23:04.716769 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:04.716256    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:23:04.720966 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:04.720945    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:23:05.526635 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:05.526607    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:23:05.577315 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:05.577284    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69b59f7464-hh45h"]
Jul 23 19:23:05.693883 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:05.693853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:23:05.796706 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:05.796615    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:23:05.858790 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:05.858762    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:23:11.193675 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:11.193644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:23:11.250299 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:11.250264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:23:30.605372 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:30.605317    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69b59f7464-hh45h" podUID="caaf831f-30f1-48cb-add3-f7bb42ff06d9" containerName="console" containerID="cri-o://4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b" gracePeriod=15
Jul 23 19:23:30.863219 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:30.863151    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:23:31.038306 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038268    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-config\") pod \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") "
Jul 23 19:23:31.038505 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038323    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-oauth-serving-cert\") pod \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") "
Jul 23 19:23:31.038505 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038372    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-serving-cert\") pod \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") "
Jul 23 19:23:31.038581 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038530    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-trusted-ca-bundle\") pod \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") "
Jul 23 19:23:31.038581 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038564    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-oauth-config\") pod \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") "
Jul 23 19:23:31.038656 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-service-ca\") pod \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") "
Jul 23 19:23:31.038656 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038633    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8mxb\" (UniqueName: \"kubernetes.io/projected/caaf831f-30f1-48cb-add3-f7bb42ff06d9-kube-api-access-b8mxb\") pod \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\" (UID: \"caaf831f-30f1-48cb-add3-f7bb42ff06d9\") "
Jul 23 19:23:31.038838 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038807    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-config" (OuterVolumeSpecName: "console-config") pod "caaf831f-30f1-48cb-add3-f7bb42ff06d9" (UID: "caaf831f-30f1-48cb-add3-f7bb42ff06d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:23:31.038916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038817    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "caaf831f-30f1-48cb-add3-f7bb42ff06d9" (UID: "caaf831f-30f1-48cb-add3-f7bb42ff06d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:23:31.038975 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038958    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:23:31.039023 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038974    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-oauth-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:23:31.039023 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.038985    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "caaf831f-30f1-48cb-add3-f7bb42ff06d9" (UID: "caaf831f-30f1-48cb-add3-f7bb42ff06d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:23:31.039099 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.039028    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "caaf831f-30f1-48cb-add3-f7bb42ff06d9" (UID: "caaf831f-30f1-48cb-add3-f7bb42ff06d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:23:31.040761 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.040739    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "caaf831f-30f1-48cb-add3-f7bb42ff06d9" (UID: "caaf831f-30f1-48cb-add3-f7bb42ff06d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:23:31.040952 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.040932    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "caaf831f-30f1-48cb-add3-f7bb42ff06d9" (UID: "caaf831f-30f1-48cb-add3-f7bb42ff06d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:23:31.041008 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.040968    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caaf831f-30f1-48cb-add3-f7bb42ff06d9-kube-api-access-b8mxb" (OuterVolumeSpecName: "kube-api-access-b8mxb") pod "caaf831f-30f1-48cb-add3-f7bb42ff06d9" (UID: "caaf831f-30f1-48cb-add3-f7bb42ff06d9"). InnerVolumeSpecName "kube-api-access-b8mxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:23:31.139734 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.139651    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:23:31.139734 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.139682    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-trusted-ca-bundle\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:23:31.139734 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.139694    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/caaf831f-30f1-48cb-add3-f7bb42ff06d9-console-oauth-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:23:31.139734 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.139704    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/caaf831f-30f1-48cb-add3-f7bb42ff06d9-service-ca\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:23:31.139734 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.139712    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8mxb\" (UniqueName: \"kubernetes.io/projected/caaf831f-30f1-48cb-add3-f7bb42ff06d9-kube-api-access-b8mxb\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:23:31.629510 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.629475    2561 generic.go:356] "Generic (PLEG): container finished" podID="caaf831f-30f1-48cb-add3-f7bb42ff06d9" containerID="4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b" exitCode=0
Jul 23 19:23:31.629988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.629541    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b59f7464-hh45h"
Jul 23 19:23:31.629988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.629567    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b59f7464-hh45h" event={"ID":"caaf831f-30f1-48cb-add3-f7bb42ff06d9","Type":"ContainerDied","Data":"4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b"}
Jul 23 19:23:31.629988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.629629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b59f7464-hh45h" event={"ID":"caaf831f-30f1-48cb-add3-f7bb42ff06d9","Type":"ContainerDied","Data":"dca4ced13b047392bac98ae383bca6c4bfa36f0ac9724c366889b41200fb8f31"}
Jul 23 19:23:31.629988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.629659    2561 scope.go:117] "RemoveContainer" containerID="4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b"
Jul 23 19:23:31.638479 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.638462    2561 scope.go:117] "RemoveContainer" containerID="4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b"
Jul 23 19:23:31.638758 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:23:31.638741    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b\": container with ID starting with 4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b not found: ID does not exist" containerID="4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b"
Jul 23 19:23:31.638816 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.638767    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b"} err="failed to get container status \"4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b\": rpc error: code = NotFound desc = could not find container \"4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b\": container with ID starting with 4659a4948c6280f634da7ca0ffb79ae14fc82e7915f7f4a19e072129f8410e4b not found: ID does not exist"
Jul 23 19:23:31.650509 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.650486    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69b59f7464-hh45h"]
Jul 23 19:23:31.656335 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:31.656312    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69b59f7464-hh45h"]
Jul 23 19:23:32.566948 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:32.566917    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caaf831f-30f1-48cb-add3-f7bb42ff06d9" path="/var/lib/kubelet/pods/caaf831f-30f1-48cb-add3-f7bb42ff06d9/volumes"
Jul 23 19:23:39.313074 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:39.313036    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:23:51.132263 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:51.132223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:23:51.148458 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:51.148432    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:23:51.734986 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:51.734960    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 19:23:59.990905 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:23:59.990872    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:00.054961 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:00.054925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:06.309616 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.309579    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-96b8f7f98-tfj24"]
Jul 23 19:24:06.310150 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.309900    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caaf831f-30f1-48cb-add3-f7bb42ff06d9" containerName="console"
Jul 23 19:24:06.310150 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.309910    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="caaf831f-30f1-48cb-add3-f7bb42ff06d9" containerName="console"
Jul 23 19:24:06.310150 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.309975    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="caaf831f-30f1-48cb-add3-f7bb42ff06d9" containerName="console"
Jul 23 19:24:06.314217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.314197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.325224 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.325203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96b8f7f98-tfj24"]
Jul 23 19:24:06.431271 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.431230    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:06.459469 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.459435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-oauth-serving-cert\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.459563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.459480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-console-config\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.459563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.459511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-serving-cert\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.459563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.459533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-service-ca\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.459563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.459561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-trusted-ca-bundle\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.459689 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.459593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8dr4\" (UniqueName: \"kubernetes.io/projected/8957d046-ff4a-43bd-a0de-0d85382f5826-kube-api-access-p8dr4\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.459689 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.459660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-oauth-config\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.560403 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.560270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-oauth-serving-cert\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.560403 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.560323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-console-config\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.560403 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.560387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-serving-cert\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.560685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.560409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-service-ca\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.560685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.560442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-trusted-ca-bundle\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.560685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.560485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8dr4\" (UniqueName: \"kubernetes.io/projected/8957d046-ff4a-43bd-a0de-0d85382f5826-kube-api-access-p8dr4\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.560685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.560515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-oauth-config\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.561172 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.561144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-oauth-serving-cert\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.561306 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.561205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-console-config\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.561306 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.561216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-service-ca\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.561619 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.561597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-trusted-ca-bundle\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.563666 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.563644    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-oauth-config\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.563784 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.563718    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-serving-cert\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.575779 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.575746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8dr4\" (UniqueName: \"kubernetes.io/projected/8957d046-ff4a-43bd-a0de-0d85382f5826-kube-api-access-p8dr4\") pod \"console-96b8f7f98-tfj24\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") " pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.600383 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.600322    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:06.623585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.623547    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:06.763884 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.763856    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96b8f7f98-tfj24"]
Jul 23 19:24:06.766558 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:24:06.766531    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8957d046_ff4a_43bd_a0de_0d85382f5826.slice/crio-c7aa01a99efa5eb7ad6e948ecf4428ff72871c48043dd011c9f34b84d6122f96 WatchSource:0}: Error finding container c7aa01a99efa5eb7ad6e948ecf4428ff72871c48043dd011c9f34b84d6122f96: Status 404 returned error can't find the container with id c7aa01a99efa5eb7ad6e948ecf4428ff72871c48043dd011c9f34b84d6122f96
Jul 23 19:24:06.778282 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:06.778258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96b8f7f98-tfj24" event={"ID":"8957d046-ff4a-43bd-a0de-0d85382f5826","Type":"ContainerStarted","Data":"c7aa01a99efa5eb7ad6e948ecf4428ff72871c48043dd011c9f34b84d6122f96"}
Jul 23 19:24:07.118654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:07.118570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:07.223286 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:07.223255    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:07.783857 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:07.783822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96b8f7f98-tfj24" event={"ID":"8957d046-ff4a-43bd-a0de-0d85382f5826","Type":"ContainerStarted","Data":"5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a"}
Jul 23 19:24:07.805347 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:07.805298    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-96b8f7f98-tfj24" podStartSLOduration=1.805282725 podStartE2EDuration="1.805282725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:24:07.803784399 +0000 UTC m=+225.737844547" watchObservedRunningTime="2026-07-23 19:24:07.805282725 +0000 UTC m=+225.739342871"
Jul 23 19:24:11.964680 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:11.964640    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:12.065943 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:12.065906    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:16.624068 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:16.624020    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:16.624068 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:16.624086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:16.628970 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:16.628950    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:16.822994 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:16.822964    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:24:16.906693 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:16.906600    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-756fd5db99-g89s4"]
Jul 23 19:24:17.081497 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:17.081463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:17.187367 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:17.187264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:22.886532 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:22.886497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:23.022118 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:23.022083    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:23.190325 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:23.190236    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:23.251935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:23.251901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:30.646058 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:30.646025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:41.928269 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:41.928232    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-756fd5db99-g89s4" podUID="4c2fcb65-2c71-4856-a141-4aaa677dfbed" containerName="console" containerID="cri-o://a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a" gracePeriod=15
Jul 23 19:24:42.164331 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.164301    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:24:42.267098 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267060    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-serving-cert\") pod \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") "
Jul 23 19:24:42.267098 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267104    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-oauth-config\") pod \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") "
Jul 23 19:24:42.267402 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-oauth-serving-cert\") pod \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") "
Jul 23 19:24:42.267402 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267200    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-trusted-ca-bundle\") pod \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") "
Jul 23 19:24:42.267514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267420    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9pw2\" (UniqueName: \"kubernetes.io/projected/4c2fcb65-2c71-4856-a141-4aaa677dfbed-kube-api-access-v9pw2\") pod \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") "
Jul 23 19:24:42.267514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267462    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-service-ca\") pod \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") "
Jul 23 19:24:42.267514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267486    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-config\") pod \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\" (UID: \"4c2fcb65-2c71-4856-a141-4aaa677dfbed\") "
Jul 23 19:24:42.267775 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267740    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c2fcb65-2c71-4856-a141-4aaa677dfbed" (UID: "4c2fcb65-2c71-4856-a141-4aaa677dfbed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:24:42.267775 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267749    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c2fcb65-2c71-4856-a141-4aaa677dfbed" (UID: "4c2fcb65-2c71-4856-a141-4aaa677dfbed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:24:42.268121 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.267791    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c2fcb65-2c71-4856-a141-4aaa677dfbed" (UID: "4c2fcb65-2c71-4856-a141-4aaa677dfbed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:24:42.268121 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.268039    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-config" (OuterVolumeSpecName: "console-config") pod "4c2fcb65-2c71-4856-a141-4aaa677dfbed" (UID: "4c2fcb65-2c71-4856-a141-4aaa677dfbed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:24:42.269553 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.269522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c2fcb65-2c71-4856-a141-4aaa677dfbed" (UID: "4c2fcb65-2c71-4856-a141-4aaa677dfbed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:24:42.269654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.269531    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2fcb65-2c71-4856-a141-4aaa677dfbed-kube-api-access-v9pw2" (OuterVolumeSpecName: "kube-api-access-v9pw2") pod "4c2fcb65-2c71-4856-a141-4aaa677dfbed" (UID: "4c2fcb65-2c71-4856-a141-4aaa677dfbed"). InnerVolumeSpecName "kube-api-access-v9pw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:24:42.269654 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.269565    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c2fcb65-2c71-4856-a141-4aaa677dfbed" (UID: "4c2fcb65-2c71-4856-a141-4aaa677dfbed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:24:42.368426 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.368322    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-trusted-ca-bundle\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:24:42.368426 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.368378    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9pw2\" (UniqueName: \"kubernetes.io/projected/4c2fcb65-2c71-4856-a141-4aaa677dfbed-kube-api-access-v9pw2\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:24:42.368426 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.368391    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-service-ca\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:24:42.368426 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.368400    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:24:42.368426 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.368409    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:24:42.368426 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.368417    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c2fcb65-2c71-4856-a141-4aaa677dfbed-console-oauth-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:24:42.368426 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.368425    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c2fcb65-2c71-4856-a141-4aaa677dfbed-oauth-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:24:42.927456 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.927375    2561 generic.go:356] "Generic (PLEG): container finished" podID="4c2fcb65-2c71-4856-a141-4aaa677dfbed" containerID="a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a" exitCode=0
Jul 23 19:24:42.927456 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.927412    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756fd5db99-g89s4"
Jul 23 19:24:42.927456 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.927428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756fd5db99-g89s4" event={"ID":"4c2fcb65-2c71-4856-a141-4aaa677dfbed","Type":"ContainerDied","Data":"a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a"}
Jul 23 19:24:42.927667 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.927469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756fd5db99-g89s4" event={"ID":"4c2fcb65-2c71-4856-a141-4aaa677dfbed","Type":"ContainerDied","Data":"43c22dbf027984ce1b8b496d233c1053e6f2b63235624b56af1983e3f9bd81d0"}
Jul 23 19:24:42.927667 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.927487    2561 scope.go:117] "RemoveContainer" containerID="a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a"
Jul 23 19:24:42.936030 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.935819    2561 scope.go:117] "RemoveContainer" containerID="a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a"
Jul 23 19:24:42.936264 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:24:42.936090    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a\": container with ID starting with a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a not found: ID does not exist" containerID="a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a"
Jul 23 19:24:42.936264 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.936113    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a"} err="failed to get container status \"a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a\": rpc error: code = NotFound desc = could not find container \"a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a\": container with ID starting with a4ca8dd97c3d0045d51104837fa67fb038d659994230756a1f5840a9b543c00a not found: ID does not exist"
Jul 23 19:24:42.946822 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.946798    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-756fd5db99-g89s4"]
Jul 23 19:24:42.952179 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:42.952159    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-756fd5db99-g89s4"]
Jul 23 19:24:44.565838 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:44.565803    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c2fcb65-2c71-4856-a141-4aaa677dfbed" path="/var/lib/kubelet/pods/4c2fcb65-2c71-4856-a141-4aaa677dfbed/volumes"
Jul 23 19:24:46.088460 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:46.088423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:24:46.183628 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:24:46.183593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:08.281520 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:08.281484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:09.993134 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:09.993100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:11.886453 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:11.886416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:11.986902 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:11.986859    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:14.021685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:14.021648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:14.111697 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:14.111659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:14.612327 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:14.612267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:14.744036 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:14.743997    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:16.197309 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:16.197274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:16.599117 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:16.599079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:18.877738 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:18.877698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:18.979340 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:18.979309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:22.042072 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:22.042028    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:22.143845 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:22.143807    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:22.416265 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:22.416182    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:25:22.419336 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:22.419317    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:25:22.420495 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:22.420478    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 19:25:23.997259 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:23.997228    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:26.234228 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.234196    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b7gkp"]
Jul 23 19:25:26.234742 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.234676    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2fcb65-2c71-4856-a141-4aaa677dfbed" containerName="console"
Jul 23 19:25:26.234742 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.234696    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2fcb65-2c71-4856-a141-4aaa677dfbed" containerName="console"
Jul 23 19:25:26.234850 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.234792    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2fcb65-2c71-4856-a141-4aaa677dfbed" containerName="console"
Jul 23 19:25:26.237538 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.237516    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b7gkp"
Jul 23 19:25:26.240410 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.240381    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 19:25:26.240410 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.240386    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 19:25:26.241411 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.241396    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9949x\""
Jul 23 19:25:26.251549 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.251528    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b7gkp"]
Jul 23 19:25:26.347959 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.347923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8cc8b523-00a0-40f2-a458-ffcd39d696c9-bound-sa-token\") pod \"cert-manager-55b4d954d5-b7gkp\" (UID: \"8cc8b523-00a0-40f2-a458-ffcd39d696c9\") " pod="cert-manager/cert-manager-55b4d954d5-b7gkp"
Jul 23 19:25:26.348154 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.347977    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j42x\" (UniqueName: \"kubernetes.io/projected/8cc8b523-00a0-40f2-a458-ffcd39d696c9-kube-api-access-6j42x\") pod \"cert-manager-55b4d954d5-b7gkp\" (UID: \"8cc8b523-00a0-40f2-a458-ffcd39d696c9\") " pod="cert-manager/cert-manager-55b4d954d5-b7gkp"
Jul 23 19:25:26.448400 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.448332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j42x\" (UniqueName: \"kubernetes.io/projected/8cc8b523-00a0-40f2-a458-ffcd39d696c9-kube-api-access-6j42x\") pod \"cert-manager-55b4d954d5-b7gkp\" (UID: \"8cc8b523-00a0-40f2-a458-ffcd39d696c9\") " pod="cert-manager/cert-manager-55b4d954d5-b7gkp"
Jul 23 19:25:26.448588 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.448467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8cc8b523-00a0-40f2-a458-ffcd39d696c9-bound-sa-token\") pod \"cert-manager-55b4d954d5-b7gkp\" (UID: \"8cc8b523-00a0-40f2-a458-ffcd39d696c9\") " pod="cert-manager/cert-manager-55b4d954d5-b7gkp"
Jul 23 19:25:26.457871 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.457843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8cc8b523-00a0-40f2-a458-ffcd39d696c9-bound-sa-token\") pod \"cert-manager-55b4d954d5-b7gkp\" (UID: \"8cc8b523-00a0-40f2-a458-ffcd39d696c9\") " pod="cert-manager/cert-manager-55b4d954d5-b7gkp"
Jul 23 19:25:26.458987 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.458961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j42x\" (UniqueName: \"kubernetes.io/projected/8cc8b523-00a0-40f2-a458-ffcd39d696c9-kube-api-access-6j42x\") pod \"cert-manager-55b4d954d5-b7gkp\" (UID: \"8cc8b523-00a0-40f2-a458-ffcd39d696c9\") " pod="cert-manager/cert-manager-55b4d954d5-b7gkp"
Jul 23 19:25:26.554625 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.554532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b7gkp"
Jul 23 19:25:26.691749 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.691724    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b7gkp"]
Jul 23 19:25:26.694473 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:25:26.694444    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cc8b523_00a0_40f2_a458_ffcd39d696c9.slice/crio-206aa60b4fc398829e98e92dd2ff025eca6e3a290150a26bcd0cbf52ab87e148 WatchSource:0}: Error finding container 206aa60b4fc398829e98e92dd2ff025eca6e3a290150a26bcd0cbf52ab87e148: Status 404 returned error can't find the container with id 206aa60b4fc398829e98e92dd2ff025eca6e3a290150a26bcd0cbf52ab87e148
Jul 23 19:25:26.696402 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:26.696385    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 19:25:27.111968 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:27.111937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b7gkp" event={"ID":"8cc8b523-00a0-40f2-a458-ffcd39d696c9","Type":"ContainerStarted","Data":"206aa60b4fc398829e98e92dd2ff025eca6e3a290150a26bcd0cbf52ab87e148"}
Jul 23 19:25:30.130392 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:30.130294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b7gkp" event={"ID":"8cc8b523-00a0-40f2-a458-ffcd39d696c9","Type":"ContainerStarted","Data":"fd913f7164ddd07b425260e2fabfa9c189af8afe71d65d9c76c203371d8fc84f"}
Jul 23 19:25:30.146768 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:30.146719    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-b7gkp" podStartSLOduration=1.008284767 podStartE2EDuration="4.146704772s" totalImagesPullingTime="3.138420005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:25:30.145422256 +0000 UTC m=+308.079482403" watchObservedRunningTime="2026-07-23 19:25:30.146704772 +0000 UTC m=+308.080764919"
Jul 23 19:25:31.084810 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:31.084779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:31.190014 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:31.189943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:33.325903 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.325872    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"]
Jul 23 19:25:33.329435 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.329410    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"
Jul 23 19:25:33.333316 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.333294    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 19:25:33.333469 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.333332    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q279m\""
Jul 23 19:25:33.334315 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.334296    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 19:25:33.358805 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.358775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"]
Jul 23 19:25:33.416146 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.416112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca60345b-04f9-4198-b5a2-ecc3875cdd6e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-94qlk\" (UID: \"ca60345b-04f9-4198-b5a2-ecc3875cdd6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"
Jul 23 19:25:33.416341 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.416177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jqr5\" (UniqueName: \"kubernetes.io/projected/ca60345b-04f9-4198-b5a2-ecc3875cdd6e-kube-api-access-2jqr5\") pod \"openshift-lws-operator-fd8ccff4c-94qlk\" (UID: \"ca60345b-04f9-4198-b5a2-ecc3875cdd6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"
Jul 23 19:25:33.517129 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.517086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca60345b-04f9-4198-b5a2-ecc3875cdd6e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-94qlk\" (UID: \"ca60345b-04f9-4198-b5a2-ecc3875cdd6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"
Jul 23 19:25:33.517324 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.517151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqr5\" (UniqueName: \"kubernetes.io/projected/ca60345b-04f9-4198-b5a2-ecc3875cdd6e-kube-api-access-2jqr5\") pod \"openshift-lws-operator-fd8ccff4c-94qlk\" (UID: \"ca60345b-04f9-4198-b5a2-ecc3875cdd6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"
Jul 23 19:25:33.517620 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.517597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca60345b-04f9-4198-b5a2-ecc3875cdd6e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-94qlk\" (UID: \"ca60345b-04f9-4198-b5a2-ecc3875cdd6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"
Jul 23 19:25:33.526590 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.526569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jqr5\" (UniqueName: \"kubernetes.io/projected/ca60345b-04f9-4198-b5a2-ecc3875cdd6e-kube-api-access-2jqr5\") pod \"openshift-lws-operator-fd8ccff4c-94qlk\" (UID: \"ca60345b-04f9-4198-b5a2-ecc3875cdd6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"
Jul 23 19:25:33.639066 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.638979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"
Jul 23 19:25:33.774024 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:33.773996    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk"]
Jul 23 19:25:33.776788 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:25:33.776753    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca60345b_04f9_4198_b5a2_ecc3875cdd6e.slice/crio-5811a01b33b10a3d66b2f35afa59c4dfc00544a485492103fbd3e00e57e512a3 WatchSource:0}: Error finding container 5811a01b33b10a3d66b2f35afa59c4dfc00544a485492103fbd3e00e57e512a3: Status 404 returned error can't find the container with id 5811a01b33b10a3d66b2f35afa59c4dfc00544a485492103fbd3e00e57e512a3
Jul 23 19:25:34.148244 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:34.148201    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk" event={"ID":"ca60345b-04f9-4198-b5a2-ecc3875cdd6e","Type":"ContainerStarted","Data":"5811a01b33b10a3d66b2f35afa59c4dfc00544a485492103fbd3e00e57e512a3"}
Jul 23 19:25:37.164249 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:37.164212    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk" event={"ID":"ca60345b-04f9-4198-b5a2-ecc3875cdd6e","Type":"ContainerStarted","Data":"4ccbb3581ce96ff7fc32a70148bf5a50dc8a121fba0267e157e23cae6c0dad93"}
Jul 23 19:25:37.191435 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:37.191382    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94qlk" podStartSLOduration=1.820528975 podStartE2EDuration="4.191348393s" totalImagesPullingTime="2.370819418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:25:37.190428553 +0000 UTC m=+315.124488700" watchObservedRunningTime="2026-07-23 19:25:37.191348393 +0000 UTC m=+315.125408541"
Jul 23 19:25:37.873980 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:37.873947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:37.965740 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:37.965700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:39.596381 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:39.596324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:51.680583 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:51.680548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:51.808726 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:51.808692    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:52.301109 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.301069    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:52.569432 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.569329    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:52.679745 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.679689    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:52.761877 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.761840    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"]
Jul 23 19:25:52.766266 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.766247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.776111 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.776094    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rtrs9\""
Jul 23 19:25:52.776224 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.776162    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 19:25:52.776475 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.776458    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 19:25:52.777063 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.777050    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 19:25:52.784609 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.784593    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 19:25:52.805108 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.805071    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"]
Jul 23 19:25:52.888935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.888843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-tmp\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.888935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.888887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmz9n\" (UniqueName: \"kubernetes.io/projected/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-kube-api-access-hmz9n\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.888935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.888925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.889243 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.888982    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-manifests\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.889243 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.889048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.921789 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.921750    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:52.989692 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.989659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.989908 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.989727    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-tmp\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.989908 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.989766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmz9n\" (UniqueName: \"kubernetes.io/projected/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-kube-api-access-hmz9n\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.989908 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.989804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.989908 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.989872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-manifests\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.990258 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.990236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-manifests\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.992209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.992181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-tmp\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.992427 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.992410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:52.992479 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:52.992439    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:53.005042 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.005011    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmz9n\" (UniqueName: \"kubernetes.io/projected/6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32-kube-api-access-hmz9n\") pod \"opendatahub-operator-controller-manager-559f567dc-lsh25\" (UID: \"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:53.022567 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.022542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:53.075526 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.075496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:53.121886 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.121852    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:53.218903 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.218852    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:53.227723 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:25:53.227685    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2fe33f_544e_4d00_a99f_c5e9b6a7ac32.slice/crio-c54436d8c54b28dfcd73e43326967dd8c5bc5ee37c8057ca365261bc9d7588b9 WatchSource:0}: Error finding container c54436d8c54b28dfcd73e43326967dd8c5bc5ee37c8057ca365261bc9d7588b9: Status 404 returned error can't find the container with id c54436d8c54b28dfcd73e43326967dd8c5bc5ee37c8057ca365261bc9d7588b9
Jul 23 19:25:53.231927 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.231894    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"]
Jul 23 19:25:53.236315 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.236292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25" event={"ID":"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32","Type":"ContainerStarted","Data":"c54436d8c54b28dfcd73e43326967dd8c5bc5ee37c8057ca365261bc9d7588b9"}
Jul 23 19:25:53.347494 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.347463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:53.441532 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.441447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:53.546479 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:53.546442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:25:57.257130 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:57.257091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25" event={"ID":"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32","Type":"ContainerStarted","Data":"4f242d5124d10627d2e5151de7dafe242bab9e7b64e14d70b4f11ecb0a403b89"}
Jul 23 19:25:58.265319 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:58.265280    2561 generic.go:356] "Generic (PLEG): container finished" podID="6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32" containerID="4f242d5124d10627d2e5151de7dafe242bab9e7b64e14d70b4f11ecb0a403b89" exitCode=0
Jul 23 19:25:58.265821 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:58.265377    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25" event={"ID":"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32","Type":"ContainerDied","Data":"4f242d5124d10627d2e5151de7dafe242bab9e7b64e14d70b4f11ecb0a403b89"}
Jul 23 19:25:59.272178 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:59.272144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25" event={"ID":"6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32","Type":"ContainerStarted","Data":"31f0795419c65fe6ec0dbf4983a452fd149c2206a9e3c3f48943ca7c9ed262f1"}
Jul 23 19:25:59.272582 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:59.272298    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:25:59.295500 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:25:59.295449    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25" podStartSLOduration=2.751713274 podStartE2EDuration="7.295431772s" totalImagesPullingTime="3.535208091s" totalInitContainerRuntime="1.008510407s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:25:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:25:59.29398538 +0000 UTC m=+337.228045528" watchObservedRunningTime="2026-07-23 19:25:59.295431772 +0000 UTC m=+337.229491919"
Jul 23 19:26:04.186884 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:04.186854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:04.284198 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:04.284163    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:10.280802 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:10.280771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-lsh25"
Jul 23 19:26:11.829119 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:11.829086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:11.992094 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:11.992061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:12.890374 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:12.890266    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:13.049521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:13.049488    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:13.222166 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:13.222134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:13.798561 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:13.798527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:14.466054 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:14.466020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:19.682773 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.682733    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"]
Jul 23 19:26:19.686101 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.686067    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.690648 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.690624    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 19:26:19.690835 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.690811    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c7ht5\""
Jul 23 19:26:19.690987 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.690714    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 19:26:19.691147 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.690758    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 19:26:19.701966 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.701938    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"]
Jul 23 19:26:19.721492 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.721459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbg2d\" (UniqueName: \"kubernetes.io/projected/3d2efd96-5d61-4b70-977b-31bd2e000923-kube-api-access-nbg2d\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.721708 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.721506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d2efd96-5d61-4b70-977b-31bd2e000923-cert\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.721708 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.721559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3d2efd96-5d61-4b70-977b-31bd2e000923-manager-config\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.721708 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.721664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d2efd96-5d61-4b70-977b-31bd2e000923-metrics-cert\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.822658 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.822617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d2efd96-5d61-4b70-977b-31bd2e000923-metrics-cert\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.822831 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.822707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbg2d\" (UniqueName: \"kubernetes.io/projected/3d2efd96-5d61-4b70-977b-31bd2e000923-kube-api-access-nbg2d\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.822831 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.822725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d2efd96-5d61-4b70-977b-31bd2e000923-cert\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.822831 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.822765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3d2efd96-5d61-4b70-977b-31bd2e000923-manager-config\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.823499 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.823473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3d2efd96-5d61-4b70-977b-31bd2e000923-manager-config\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.825396 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.825347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d2efd96-5d61-4b70-977b-31bd2e000923-cert\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.825488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.825410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d2efd96-5d61-4b70-977b-31bd2e000923-metrics-cert\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.831734 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.831714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbg2d\" (UniqueName: \"kubernetes.io/projected/3d2efd96-5d61-4b70-977b-31bd2e000923-kube-api-access-nbg2d\") pod \"lws-controller-manager-84c9b5-2pjz7\" (UID: \"3d2efd96-5d61-4b70-977b-31bd2e000923\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:19.997871 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:19.997832    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:20.135450 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:20.135424    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"]
Jul 23 19:26:20.138056 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:26:20.138031    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2efd96_5d61_4b70_977b_31bd2e000923.slice/crio-ea4762f1ce5bbc640a1971b2acd42d02aa07ea05d73045f385bb1410803afb78 WatchSource:0}: Error finding container ea4762f1ce5bbc640a1971b2acd42d02aa07ea05d73045f385bb1410803afb78: Status 404 returned error can't find the container with id ea4762f1ce5bbc640a1971b2acd42d02aa07ea05d73045f385bb1410803afb78
Jul 23 19:26:20.376386 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:20.376286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7" event={"ID":"3d2efd96-5d61-4b70-977b-31bd2e000923","Type":"ContainerStarted","Data":"ea4762f1ce5bbc640a1971b2acd42d02aa07ea05d73045f385bb1410803afb78"}
Jul 23 19:26:22.388595 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:22.388549    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7" event={"ID":"3d2efd96-5d61-4b70-977b-31bd2e000923","Type":"ContainerStarted","Data":"655392aef8dfdc848e4f9714f435f7d330034a2f48a67b15952c9e15adeb37f9"}
Jul 23 19:26:22.389073 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:22.388639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:22.663496 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:22.663416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:22.831573 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:22.831538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:23.015879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.015845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:23.146963 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.146910    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7" podStartSLOduration=2.626566122 podStartE2EDuration="4.146891387s" totalImagesPullingTime="1.520325265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:26:22.436797019 +0000 UTC m=+360.370857166" watchObservedRunningTime="2026-07-23 19:26:23.146891387 +0000 UTC m=+361.080951534"
Jul 23 19:26:23.147187 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.147066    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"]
Jul 23 19:26:23.150233 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.150211    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.153713 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.153691    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 19:26:23.154897 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.154874    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mz5fj\""
Jul 23 19:26:23.155003 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.154924    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 19:26:23.156904 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.156888    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 19:26:23.158848 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.158828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:23.159794 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.159778    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 19:26:23.174947 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.174884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"]
Jul 23 19:26:23.251436 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.251399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6jft\" (UniqueName: \"kubernetes.io/projected/e6eeb4b7-ec9e-4458-80d2-83824925abd2-kube-api-access-p6jft\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.251657 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.251510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6eeb4b7-ec9e-4458-80d2-83824925abd2-tmp\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.251657 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.251544    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6eeb4b7-ec9e-4458-80d2-83824925abd2-tls-certs\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.352864 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.352777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6eeb4b7-ec9e-4458-80d2-83824925abd2-tmp\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.352864 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.352817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6eeb4b7-ec9e-4458-80d2-83824925abd2-tls-certs\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.353055 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.352885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6jft\" (UniqueName: \"kubernetes.io/projected/e6eeb4b7-ec9e-4458-80d2-83824925abd2-kube-api-access-p6jft\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.355278 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.355251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6eeb4b7-ec9e-4458-80d2-83824925abd2-tmp\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.355419 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.355348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6eeb4b7-ec9e-4458-80d2-83824925abd2-tls-certs\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.360471 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.360415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:23.363758 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.363730    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6jft\" (UniqueName: \"kubernetes.io/projected/e6eeb4b7-ec9e-4458-80d2-83824925abd2-kube-api-access-p6jft\") pod \"kube-auth-proxy-5fdd4658f-756bf\" (UID: \"e6eeb4b7-ec9e-4458-80d2-83824925abd2\") " pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.459902 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.459873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"
Jul 23 19:26:23.601753 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:23.601674    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fdd4658f-756bf"]
Jul 23 19:26:23.604020 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:26:23.603968    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6eeb4b7_ec9e_4458_80d2_83824925abd2.slice/crio-5e9c5c49d54c6f467bcbc329daa629ef0089296b9f249e5d0bbc99924c19e895 WatchSource:0}: Error finding container 5e9c5c49d54c6f467bcbc329daa629ef0089296b9f249e5d0bbc99924c19e895: Status 404 returned error can't find the container with id 5e9c5c49d54c6f467bcbc329daa629ef0089296b9f249e5d0bbc99924c19e895
Jul 23 19:26:24.081952 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:24.081918    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:24.186088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:24.186054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:24.269154 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:24.269082    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:24.401957 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:24.401867    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf" event={"ID":"e6eeb4b7-ec9e-4458-80d2-83824925abd2","Type":"ContainerStarted","Data":"5e9c5c49d54c6f467bcbc329daa629ef0089296b9f249e5d0bbc99924c19e895"}
Jul 23 19:26:25.618833 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:25.618798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:25.752604 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:25.752574    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:27.217204 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:27.217169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:27.418095 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:27.418053    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf" event={"ID":"e6eeb4b7-ec9e-4458-80d2-83824925abd2","Type":"ContainerStarted","Data":"b2b7a1567e588e33330260527713a2ddf6c931bd88b9ad7a917e97ddf6f660d0"}
Jul 23 19:26:27.450239 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:27.450171    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fdd4658f-756bf" podStartSLOduration=1.201584365 podStartE2EDuration="4.450150766s" totalImagesPullingTime="3.248566401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:26:27.449216485 +0000 UTC m=+365.383276658" watchObservedRunningTime="2026-07-23 19:26:27.450150766 +0000 UTC m=+365.384210914"
Jul 23 19:26:33.396242 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:33.396212    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84c9b5-2pjz7"
Jul 23 19:26:33.870615 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:33.870577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:34.290228 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:34.290196    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:34.369561 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:34.369529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:34.583878 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:34.583789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:34.797475 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:34.797442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:35.157239 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:35.157206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:37.662085 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:37.662053    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:26:37.759157 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:26:37.759125    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:11.166910 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:11.166865    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:13.361076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:13.361036    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:13.456992 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:13.456950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:13.557593 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:13.557555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:14.298126 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:14.298094    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:14.515674 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:14.515643    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:29.076775 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:29.076737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:41.747829 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:41.747789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:45.933760 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:45.933674    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:47.427887 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:47.427853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:47.534974 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:47.534926    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:48.422389 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:48.422331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:48.546332 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:48.546289    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:49.446612 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:49.446577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:49.542480 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:49.542444    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:49.809493 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:49.809462    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:52.964370 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:52.964333    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:53.352995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:53.352912    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:53.682865 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:53.682784    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:53.941316 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:53.941233    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:54.984716 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:54.984678    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6559cbb8d4-crztw"]
Jul 23 19:27:54.987462 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:54.987444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.002051 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.002026    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6559cbb8d4-crztw"]
Jul 23 19:27:55.066956 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.066921    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:55.102765 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.102728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aff214d-2513-4f10-835d-ed26391f7144-console-oauth-config\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.102899 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.102778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8g5b\" (UniqueName: \"kubernetes.io/projected/5aff214d-2513-4f10-835d-ed26391f7144-kube-api-access-f8g5b\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.102899 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.102875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-oauth-serving-cert\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.103003 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.102908    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-console-config\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.103003 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.102940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-service-ca\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.103003 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.102990    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aff214d-2513-4f10-835d-ed26391f7144-console-serving-cert\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.103159 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.103030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-trusted-ca-bundle\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.170079 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.170038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:55.204345 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.204300    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aff214d-2513-4f10-835d-ed26391f7144-console-oauth-config\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.204585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.204378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8g5b\" (UniqueName: \"kubernetes.io/projected/5aff214d-2513-4f10-835d-ed26391f7144-kube-api-access-f8g5b\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.204585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.204449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-oauth-serving-cert\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.204585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.204481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-console-config\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.204585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.204518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-service-ca\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.204585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.204542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aff214d-2513-4f10-835d-ed26391f7144-console-serving-cert\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.204849 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.204589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-trusted-ca-bundle\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.205255 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.205227    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-oauth-serving-cert\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.205412 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.205233    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-service-ca\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.205471 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.205454    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-console-config\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.205723 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.205700    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aff214d-2513-4f10-835d-ed26391f7144-trusted-ca-bundle\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.207008 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.206977    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aff214d-2513-4f10-835d-ed26391f7144-console-oauth-config\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.207317 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.207295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aff214d-2513-4f10-835d-ed26391f7144-console-serving-cert\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.228851 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.228825    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8g5b\" (UniqueName: \"kubernetes.io/projected/5aff214d-2513-4f10-835d-ed26391f7144-kube-api-access-f8g5b\") pod \"console-6559cbb8d4-crztw\" (UID: \"5aff214d-2513-4f10-835d-ed26391f7144\") " pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.298679 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.298598    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:27:55.317962 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.317937    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:55.439001 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.438976    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6559cbb8d4-crztw"]
Jul 23 19:27:55.441342 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:27:55.441315    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aff214d_2513_4f10_835d_ed26391f7144.slice/crio-eedbfd6df1d22add6ec18890a7789147cd9c6764835b1cb0140fb8736bd8eb6f WatchSource:0}: Error finding container eedbfd6df1d22add6ec18890a7789147cd9c6764835b1cb0140fb8736bd8eb6f: Status 404 returned error can't find the container with id eedbfd6df1d22add6ec18890a7789147cd9c6764835b1cb0140fb8736bd8eb6f
Jul 23 19:27:55.457304 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.457268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:55.804780 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.804746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:55.812666 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.812641    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6559cbb8d4-crztw" event={"ID":"5aff214d-2513-4f10-835d-ed26391f7144","Type":"ContainerStarted","Data":"d04f9b706db23afd4763d8c5053d11f4dc78fe205601ca7c6b8ddef4cbfc2507"}
Jul 23 19:27:55.812781 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.812683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6559cbb8d4-crztw" event={"ID":"5aff214d-2513-4f10-835d-ed26391f7144","Type":"ContainerStarted","Data":"eedbfd6df1d22add6ec18890a7789147cd9c6764835b1cb0140fb8736bd8eb6f"}
Jul 23 19:27:55.839954 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.839894    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6559cbb8d4-crztw" podStartSLOduration=1.839876151 podStartE2EDuration="1.839876151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:27:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:27:55.839324808 +0000 UTC m=+453.773384956" watchObservedRunningTime="2026-07-23 19:27:55.839876151 +0000 UTC m=+453.773936298"
Jul 23 19:27:55.902961 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.902930    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:55.984831 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.984801    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"]
Jul 23 19:27:55.987127 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.987109    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"
Jul 23 19:27:55.990004 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.989985    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mfsfz\""
Jul 23 19:27:55.990204 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.990190    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 19:27:55.990288 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.990228    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 19:27:55.998608 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:55.998585    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"]
Jul 23 19:27:56.112698 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:56.112592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn22r\" (UniqueName: \"kubernetes.io/projected/2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1-kube-api-access-bn22r\") pod \"authorino-operator-75cc8d5cb7-lpxm7\" (UID: \"2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"
Jul 23 19:27:56.213864 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:56.213830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn22r\" (UniqueName: \"kubernetes.io/projected/2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1-kube-api-access-bn22r\") pod \"authorino-operator-75cc8d5cb7-lpxm7\" (UID: \"2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"
Jul 23 19:27:56.223932 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:56.223903    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn22r\" (UniqueName: \"kubernetes.io/projected/2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1-kube-api-access-bn22r\") pod \"authorino-operator-75cc8d5cb7-lpxm7\" (UID: \"2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"
Jul 23 19:27:56.297988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:56.297960    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"
Jul 23 19:27:56.440937 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:56.440916    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:56.441325 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:56.441305    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"]
Jul 23 19:27:56.443167 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:27:56.443147    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cdbbc71_1f3e_4b72_81b7_130bcdcbf7a1.slice/crio-a735ba8c1032d04445e13b18fba388175edb699174abb7ed32307a040810262a WatchSource:0}: Error finding container a735ba8c1032d04445e13b18fba388175edb699174abb7ed32307a040810262a: Status 404 returned error can't find the container with id a735ba8c1032d04445e13b18fba388175edb699174abb7ed32307a040810262a
Jul 23 19:27:56.818717 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:56.818684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7" event={"ID":"2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1","Type":"ContainerStarted","Data":"a735ba8c1032d04445e13b18fba388175edb699174abb7ed32307a040810262a"}
Jul 23 19:27:57.841792 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:57.841764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:57.940715 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:57.940677    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:27:59.837008 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:59.836975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7" event={"ID":"2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1","Type":"ContainerStarted","Data":"e1181769329202a50e39d65fac4734b040ad94099d2acf67570280eafdee9130"}
Jul 23 19:27:59.837434 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:59.837114    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"
Jul 23 19:27:59.859537 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:27:59.859488    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7" podStartSLOduration=2.523289909 podStartE2EDuration="4.859471355s" totalImagesPullingTime="2.336181446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:27:59.856059099 +0000 UTC m=+457.790119245" watchObservedRunningTime="2026-07-23 19:27:59.859471355 +0000 UTC m=+457.793531501"
Jul 23 19:28:01.545544 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:01.545510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:01.652161 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:01.652129    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:02.092609 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:02.092574    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:02.372541 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:02.372429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:04.954816 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:04.954761    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:05.057066 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:05.057033    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:05.299006 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:05.298896    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:28:05.299006 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:05.298960    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:28:05.303620 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:05.303598    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:28:05.866701 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:05.866671    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6559cbb8d4-crztw"
Jul 23 19:28:05.932561 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:05.932530    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96b8f7f98-tfj24"]
Jul 23 19:28:06.067470 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:06.067431    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:06.170641 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:06.170519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:06.268536 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:06.268492    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:10.843504 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:10.843475    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lpxm7"
Jul 23 19:28:13.503555 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:13.503515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:13.646311 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:13.646268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:15.979035 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:15.978992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:16.088195 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:16.088162    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:18.810824 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:18.810796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:18.985251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:18.985208    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:22.619465 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:22.619431    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:22.777261 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:22.777231    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:30.953786 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:30.953741    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-96b8f7f98-tfj24" podUID="8957d046-ff4a-43bd-a0de-0d85382f5826" containerName="console" containerID="cri-o://5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a" gracePeriod=15
Jul 23 19:28:31.190018 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.189995    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:28:31.238320 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238227    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-serving-cert\") pod \"8957d046-ff4a-43bd-a0de-0d85382f5826\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") "
Jul 23 19:28:31.238320 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238269    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-trusted-ca-bundle\") pod \"8957d046-ff4a-43bd-a0de-0d85382f5826\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") "
Jul 23 19:28:31.238571 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238332    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-service-ca\") pod \"8957d046-ff4a-43bd-a0de-0d85382f5826\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") "
Jul 23 19:28:31.238571 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8dr4\" (UniqueName: \"kubernetes.io/projected/8957d046-ff4a-43bd-a0de-0d85382f5826-kube-api-access-p8dr4\") pod \"8957d046-ff4a-43bd-a0de-0d85382f5826\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") "
Jul 23 19:28:31.238693 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-oauth-serving-cert\") pod \"8957d046-ff4a-43bd-a0de-0d85382f5826\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") "
Jul 23 19:28:31.238693 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238611    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-console-config\") pod \"8957d046-ff4a-43bd-a0de-0d85382f5826\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") "
Jul 23 19:28:31.238693 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238641    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-oauth-config\") pod \"8957d046-ff4a-43bd-a0de-0d85382f5826\" (UID: \"8957d046-ff4a-43bd-a0de-0d85382f5826\") "
Jul 23 19:28:31.238830 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238720    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-service-ca" (OuterVolumeSpecName: "service-ca") pod "8957d046-ff4a-43bd-a0de-0d85382f5826" (UID: "8957d046-ff4a-43bd-a0de-0d85382f5826"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:28:31.238830 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238758    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8957d046-ff4a-43bd-a0de-0d85382f5826" (UID: "8957d046-ff4a-43bd-a0de-0d85382f5826"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:28:31.238998 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.238972    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-console-config" (OuterVolumeSpecName: "console-config") pod "8957d046-ff4a-43bd-a0de-0d85382f5826" (UID: "8957d046-ff4a-43bd-a0de-0d85382f5826"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:28:31.239117 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.239008    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-trusted-ca-bundle\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:28:31.239117 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.239029    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-service-ca\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:28:31.239230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.239211    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8957d046-ff4a-43bd-a0de-0d85382f5826" (UID: "8957d046-ff4a-43bd-a0de-0d85382f5826"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:28:31.240698 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.240675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8957d046-ff4a-43bd-a0de-0d85382f5826-kube-api-access-p8dr4" (OuterVolumeSpecName: "kube-api-access-p8dr4") pod "8957d046-ff4a-43bd-a0de-0d85382f5826" (UID: "8957d046-ff4a-43bd-a0de-0d85382f5826"). InnerVolumeSpecName "kube-api-access-p8dr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:28:31.241074 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.241053    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8957d046-ff4a-43bd-a0de-0d85382f5826" (UID: "8957d046-ff4a-43bd-a0de-0d85382f5826"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:28:31.241135 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.241076    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8957d046-ff4a-43bd-a0de-0d85382f5826" (UID: "8957d046-ff4a-43bd-a0de-0d85382f5826"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:28:31.330973 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.330934    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:31.340251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.340222    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8dr4\" (UniqueName: \"kubernetes.io/projected/8957d046-ff4a-43bd-a0de-0d85382f5826-kube-api-access-p8dr4\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:28:31.340251 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.340251    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-oauth-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:28:31.340460 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.340264    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8957d046-ff4a-43bd-a0de-0d85382f5826-console-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:28:31.340460 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.340276    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-oauth-config\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:28:31.340460 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.340287    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8957d046-ff4a-43bd-a0de-0d85382f5826-console-serving-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:28:31.433032 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.432996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:31.981087 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.981047    2561 generic.go:356] "Generic (PLEG): container finished" podID="8957d046-ff4a-43bd-a0de-0d85382f5826" containerID="5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a" exitCode=0
Jul 23 19:28:31.981513 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.981110    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96b8f7f98-tfj24"
Jul 23 19:28:31.981513 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.981130    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96b8f7f98-tfj24" event={"ID":"8957d046-ff4a-43bd-a0de-0d85382f5826","Type":"ContainerDied","Data":"5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a"}
Jul 23 19:28:31.981513 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.981211    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96b8f7f98-tfj24" event={"ID":"8957d046-ff4a-43bd-a0de-0d85382f5826","Type":"ContainerDied","Data":"c7aa01a99efa5eb7ad6e948ecf4428ff72871c48043dd011c9f34b84d6122f96"}
Jul 23 19:28:31.981513 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.981231    2561 scope.go:117] "RemoveContainer" containerID="5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a"
Jul 23 19:28:31.990659 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.990639    2561 scope.go:117] "RemoveContainer" containerID="5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a"
Jul 23 19:28:31.990902 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:28:31.990884    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a\": container with ID starting with 5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a not found: ID does not exist" containerID="5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a"
Jul 23 19:28:31.990952 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:31.990911    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a"} err="failed to get container status \"5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a\": rpc error: code = NotFound desc = could not find container \"5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a\": container with ID starting with 5d20db6d1e0da5f0201c7d56238d7d10a4c6be783a457f6becfe56f69c21fa0a not found: ID does not exist"
Jul 23 19:28:32.002723 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:32.002700    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96b8f7f98-tfj24"]
Jul 23 19:28:32.007607 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:32.007585    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-96b8f7f98-tfj24"]
Jul 23 19:28:32.566617 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:32.566585    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8957d046-ff4a-43bd-a0de-0d85382f5826" path="/var/lib/kubelet/pods/8957d046-ff4a-43bd-a0de-0d85382f5826/volumes"
Jul 23 19:28:33.952971 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:33.952939    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:34.055516 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:34.055482    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:34.234873 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:34.234789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:37.169336 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:37.169302    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:37.285447 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:37.285411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:40.780938 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:40.780904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:40.937986 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:40.937946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:49.253391 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:49.253331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:49.353092 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:49.353054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:57.182385 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:57.182324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:28:57.303637 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:28:57.303597    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:02.300661 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:02.300623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:02.464382 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:02.464329    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:02.616425 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:02.616312    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:03.270500 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.270460    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:03.345955 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.345920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:03.449869 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.449837    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4rzr9"]
Jul 23 19:29:03.450224 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.450211    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8957d046-ff4a-43bd-a0de-0d85382f5826" containerName="console"
Jul 23 19:29:03.450273 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.450225    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8957d046-ff4a-43bd-a0de-0d85382f5826" containerName="console"
Jul 23 19:29:03.450308 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.450290    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8957d046-ff4a-43bd-a0de-0d85382f5826" containerName="console"
Jul 23 19:29:03.453158 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.453138    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4rzr9"
Jul 23 19:29:03.457146 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.457124    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rwdhb\""
Jul 23 19:29:03.465506 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.465482    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4rzr9"]
Jul 23 19:29:03.524631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.524543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgwl\" (UniqueName: \"kubernetes.io/projected/9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b-kube-api-access-bhgwl\") pod \"authorino-75d556bd77-4rzr9\" (UID: \"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b\") " pod="kuadrant-system/authorino-75d556bd77-4rzr9"
Jul 23 19:29:03.625241 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.625201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgwl\" (UniqueName: \"kubernetes.io/projected/9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b-kube-api-access-bhgwl\") pod \"authorino-75d556bd77-4rzr9\" (UID: \"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b\") " pod="kuadrant-system/authorino-75d556bd77-4rzr9"
Jul 23 19:29:03.635385 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.635338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgwl\" (UniqueName: \"kubernetes.io/projected/9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b-kube-api-access-bhgwl\") pod \"authorino-75d556bd77-4rzr9\" (UID: \"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b\") " pod="kuadrant-system/authorino-75d556bd77-4rzr9"
Jul 23 19:29:03.762488 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.762452    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4rzr9"
Jul 23 19:29:03.914989 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:03.914944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4rzr9"]
Jul 23 19:29:03.918865 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:29:03.918832    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e3ef5ac_b357_4a78_93eb_c43bf7c9f33b.slice/crio-ee4c4b4b8a52a0b7618dcceadf1921d95ae5d9e419c522bfcd8a73dbdb346c4b WatchSource:0}: Error finding container ee4c4b4b8a52a0b7618dcceadf1921d95ae5d9e419c522bfcd8a73dbdb346c4b: Status 404 returned error can't find the container with id ee4c4b4b8a52a0b7618dcceadf1921d95ae5d9e419c522bfcd8a73dbdb346c4b
Jul 23 19:29:04.138685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:04.138591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4rzr9" event={"ID":"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b","Type":"ContainerStarted","Data":"ee4c4b4b8a52a0b7618dcceadf1921d95ae5d9e419c522bfcd8a73dbdb346c4b"}
Jul 23 19:29:07.161987 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:07.161899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4rzr9" event={"ID":"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b","Type":"ContainerStarted","Data":"ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72"}
Jul 23 19:29:07.190915 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:07.190869    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4rzr9" podStartSLOduration=1.253023547 podStartE2EDuration="4.190854475s" totalImagesPullingTime="2.937830928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:29:07.189862669 +0000 UTC m=+525.123922815" watchObservedRunningTime="2026-07-23 19:29:07.190854475 +0000 UTC m=+525.124914622"
Jul 23 19:29:18.422513 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.422439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:18.525713 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.525679    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:18.926902 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.926870    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"]
Jul 23 19:29:18.929935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.929919    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:18.947006 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.946978    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 19:29:18.947330 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.947316    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v2cj4\""
Jul 23 19:29:18.947396 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.947340    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 19:29:18.957514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.957489    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 19:29:18.967650 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:18.967629    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"]
Jul 23 19:29:19.022552 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.022516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:19.068217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.068185    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca93b0cb-4033-4631-8358-f5d1287e616a-data\") pod \"postgres-69fb4594cf-k2xch\" (UID: \"ca93b0cb-4033-4631-8358-f5d1287e616a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:19.068428 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.068246    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bss9\" (UniqueName: \"kubernetes.io/projected/ca93b0cb-4033-4631-8358-f5d1287e616a-kube-api-access-6bss9\") pod \"postgres-69fb4594cf-k2xch\" (UID: \"ca93b0cb-4033-4631-8358-f5d1287e616a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:19.169585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.169546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca93b0cb-4033-4631-8358-f5d1287e616a-data\") pod \"postgres-69fb4594cf-k2xch\" (UID: \"ca93b0cb-4033-4631-8358-f5d1287e616a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:19.169795 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.169609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bss9\" (UniqueName: \"kubernetes.io/projected/ca93b0cb-4033-4631-8358-f5d1287e616a-kube-api-access-6bss9\") pod \"postgres-69fb4594cf-k2xch\" (UID: \"ca93b0cb-4033-4631-8358-f5d1287e616a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:19.170000 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.169976    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca93b0cb-4033-4631-8358-f5d1287e616a-data\") pod \"postgres-69fb4594cf-k2xch\" (UID: \"ca93b0cb-4033-4631-8358-f5d1287e616a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:19.181503 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.181435    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bss9\" (UniqueName: \"kubernetes.io/projected/ca93b0cb-4033-4631-8358-f5d1287e616a-kube-api-access-6bss9\") pod \"postgres-69fb4594cf-k2xch\" (UID: \"ca93b0cb-4033-4631-8358-f5d1287e616a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:19.240156 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.240116    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:19.381374 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:19.381315    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"]
Jul 23 19:29:19.384492 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:29:19.384462    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca93b0cb_4033_4631_8358_f5d1287e616a.slice/crio-089ecfe6dc10ec13c3b359525320e2c0cc4d3c268cc13e7e0ad530463a356f60 WatchSource:0}: Error finding container 089ecfe6dc10ec13c3b359525320e2c0cc4d3c268cc13e7e0ad530463a356f60: Status 404 returned error can't find the container with id 089ecfe6dc10ec13c3b359525320e2c0cc4d3c268cc13e7e0ad530463a356f60
Jul 23 19:29:20.228198 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:20.228160    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch" event={"ID":"ca93b0cb-4033-4631-8358-f5d1287e616a","Type":"ContainerStarted","Data":"089ecfe6dc10ec13c3b359525320e2c0cc4d3c268cc13e7e0ad530463a356f60"}
Jul 23 19:29:24.320167 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:24.320135    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 19:29:25.256892 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:25.256857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch" event={"ID":"ca93b0cb-4033-4631-8358-f5d1287e616a","Type":"ContainerStarted","Data":"dffa9bbba7198f41e6ebd658eecacf9b2aeaabe32a636e430e828fb075b88683"}
Jul 23 19:29:25.257074 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:25.256998    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:25.274988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:25.274921    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch" podStartSLOduration=2.343797915 podStartE2EDuration="7.274906677s" totalImagesPullingTime="4.931108762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:29:25.273343132 +0000 UTC m=+543.207403282" watchObservedRunningTime="2026-07-23 19:29:25.274906677 +0000 UTC m=+543.208966831"
Jul 23 19:29:31.291468 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:31.291441    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2xch"
Jul 23 19:29:31.616089 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:31.615999    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:31.902610 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:31.902525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:36.422630 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:36.422596    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4rzr9"]
Jul 23 19:29:36.423078 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:36.422803    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4rzr9" podUID="9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b" containerName="authorino" containerID="cri-o://ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72" gracePeriod=30
Jul 23 19:29:37.244338 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.244302    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4rzr9"
Jul 23 19:29:37.313294 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.313256    2561 generic.go:356] "Generic (PLEG): container finished" podID="9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b" containerID="ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72" exitCode=0
Jul 23 19:29:37.313518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.313305    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4rzr9"
Jul 23 19:29:37.313518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.313302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4rzr9" event={"ID":"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b","Type":"ContainerDied","Data":"ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72"}
Jul 23 19:29:37.313518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.313425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4rzr9" event={"ID":"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b","Type":"ContainerDied","Data":"ee4c4b4b8a52a0b7618dcceadf1921d95ae5d9e419c522bfcd8a73dbdb346c4b"}
Jul 23 19:29:37.313518 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.313450    2561 scope.go:117] "RemoveContainer" containerID="ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72"
Jul 23 19:29:37.321687 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.321665    2561 scope.go:117] "RemoveContainer" containerID="ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72"
Jul 23 19:29:37.321942 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:29:37.321925    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72\": container with ID starting with ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72 not found: ID does not exist" containerID="ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72"
Jul 23 19:29:37.322010 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.321953    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72"} err="failed to get container status \"ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72\": rpc error: code = NotFound desc = could not find container \"ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72\": container with ID starting with ab38838cd42754398d31d559b7a9b756e17577a2bd1da4173a6b7c75cb5eba72 not found: ID does not exist"
Jul 23 19:29:37.339459 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.339378    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhgwl\" (UniqueName: \"kubernetes.io/projected/9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b-kube-api-access-bhgwl\") pod \"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b\" (UID: \"9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b\") "
Jul 23 19:29:37.341711 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.341676    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b-kube-api-access-bhgwl" (OuterVolumeSpecName: "kube-api-access-bhgwl") pod "9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b" (UID: "9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b"). InnerVolumeSpecName "kube-api-access-bhgwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:29:37.440649 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.440615    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhgwl\" (UniqueName: \"kubernetes.io/projected/9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b-kube-api-access-bhgwl\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:29:37.634580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.634548    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4rzr9"]
Jul 23 19:29:37.638009 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:37.637981    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4rzr9"]
Jul 23 19:29:38.571827 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:38.571792    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b" path="/var/lib/kubelet/pods/9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b/volumes"
Jul 23 19:29:41.059948 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.059905    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:41.082182 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.082147    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f9d846d69-s52bv"]
Jul 23 19:29:41.082562 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.082536    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b" containerName="authorino"
Jul 23 19:29:41.082562 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.082563    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b" containerName="authorino"
Jul 23 19:29:41.082685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.082619    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3ef5ac-b357-4a78-93eb-c43bf7c9f33b" containerName="authorino"
Jul 23 19:29:41.087480 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.087461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:41.090780 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.090756    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 19:29:41.091192 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.091161    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 19:29:41.091316 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.091273    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nsblt\""
Jul 23 19:29:41.099454 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.099428    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f9d846d69-s52bv"]
Jul 23 19:29:41.175881 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.175848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:41.178075 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.178056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-webhook-cert\") pod \"maas-controller-6f9d846d69-s52bv\" (UID: \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\") " pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:41.178137 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.178097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwmwx\" (UniqueName: \"kubernetes.io/projected/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-kube-api-access-jwmwx\") pod \"maas-controller-6f9d846d69-s52bv\" (UID: \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\") " pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:41.278803 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.278765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-webhook-cert\") pod \"maas-controller-6f9d846d69-s52bv\" (UID: \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\") " pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:41.278983 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.278827    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwmwx\" (UniqueName: \"kubernetes.io/projected/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-kube-api-access-jwmwx\") pod \"maas-controller-6f9d846d69-s52bv\" (UID: \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\") " pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:41.281584 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.281552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-webhook-cert\") pod \"maas-controller-6f9d846d69-s52bv\" (UID: \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\") " pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:41.283675 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.283616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:41.290134 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.290105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwmwx\" (UniqueName: \"kubernetes.io/projected/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-kube-api-access-jwmwx\") pod \"maas-controller-6f9d846d69-s52bv\" (UID: \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\") " pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:41.398528 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.398434    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:41.540844 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:41.540797    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f9d846d69-s52bv"]
Jul 23 19:29:41.543551 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:29:41.543517    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6e87bf_b351_4eaf_8660_a98f2b27dc7f.slice/crio-72d08231f974ffaf91de36d3a4f42e229c3c03cbead4485593a3edda89f2cbce WatchSource:0}: Error finding container 72d08231f974ffaf91de36d3a4f42e229c3c03cbead4485593a3edda89f2cbce: Status 404 returned error can't find the container with id 72d08231f974ffaf91de36d3a4f42e229c3c03cbead4485593a3edda89f2cbce
Jul 23 19:29:42.341439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:42.341395    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f9d846d69-s52bv" event={"ID":"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f","Type":"ContainerStarted","Data":"72d08231f974ffaf91de36d3a4f42e229c3c03cbead4485593a3edda89f2cbce"}
Jul 23 19:29:44.092242 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:44.092205    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:44.193408 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:44.193299    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:29:44.352911 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:44.352870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f9d846d69-s52bv" event={"ID":"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f","Type":"ContainerStarted","Data":"b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0"}
Jul 23 19:29:44.353116 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:44.352988    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:44.389054 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:44.388994    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f9d846d69-s52bv" podStartSLOduration=0.996765948 podStartE2EDuration="3.388978842s" totalImagesPullingTime="2.392212894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:29:44.388178353 +0000 UTC m=+562.322238523" watchObservedRunningTime="2026-07-23 19:29:44.388978842 +0000 UTC m=+562.323038989"
Jul 23 19:29:55.359632 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:55.359594    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:55.934034 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:55.933995    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f9d846d69-s52bv"]
Jul 23 19:29:55.934258 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:55.934222    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f9d846d69-s52bv" podUID="fe6e87bf-b351-4eaf-8660-a98f2b27dc7f" containerName="manager" containerID="cri-o://b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0" gracePeriod=30
Jul 23 19:29:56.177434 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.177407    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:56.212693 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.212663    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwmwx\" (UniqueName: \"kubernetes.io/projected/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-kube-api-access-jwmwx\") pod \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\" (UID: \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\") "
Jul 23 19:29:56.212860 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.212736    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-webhook-cert\") pod \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\" (UID: \"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f\") "
Jul 23 19:29:56.215153 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.215116    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe6e87bf-b351-4eaf-8660-a98f2b27dc7f" (UID: "fe6e87bf-b351-4eaf-8660-a98f2b27dc7f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:29:56.215153 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.215116    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-kube-api-access-jwmwx" (OuterVolumeSpecName: "kube-api-access-jwmwx") pod "fe6e87bf-b351-4eaf-8660-a98f2b27dc7f" (UID: "fe6e87bf-b351-4eaf-8660-a98f2b27dc7f"). InnerVolumeSpecName "kube-api-access-jwmwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:29:56.313557 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.313525    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-webhook-cert\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:29:56.313557 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.313553    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwmwx\" (UniqueName: \"kubernetes.io/projected/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f-kube-api-access-jwmwx\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:29:56.414151 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.414115    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe6e87bf-b351-4eaf-8660-a98f2b27dc7f" containerID="b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0" exitCode=0
Jul 23 19:29:56.414626 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.414159    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f9d846d69-s52bv"
Jul 23 19:29:56.414626 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.414182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f9d846d69-s52bv" event={"ID":"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f","Type":"ContainerDied","Data":"b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0"}
Jul 23 19:29:56.414626 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.414225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f9d846d69-s52bv" event={"ID":"fe6e87bf-b351-4eaf-8660-a98f2b27dc7f","Type":"ContainerDied","Data":"72d08231f974ffaf91de36d3a4f42e229c3c03cbead4485593a3edda89f2cbce"}
Jul 23 19:29:56.414626 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.414246    2561 scope.go:117] "RemoveContainer" containerID="b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0"
Jul 23 19:29:56.423764 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.423744    2561 scope.go:117] "RemoveContainer" containerID="b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0"
Jul 23 19:29:56.424034 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:29:56.424015    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0\": container with ID starting with b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0 not found: ID does not exist" containerID="b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0"
Jul 23 19:29:56.424076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.424046    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0"} err="failed to get container status \"b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0\": rpc error: code = NotFound desc = could not find container \"b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0\": container with ID starting with b893934938ebbcdc2ab465824adf4950ab0f905343605dfbcb8c26fefcd9d6b0 not found: ID does not exist"
Jul 23 19:29:56.438099 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.438070    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f9d846d69-s52bv"]
Jul 23 19:29:56.443792 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.443767    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f9d846d69-s52bv"]
Jul 23 19:29:56.567087 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:29:56.567003    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe6e87bf-b351-4eaf-8660-a98f2b27dc7f" path="/var/lib/kubelet/pods/fe6e87bf-b351-4eaf-8660-a98f2b27dc7f/volumes"
Jul 23 19:30:02.250414 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:02.250374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:02.327427 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:02.327391    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:14.812123 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:14.812085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:16.224806 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.224773    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:16.458339 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.458304    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:16.563533 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.563418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:16.657272 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.657240    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"]
Jul 23 19:30:16.657667 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.657654    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6e87bf-b351-4eaf-8660-a98f2b27dc7f" containerName="manager"
Jul 23 19:30:16.657713 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.657668    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6e87bf-b351-4eaf-8660-a98f2b27dc7f" containerName="manager"
Jul 23 19:30:16.657747 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.657729    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6e87bf-b351-4eaf-8660-a98f2b27dc7f" containerName="manager"
Jul 23 19:30:16.664364 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.664337    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:16.668374 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.668329    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5kbrn\""
Jul 23 19:30:16.670387 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.669382    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 19:30:16.673405 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.673374    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"]
Jul 23 19:30:16.807836 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.807797    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnf8l\" (UniqueName: \"kubernetes.io/projected/0a96776d-69c1-4463-ae69-9dbb875e6ba9-kube-api-access-vnf8l\") pod \"payload-pre-processing-7677b774bb-qlhr9\" (UID: \"0a96776d-69c1-4463-ae69-9dbb875e6ba9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:16.808022 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.807862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a96776d-69c1-4463-ae69-9dbb875e6ba9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qlhr9\" (UID: \"0a96776d-69c1-4463-ae69-9dbb875e6ba9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:16.908954 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.908860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a96776d-69c1-4463-ae69-9dbb875e6ba9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qlhr9\" (UID: \"0a96776d-69c1-4463-ae69-9dbb875e6ba9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:16.908954 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.908935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnf8l\" (UniqueName: \"kubernetes.io/projected/0a96776d-69c1-4463-ae69-9dbb875e6ba9-kube-api-access-vnf8l\") pod \"payload-pre-processing-7677b774bb-qlhr9\" (UID: \"0a96776d-69c1-4463-ae69-9dbb875e6ba9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:16.909629 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.909609    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a96776d-69c1-4463-ae69-9dbb875e6ba9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qlhr9\" (UID: \"0a96776d-69c1-4463-ae69-9dbb875e6ba9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:16.918782 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.918748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnf8l\" (UniqueName: \"kubernetes.io/projected/0a96776d-69c1-4463-ae69-9dbb875e6ba9-kube-api-access-vnf8l\") pod \"payload-pre-processing-7677b774bb-qlhr9\" (UID: \"0a96776d-69c1-4463-ae69-9dbb875e6ba9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:16.981327 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:16.981273    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:17.196409 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:17.196348    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"]
Jul 23 19:30:17.199581 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:30:17.199548    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a96776d_69c1_4463_ae69_9dbb875e6ba9.slice/crio-16186bd10f65e9cf405320cb2e989bc37b949effea42588e7516ba6ce669527a WatchSource:0}: Error finding container 16186bd10f65e9cf405320cb2e989bc37b949effea42588e7516ba6ce669527a: Status 404 returned error can't find the container with id 16186bd10f65e9cf405320cb2e989bc37b949effea42588e7516ba6ce669527a
Jul 23 19:30:17.515637 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:17.515599    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9" event={"ID":"0a96776d-69c1-4463-ae69-9dbb875e6ba9","Type":"ContainerStarted","Data":"16186bd10f65e9cf405320cb2e989bc37b949effea42588e7516ba6ce669527a"}
Jul 23 19:30:19.527420 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:19.527382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9" event={"ID":"0a96776d-69c1-4463-ae69-9dbb875e6ba9","Type":"ContainerStarted","Data":"32a4f720e8dbe062a3005ba95004b54638cab417ca18468484a3cb69e579614a"}
Jul 23 19:30:19.527836 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:19.527501    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:22.449310 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:22.449281    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:30:22.449785 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:22.449368    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:30:25.114378 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:25.114328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:25.275363 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:25.275315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:26.890761 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:26.890720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:30.535534 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:30.535503    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9"
Jul 23 19:30:30.580708 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:30.580660    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-qlhr9" podStartSLOduration=13.000095266 podStartE2EDuration="14.580645423s" totalImagesPullingTime="1.580550157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:30:19.579399323 +0000 UTC m=+597.513459467" watchObservedRunningTime="2026-07-23 19:30:30.580645423 +0000 UTC m=+608.514705580"
Jul 23 19:30:46.658866 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:46.658777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:53.131839 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:53.131797    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:30:56.848026 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:30:56.847983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:31:04.134837 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.134803    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"]
Jul 23 19:31:04.137676 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.137660    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.142290 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.142264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tbbll\""
Jul 23 19:31:04.142467 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.142264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 23 19:31:04.142467 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.142264    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 19:31:04.142467 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.142271    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 19:31:04.155426 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.155403    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"]
Jul 23 19:31:04.172279 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.172252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:31:04.251810 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.251771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqqdf\" (UniqueName: \"kubernetes.io/projected/c540a67a-8099-4959-b717-8261bbf41076-kube-api-access-bqqdf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.252015 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.251834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.252015 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.251861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.252015 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.251911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.252015 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.251938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.252015 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.252009    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c540a67a-8099-4959-b717-8261bbf41076-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.352534 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.352486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.352534 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.352531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c540a67a-8099-4959-b717-8261bbf41076-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.352824 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.352590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqqdf\" (UniqueName: \"kubernetes.io/projected/c540a67a-8099-4959-b717-8261bbf41076-kube-api-access-bqqdf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.352824 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.352732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.352824 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.352773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.352824 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.352805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.353055 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.352882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.353168 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.353144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.353227 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.353179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.355133 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.355114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c540a67a-8099-4959-b717-8261bbf41076-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.355274 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.355135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c540a67a-8099-4959-b717-8261bbf41076-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.364406 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.364381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqqdf\" (UniqueName: \"kubernetes.io/projected/c540a67a-8099-4959-b717-8261bbf41076-kube-api-access-bqqdf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-n88sf\" (UID: \"c540a67a-8099-4959-b717-8261bbf41076\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.448976 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.448878    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:04.586960 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.586935    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"]
Jul 23 19:31:04.589026 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:31:04.589000    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc540a67a_8099_4959_b717_8261bbf41076.slice/crio-a81a84deaa41e7b8563abb4caaff29940e7b9eb0c890352f5585089d40f52d97 WatchSource:0}: Error finding container a81a84deaa41e7b8563abb4caaff29940e7b9eb0c890352f5585089d40f52d97: Status 404 returned error can't find the container with id a81a84deaa41e7b8563abb4caaff29940e7b9eb0c890352f5585089d40f52d97
Jul 23 19:31:04.590335 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.590311    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 19:31:04.745187 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:04.745144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf" event={"ID":"c540a67a-8099-4959-b717-8261bbf41076","Type":"ContainerStarted","Data":"a81a84deaa41e7b8563abb4caaff29940e7b9eb0c890352f5585089d40f52d97"}
Jul 23 19:31:07.763664 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:07.763604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf" event={"ID":"c540a67a-8099-4959-b717-8261bbf41076","Type":"ContainerStarted","Data":"1bc0b494a1f14bab316783eb6527f3b03447d2cd685e5d71a53a66bedbd822cd"}
Jul 23 19:31:07.783091 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:07.783030    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf" podStartSLOduration=0.989363139 podStartE2EDuration="3.783015009s" totalImagesPullingTime="2.79365187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:31:07.782179001 +0000 UTC m=+645.716239147" watchObservedRunningTime="2026-07-23 19:31:07.783015009 +0000 UTC m=+645.717075155"
Jul 23 19:31:08.340583 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:08.340546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:31:14.449786 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:14.449742    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:14.450306 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:14.449845    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:14.462313 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:14.462284    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:14.808524 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:14.808494    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-n88sf"
Jul 23 19:31:16.166507 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:16.166478    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:31:18.438228 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:18.438192    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:31:25.136105 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.136072    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"]
Jul 23 19:31:25.138567 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.138551    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.141315 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.141291    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 19:31:25.152285 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.152261    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"]
Jul 23 19:31:25.178586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.178558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:31:25.246702 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.246669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjp5v\" (UniqueName: \"kubernetes.io/projected/62d54e78-1cea-4c30-b33a-ffcdfa0826af-kube-api-access-hjp5v\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.246916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.246760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.246916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.246787    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.246916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.246812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.246916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.246835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.247063 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.246920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d54e78-1cea-4c30-b33a-ffcdfa0826af-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.347459 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.347423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjp5v\" (UniqueName: \"kubernetes.io/projected/62d54e78-1cea-4c30-b33a-ffcdfa0826af-kube-api-access-hjp5v\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.347631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.347501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.347631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.347521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.347631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.347547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.347631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.347568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.347631 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.347621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d54e78-1cea-4c30-b33a-ffcdfa0826af-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.347983 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.347960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.348100 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.348014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.348100 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.348031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.350076 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.350055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d54e78-1cea-4c30-b33a-ffcdfa0826af-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.350214 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.350199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d54e78-1cea-4c30-b33a-ffcdfa0826af-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.356737 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.356719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjp5v\" (UniqueName: \"kubernetes.io/projected/62d54e78-1cea-4c30-b33a-ffcdfa0826af-kube-api-access-hjp5v\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-95kw5\" (UID: \"62d54e78-1cea-4c30-b33a-ffcdfa0826af\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.447979 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.447877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:25.585707 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.585683    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"]
Jul 23 19:31:25.587411 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:31:25.587382    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62d54e78_1cea_4c30_b33a_ffcdfa0826af.slice/crio-d1d619ef0ed34e2bc9cdbf1e5b51afd319caec988c5eb8b4485e68570f6524b2 WatchSource:0}: Error finding container d1d619ef0ed34e2bc9cdbf1e5b51afd319caec988c5eb8b4485e68570f6524b2: Status 404 returned error can't find the container with id d1d619ef0ed34e2bc9cdbf1e5b51afd319caec988c5eb8b4485e68570f6524b2
Jul 23 19:31:25.853869 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.853838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5" event={"ID":"62d54e78-1cea-4c30-b33a-ffcdfa0826af","Type":"ContainerStarted","Data":"0c379c7b40ac7c9978396c8e296dd80e91d747d23fb4d35e1548d9ca61df8e5a"}
Jul 23 19:31:25.854052 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.853877    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5" event={"ID":"62d54e78-1cea-4c30-b33a-ffcdfa0826af","Type":"ContainerStarted","Data":"d1d619ef0ed34e2bc9cdbf1e5b51afd319caec988c5eb8b4485e68570f6524b2"}
Jul 23 19:31:25.876133 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:25.876076    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5" podStartSLOduration=0.718989578 podStartE2EDuration="876.06248ms" totalImagesPullingTime="157.072902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:31:25.874574498 +0000 UTC m=+663.808634647" watchObservedRunningTime="2026-07-23 19:31:25.87606248 +0000 UTC m=+663.810122626"
Jul 23 19:31:35.448318 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:35.448287    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:35.448318 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:35.448325    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:35.460780 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:35.460754    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:31:35.914689 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:31:35.914658    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-95kw5"
Jul 23 19:32:27.311522 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:27.311445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:32:39.883065 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:39.883031    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57d56f486d-4q768"]
Jul 23 19:32:39.886856 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:39.886832    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d56f486d-4q768"
Jul 23 19:32:39.891193 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:39.891173    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rwdhb\""
Jul 23 19:32:39.891300 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:39.891206    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 19:32:39.895423 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:39.895399    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57d56f486d-4q768"]
Jul 23 19:32:39.934645 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:39.934602    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54f4be6f-e28a-4ffd-8452-29445e98e4d0-tls-cert\") pod \"authorino-57d56f486d-4q768\" (UID: \"54f4be6f-e28a-4ffd-8452-29445e98e4d0\") " pod="kuadrant-system/authorino-57d56f486d-4q768"
Jul 23 19:32:39.934645 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:39.934643    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7srd7\" (UniqueName: \"kubernetes.io/projected/54f4be6f-e28a-4ffd-8452-29445e98e4d0-kube-api-access-7srd7\") pod \"authorino-57d56f486d-4q768\" (UID: \"54f4be6f-e28a-4ffd-8452-29445e98e4d0\") " pod="kuadrant-system/authorino-57d56f486d-4q768"
Jul 23 19:32:40.035894 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:40.035857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54f4be6f-e28a-4ffd-8452-29445e98e4d0-tls-cert\") pod \"authorino-57d56f486d-4q768\" (UID: \"54f4be6f-e28a-4ffd-8452-29445e98e4d0\") " pod="kuadrant-system/authorino-57d56f486d-4q768"
Jul 23 19:32:40.035894 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:40.035895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7srd7\" (UniqueName: \"kubernetes.io/projected/54f4be6f-e28a-4ffd-8452-29445e98e4d0-kube-api-access-7srd7\") pod \"authorino-57d56f486d-4q768\" (UID: \"54f4be6f-e28a-4ffd-8452-29445e98e4d0\") " pod="kuadrant-system/authorino-57d56f486d-4q768"
Jul 23 19:32:40.038615 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:40.038592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54f4be6f-e28a-4ffd-8452-29445e98e4d0-tls-cert\") pod \"authorino-57d56f486d-4q768\" (UID: \"54f4be6f-e28a-4ffd-8452-29445e98e4d0\") " pod="kuadrant-system/authorino-57d56f486d-4q768"
Jul 23 19:32:40.044218 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:40.044187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7srd7\" (UniqueName: \"kubernetes.io/projected/54f4be6f-e28a-4ffd-8452-29445e98e4d0-kube-api-access-7srd7\") pod \"authorino-57d56f486d-4q768\" (UID: \"54f4be6f-e28a-4ffd-8452-29445e98e4d0\") " pod="kuadrant-system/authorino-57d56f486d-4q768"
Jul 23 19:32:40.196978 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:40.196887    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d56f486d-4q768"
Jul 23 19:32:40.272240 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:40.272198    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:32:40.343890 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:40.343811    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57d56f486d-4q768"]
Jul 23 19:32:40.346216 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:40.346182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:32:40.346643 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:32:40.346616    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54f4be6f_e28a_4ffd_8452_29445e98e4d0.slice/crio-1a6ca0245837eb02377035c44717cfe80b51020be6b56ee5d82654737f23ae86 WatchSource:0}: Error finding container 1a6ca0245837eb02377035c44717cfe80b51020be6b56ee5d82654737f23ae86: Status 404 returned error can't find the container with id 1a6ca0245837eb02377035c44717cfe80b51020be6b56ee5d82654737f23ae86
Jul 23 19:32:41.228704 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:41.228609    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d56f486d-4q768" event={"ID":"54f4be6f-e28a-4ffd-8452-29445e98e4d0","Type":"ContainerStarted","Data":"24f1d8faa43c4c3d177012bce2675cdee9807a70c259a705381a7f3ce0e76fcc"}
Jul 23 19:32:41.228704 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:41.228659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d56f486d-4q768" event={"ID":"54f4be6f-e28a-4ffd-8452-29445e98e4d0","Type":"ContainerStarted","Data":"1a6ca0245837eb02377035c44717cfe80b51020be6b56ee5d82654737f23ae86"}
Jul 23 19:32:41.247961 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:41.247899    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57d56f486d-4q768" podStartSLOduration=1.640823535 podStartE2EDuration="2.247877544s" totalImagesPullingTime="607.054009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:32:41.247043682 +0000 UTC m=+739.181103830" watchObservedRunningTime="2026-07-23 19:32:41.247877544 +0000 UTC m=+739.181937691"
Jul 23 19:32:41.402058 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:41.402023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:32:41.527916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:32:41.527809    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:33:53.282490 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:33:53.282408    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:33:53.336473 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:33:53.336443    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:34:44.609709 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:34:44.609673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:34:45.793416 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:34:45.793374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:22.481072 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:22.481042    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:35:22.482320 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:22.482296    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:35:25.441928 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:25.441890    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:26.686855 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:26.686817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:31.369921 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:31.369886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:31.470225 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:31.470187    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:31.623113 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:31.623040    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:31.734585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:31.734551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:31.990687 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:31.990658    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:37.810786 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:37.810740    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:35:37.872728 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:35:37.872688    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:37:09.855564 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:37:09.855525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:37:17.875793 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:37:17.875745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:37:17.949653 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:37:17.949618    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:37:56.684593 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:37:56.684554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:40:22.513063 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:40:22.513035    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:40:22.514977 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:40:22.514957    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:42:09.454941 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:42:09.454903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:43:09.206980 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:43:09.206942    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:43:18.377552 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:43:18.377499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:43:22.010680 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:43:22.010628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:43:22.111549 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:43:22.111510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:43:51.135023 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:43:51.134982    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:43:52.538304 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:43:52.538265    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:45:22.546150 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:45:22.546120    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:45:22.551083 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:45:22.551063    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:45:32.154533 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:45:32.154499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:45:32.242057 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:45:32.241996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:45:43.294079 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:45:43.294005    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:02.106884 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:02.106844    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:23.450164 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:23.450081    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:26.400077 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:26.400040    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:26.504329 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:26.504286    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:26.826329 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:26.826293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:32.483590 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:32.483556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:32.545061 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:32.545030    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:32.713898 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:32.713854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:33.018042 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:33.017991    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:33.839724 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:33.839684    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:35.714883 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:35.714842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:35.813879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:35.813843    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:35.942095 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:35.942061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:36.133749 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:36.133659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:36.516750 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:36.516705    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:36.624483 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:36.624447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:47:50.349366 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:47:50.349306    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:11.710269 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:11.710229    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:16.331514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:16.331475    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:16.487693 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:16.487647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:16.731073 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:16.731040    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:16.957811 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:16.957771    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:17.069375 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:17.069247    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:17.171715 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:17.171659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:17.482239 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:17.482201    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:17.876106 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:17.875966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:20.054344 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:20.054312    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:20.325283 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:20.325192    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:20.730221 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:20.730179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:20.890249 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:20.890212    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:20.994407 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:20.994301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:48:55.468179 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:48:55.468140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:00.108572 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:00.108535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:00.261692 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:00.261656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:00.480093 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:00.480062    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:00.703504 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:00.703468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:01.075568 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:01.075532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:01.287558 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:01.287513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:03.280763 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:03.280732    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:03.497584 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:03.497546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:03.604079 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:03.603978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:03.743402 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:03.743343    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:04.136940 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:04.136904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:04.235991 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:04.235948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:39.492637 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:39.492584    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:44.016826 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:44.016781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:45.198146 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:45.198109    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:45.394855 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:45.394814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:45.619883 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:45.619851    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:45.930597 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:45.930507    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:46.252836 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:46.252803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:48.457031 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:48.456988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:48.553971 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:48.553938    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:48.625016 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:48.624972    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:48.953338 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:48.953302    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:49.216828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:49.216711    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:49:49.316191 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:49:49.316159    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:06.704928 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:06.704888    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:06.805435 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:06.805401    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:10.164566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:10.164527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:10.262175 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:10.262142    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:22.578072 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:22.578044    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:50:22.582767 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:22.582747    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:50:23.774203 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:23.774159    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:28.283377 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:28.283321    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:28.427691 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:28.427660    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:28.656424 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:28.656314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:29.127998 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:29.127962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:29.224252 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:29.224209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:29.325128 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:29.325091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:30.693038 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:30.692996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:36.521791 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:36.521746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:36.587676 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:36.587637    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:36.671483 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:36.671452    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:36.770802 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:36.770775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:36.868929 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:36.868833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:50:37.241851 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:50:37.241808    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:03.168980 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:03.168943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:09.532038 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:09.532007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:09.635927 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:09.635895    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:09.732465 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:09.732431    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:25.588651 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:25.588609    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:31.474024 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:31.473980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:31.575806 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:31.575768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:31.673711 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:31.673676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:42.240014 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:42.239974    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:42.990229 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:42.990196    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:49.376292 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:49.376255    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:49.485183 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:49.485136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:49.580159 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:49.580124    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:49.676143 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:49.676046    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:50.384606 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:50.384571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:50.480236 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:50.480198    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:50.580342 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:50.580304    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:52.152996 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:52.152963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:58.582680 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:58.582629    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:58.712832 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:58.712794    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:51:59.224130 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:51:59.224092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:05.141517 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:05.141483    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:05.241464 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:05.241427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:05.341629 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:05.341587    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:05.593284 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:05.593241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:05.753182 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:05.753130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:08.522230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:08.522194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:08.612148 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:08.612112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:08.681257 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:08.681178    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:08.993309 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:08.993248    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:09.186757 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:09.186716    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:09.287562 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:09.287462    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:13.019064 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:13.019027    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:13.725627 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:13.725589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:13.842700 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:13.842656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:14.107521 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:14.107436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:19.901831 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:19.901791    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:20.001460 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:20.001422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:30.726419 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:30.726383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:35.345439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:35.345398    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:35.721965 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:35.721935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:41.373384 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:41.373331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:41.473790 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:41.473748    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:41.641898 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:41.641805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:41.848456 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:41.848412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:41.980566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:41.980527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:42.073502 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:42.073473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:42.237799 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:42.237710    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:48.122751 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:48.122708    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:48.230721 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:48.230685    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:48.321548 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:48.321519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:48.558482 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:48.558442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:48.672127 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:48.672086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:53.496224 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:53.496175    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:53.572762 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:53.572727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:54.653202 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:54.653163    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:52:54.710835 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:52:54.710798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:01.378075 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:01.378033    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:01.685490 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:01.685410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:02.130687 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:02.130652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:04.773959 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:04.773922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:04.873066 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:04.873030    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:04.993774 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:04.993733    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:05.492578 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:05.492541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:05.599614 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:05.599580    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:05.693242 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:05.693212    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:09.388565 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:09.388530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:13.971753 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:13.971655    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:53.074753 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:53.074712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:57.543828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:57.543789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:53:59.692929 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:53:59.692889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:04.773563 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:04.773522    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:20.844250 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:20.844218    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:20.899332 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:20.899287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:41.895331 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:41.895296    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:42.216483 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:42.216440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:48.195329 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:48.195286    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:53.672184 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:53.672141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:53.775552 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:53.775523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:53.960177 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:53.960133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:54.176755 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:54.176721    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:55.202919 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:55.202871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:55.302789 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:55.302754    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:55.408414 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:55.408378    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:56.166913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:56.166875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:56.287197 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:56.287155    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:54:57.739570 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:54:57.739527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:03.928753 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:03.928701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:04.030318 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:04.030269    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:04.712086 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:04.712051    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:07.805523 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:07.805474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:07.930590 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:07.930555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:10.930025 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:10.929981    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:11.039193 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:11.039161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:11.132828 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:11.132776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:21.642130 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:21.642092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:21.992585 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:21.992550    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:22.611087 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:22.611059    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:55:22.623262 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:22.623238    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 19:55:42.961635 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:42.961585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:49.387606 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:49.387557    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:49.487423 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:49.487387    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:49.725491 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:49.725456    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:50.042243 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:50.042140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:50.176544 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:50.176506    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:52.659059 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:52.659022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:52.761815 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:52.761769    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:52.855154 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:52.855090    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:52.958704 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:52.958663    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:53.342197 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:53.342106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:53.442387 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:53.442315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:57.047623 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:57.047589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:57.376429 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:57.376327    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:57.735033 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:57.734997    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:55:58.115414 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:55:58.115291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:00.503443 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:00.503398    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:00.598204 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:00.598165    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:00.720757 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:00.720722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:01.037178 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:01.037139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:01.188653 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:01.188616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:01.287163 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:01.287126    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:04.980855 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:04.980819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:14.136809 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:14.136727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:14.237303 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:14.237271    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:21.028712 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.028675    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"]
Jul 23 19:56:21.032393 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.032372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.034929 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.034908    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4223ab\"/\"default-dockercfg-qbrrh\""
Jul 23 19:56:21.036010 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.035988    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4223ab\"/\"openshift-service-ca.crt\""
Jul 23 19:56:21.036107 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.035997    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4223ab\"/\"kube-root-ca.crt\""
Jul 23 19:56:21.036107 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.036084    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4223ab\"/\"test-model-4223ab-kserve-self-signed-certs\""
Jul 23 19:56:21.041389 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.041336    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"]
Jul 23 19:56:21.057278 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.057236    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:21.210013 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.209975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-model-cache\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.210237 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.210029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctkwr\" (UniqueName: \"kubernetes.io/projected/8e92a5fc-9777-45d8-bf82-65defda9f95e-kube-api-access-ctkwr\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.210237 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.210118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-home\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.210237 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.210153    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e92a5fc-9777-45d8-bf82-65defda9f95e-tls-certs\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.210237 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.210221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-dshm\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.210476 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.210320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-tmp-dir\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.311812 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.311717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-dshm\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.311988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.311821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-tmp-dir\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.311988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.311852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-model-cache\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.311988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.311886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctkwr\" (UniqueName: \"kubernetes.io/projected/8e92a5fc-9777-45d8-bf82-65defda9f95e-kube-api-access-ctkwr\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.311988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.311920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-home\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.311988 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.311942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e92a5fc-9777-45d8-bf82-65defda9f95e-tls-certs\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.312262 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.312243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-tmp-dir\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.312312 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.312275    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-model-cache\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.312312 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.312300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-home\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.314196 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.314174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-dshm\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.315141 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.315118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e92a5fc-9777-45d8-bf82-65defda9f95e-tls-certs\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.319712 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.319690    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctkwr\" (UniqueName: \"kubernetes.io/projected/8e92a5fc-9777-45d8-bf82-65defda9f95e-kube-api-access-ctkwr\") pod \"test-model-4223ab-kserve-569d584c9c-ssr2g\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") " pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.343685 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.343650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:21.487122 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.487096    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"]
Jul 23 19:56:21.489737 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:56:21.489708    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e92a5fc_9777_45d8_bf82_65defda9f95e.slice/crio-e9865d8681833a76a518d05306b15b71e029ea7ae0493f08d4a09250f7d33802 WatchSource:0}: Error finding container e9865d8681833a76a518d05306b15b71e029ea7ae0493f08d4a09250f7d33802: Status 404 returned error can't find the container with id e9865d8681833a76a518d05306b15b71e029ea7ae0493f08d4a09250f7d33802
Jul 23 19:56:21.965603 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:21.965570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:22.047784 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:22.047752    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:22.228958 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:22.228870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g" event={"ID":"8e92a5fc-9777-45d8-bf82-65defda9f95e","Type":"ContainerStarted","Data":"64f09ba6b5f2ba6b24c9e7a0d0651c7034f5bfec0c8b5e7d9a1e2fcb3b398574"}
Jul 23 19:56:22.228958 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:22.228916    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g" event={"ID":"8e92a5fc-9777-45d8-bf82-65defda9f95e","Type":"ContainerStarted","Data":"e9865d8681833a76a518d05306b15b71e029ea7ae0493f08d4a09250f7d33802"}
Jul 23 19:56:22.245500 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:22.245448    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g" podStartSLOduration=1.24542833 podStartE2EDuration="1.24542833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:56:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:56:22.244549559 +0000 UTC m=+2160.178609707" watchObservedRunningTime="2026-07-23 19:56:22.24542833 +0000 UTC m=+2160.179488477"
Jul 23 19:56:31.344594 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:31.344554    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:31.345008 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:31.344614    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:31.357201 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:31.357172    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:32.288677 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:32.288633    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:56:38.815637 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.815596    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"]
Jul 23 19:56:38.819368 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.819336    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.823012 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.822986    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-111c5d\"/\"test-model-111c5d-kserve-self-signed-certs\""
Jul 23 19:56:38.823012 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.823003    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-111c5d\"/\"default-dockercfg-6d76s\""
Jul 23 19:56:38.823231 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.823041    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-111c5d\"/\"openshift-service-ca.crt\""
Jul 23 19:56:38.823231 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.823005    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-111c5d\"/\"kube-root-ca.crt\""
Jul 23 19:56:38.828135 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.828108    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"]
Jul 23 19:56:38.842799 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.842753    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:38.878706 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.878662    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tls-certs\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.878914 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.878716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-home\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.878914 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.878743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsdp2\" (UniqueName: \"kubernetes.io/projected/0bbb8ae3-1d3d-4a80-b400-bb870e248255-kube-api-access-qsdp2\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.878914 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.878818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-model-cache\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.879058 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.878975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-dshm\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.879058 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.879018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tmp-dir\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980256 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-home\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980256 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsdp2\" (UniqueName: \"kubernetes.io/projected/0bbb8ae3-1d3d-4a80-b400-bb870e248255-kube-api-access-qsdp2\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980579 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-model-cache\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980579 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-dshm\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980579 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tmp-dir\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980579 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tls-certs\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980793 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-home\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980850 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980816    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-model-cache\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.980895 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.980864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tmp-dir\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.982842 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.982820    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-dshm\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.983011 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.982993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tls-certs\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:38.989902 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:38.989876    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsdp2\" (UniqueName: \"kubernetes.io/projected/0bbb8ae3-1d3d-4a80-b400-bb870e248255-kube-api-access-qsdp2\") pod \"test-model-111c5d-kserve-849cfc5d67-q9vx4\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") " pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:39.130213 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:39.130117    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:39.266534 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:39.266509    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"]
Jul 23 19:56:39.268519 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:56:39.268488    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bbb8ae3_1d3d_4a80_b400_bb870e248255.slice/crio-123f5533aae6112ff84a2e049ff219196267c26e95b3680dbc55d7d998f5bd71 WatchSource:0}: Error finding container 123f5533aae6112ff84a2e049ff219196267c26e95b3680dbc55d7d998f5bd71: Status 404 returned error can't find the container with id 123f5533aae6112ff84a2e049ff219196267c26e95b3680dbc55d7d998f5bd71
Jul 23 19:56:39.312796 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:39.312761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4" event={"ID":"0bbb8ae3-1d3d-4a80-b400-bb870e248255","Type":"ContainerStarted","Data":"123f5533aae6112ff84a2e049ff219196267c26e95b3680dbc55d7d998f5bd71"}
Jul 23 19:56:40.320640 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:40.320604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4" event={"ID":"0bbb8ae3-1d3d-4a80-b400-bb870e248255","Type":"ContainerStarted","Data":"24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231"}
Jul 23 19:56:40.337759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:40.337701    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4" podStartSLOduration=2.337685509 podStartE2EDuration="2.337685509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:56:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:56:40.335745105 +0000 UTC m=+2178.269805250" watchObservedRunningTime="2026-07-23 19:56:40.337685509 +0000 UTC m=+2178.271745657"
Jul 23 19:56:49.130415 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:49.130364    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:49.130821 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:49.130434    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:49.142977 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:49.142944    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:49.376843 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:49.376802    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:56:51.267520 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:51.267489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:56:51.322399 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:56:51.322335    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:24.395830 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:24.395789    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"]
Jul 23 19:57:24.416083 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:24.416029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:25.262217 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:25.262178    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"]
Jul 23 19:57:25.329428 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:25.329380    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:26.018197 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:26.018163    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:26.120137 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:26.120093    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:35.857014 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:35.856974    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:39.416913 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.416867    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g" podUID="8e92a5fc-9777-45d8-bf82-65defda9f95e" containerName="main" containerID="cri-o://64f09ba6b5f2ba6b24c9e7a0d0651c7034f5bfec0c8b5e7d9a1e2fcb3b398574" gracePeriod=45
Jul 23 19:57:39.641183 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.641109    2561 generic.go:356] "Generic (PLEG): container finished" podID="8e92a5fc-9777-45d8-bf82-65defda9f95e" containerID="64f09ba6b5f2ba6b24c9e7a0d0651c7034f5bfec0c8b5e7d9a1e2fcb3b398574" exitCode=0
Jul 23 19:57:39.641183 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.641148    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g" event={"ID":"8e92a5fc-9777-45d8-bf82-65defda9f95e","Type":"ContainerDied","Data":"64f09ba6b5f2ba6b24c9e7a0d0651c7034f5bfec0c8b5e7d9a1e2fcb3b398574"}
Jul 23 19:57:39.662864 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.662833    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:57:39.766323 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766279    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-tmp-dir\") pod \"8e92a5fc-9777-45d8-bf82-65defda9f95e\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") "
Jul 23 19:57:39.766323 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766329    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-home\") pod \"8e92a5fc-9777-45d8-bf82-65defda9f95e\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") "
Jul 23 19:57:39.766624 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766383    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-model-cache\") pod \"8e92a5fc-9777-45d8-bf82-65defda9f95e\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") "
Jul 23 19:57:39.766624 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766421    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-dshm\") pod \"8e92a5fc-9777-45d8-bf82-65defda9f95e\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") "
Jul 23 19:57:39.766624 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766445    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctkwr\" (UniqueName: \"kubernetes.io/projected/8e92a5fc-9777-45d8-bf82-65defda9f95e-kube-api-access-ctkwr\") pod \"8e92a5fc-9777-45d8-bf82-65defda9f95e\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") "
Jul 23 19:57:39.766624 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766475    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e92a5fc-9777-45d8-bf82-65defda9f95e-tls-certs\") pod \"8e92a5fc-9777-45d8-bf82-65defda9f95e\" (UID: \"8e92a5fc-9777-45d8-bf82-65defda9f95e\") "
Jul 23 19:57:39.766891 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766648    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8e92a5fc-9777-45d8-bf82-65defda9f95e" (UID: "8e92a5fc-9777-45d8-bf82-65defda9f95e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:39.766891 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766665    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-home" (OuterVolumeSpecName: "home") pod "8e92a5fc-9777-45d8-bf82-65defda9f95e" (UID: "8e92a5fc-9777-45d8-bf82-65defda9f95e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:39.766891 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766726    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-model-cache" (OuterVolumeSpecName: "model-cache") pod "8e92a5fc-9777-45d8-bf82-65defda9f95e" (UID: "8e92a5fc-9777-45d8-bf82-65defda9f95e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:39.766891 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766822    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-tmp-dir\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:39.766891 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766842    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-home\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:39.766891 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.766855    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-model-cache\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:39.768819 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.768798    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-dshm" (OuterVolumeSpecName: "dshm") pod "8e92a5fc-9777-45d8-bf82-65defda9f95e" (UID: "8e92a5fc-9777-45d8-bf82-65defda9f95e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:39.768935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.768829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e92a5fc-9777-45d8-bf82-65defda9f95e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8e92a5fc-9777-45d8-bf82-65defda9f95e" (UID: "8e92a5fc-9777-45d8-bf82-65defda9f95e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:57:39.768935 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.768860    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e92a5fc-9777-45d8-bf82-65defda9f95e-kube-api-access-ctkwr" (OuterVolumeSpecName: "kube-api-access-ctkwr") pod "8e92a5fc-9777-45d8-bf82-65defda9f95e" (UID: "8e92a5fc-9777-45d8-bf82-65defda9f95e"). InnerVolumeSpecName "kube-api-access-ctkwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:57:39.868010 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.867972    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e92a5fc-9777-45d8-bf82-65defda9f95e-dshm\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:39.868010 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.868008    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctkwr\" (UniqueName: \"kubernetes.io/projected/8e92a5fc-9777-45d8-bf82-65defda9f95e-kube-api-access-ctkwr\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:39.868232 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:39.868025    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e92a5fc-9777-45d8-bf82-65defda9f95e-tls-certs\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:40.292332 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.292274    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4" podUID="0bbb8ae3-1d3d-4a80-b400-bb870e248255" containerName="main" containerID="cri-o://24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231" gracePeriod=45
Jul 23 19:57:40.493727 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.493688    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:40.555737 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.555657    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:57:40.575759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.575529    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-home\") pod \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") "
Jul 23 19:57:40.575759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.575596    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-model-cache\") pod \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") "
Jul 23 19:57:40.575759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.575622    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tmp-dir\") pod \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") "
Jul 23 19:57:40.575759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.575649    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-dshm\") pod \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") "
Jul 23 19:57:40.575759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.575695    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsdp2\" (UniqueName: \"kubernetes.io/projected/0bbb8ae3-1d3d-4a80-b400-bb870e248255-kube-api-access-qsdp2\") pod \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") "
Jul 23 19:57:40.575759 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.575753    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tls-certs\") pod \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\" (UID: \"0bbb8ae3-1d3d-4a80-b400-bb870e248255\") "
Jul 23 19:57:40.576346 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.575786    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-home" (OuterVolumeSpecName: "home") pod "0bbb8ae3-1d3d-4a80-b400-bb870e248255" (UID: "0bbb8ae3-1d3d-4a80-b400-bb870e248255"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:40.576346 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.575974    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0bbb8ae3-1d3d-4a80-b400-bb870e248255" (UID: "0bbb8ae3-1d3d-4a80-b400-bb870e248255"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:40.576346 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.576151    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-model-cache" (OuterVolumeSpecName: "model-cache") pod "0bbb8ae3-1d3d-4a80-b400-bb870e248255" (UID: "0bbb8ae3-1d3d-4a80-b400-bb870e248255"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:40.576772 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.576738    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-home\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:40.576772 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.576766    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-model-cache\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:40.576951 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.576806    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tmp-dir\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:40.579083 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.579059    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0bbb8ae3-1d3d-4a80-b400-bb870e248255" (UID: "0bbb8ae3-1d3d-4a80-b400-bb870e248255"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:57:40.579083 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.579073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bbb8ae3-1d3d-4a80-b400-bb870e248255-kube-api-access-qsdp2" (OuterVolumeSpecName: "kube-api-access-qsdp2") pod "0bbb8ae3-1d3d-4a80-b400-bb870e248255" (UID: "0bbb8ae3-1d3d-4a80-b400-bb870e248255"). InnerVolumeSpecName "kube-api-access-qsdp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:57:40.579241 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.579100    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-dshm" (OuterVolumeSpecName: "dshm") pod "0bbb8ae3-1d3d-4a80-b400-bb870e248255" (UID: "0bbb8ae3-1d3d-4a80-b400-bb870e248255"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:40.647986 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.647943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g" event={"ID":"8e92a5fc-9777-45d8-bf82-65defda9f95e","Type":"ContainerDied","Data":"e9865d8681833a76a518d05306b15b71e029ea7ae0493f08d4a09250f7d33802"}
Jul 23 19:57:40.647986 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.647958    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"
Jul 23 19:57:40.648253 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.648002    2561 scope.go:117] "RemoveContainer" containerID="64f09ba6b5f2ba6b24c9e7a0d0651c7034f5bfec0c8b5e7d9a1e2fcb3b398574"
Jul 23 19:57:40.649470 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.649440    2561 generic.go:356] "Generic (PLEG): container finished" podID="0bbb8ae3-1d3d-4a80-b400-bb870e248255" containerID="24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231" exitCode=0
Jul 23 19:57:40.649580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.649484    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4" event={"ID":"0bbb8ae3-1d3d-4a80-b400-bb870e248255","Type":"ContainerDied","Data":"24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231"}
Jul 23 19:57:40.649580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.649498    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"
Jul 23 19:57:40.649580 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.649516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4" event={"ID":"0bbb8ae3-1d3d-4a80-b400-bb870e248255","Type":"ContainerDied","Data":"123f5533aae6112ff84a2e049ff219196267c26e95b3680dbc55d7d998f5bd71"}
Jul 23 19:57:40.657550 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.657524    2561 scope.go:117] "RemoveContainer" containerID="24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231"
Jul 23 19:57:40.665447 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.665422    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"]
Jul 23 19:57:40.666230 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.666205    2561 scope.go:117] "RemoveContainer" containerID="24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231"
Jul 23 19:57:40.666780 ip-10-0-135-62 kubenswrapper[2561]: E0723 19:57:40.666743    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231\": container with ID starting with 24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231 not found: ID does not exist" containerID="24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231"
Jul 23 19:57:40.666880 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.666783    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231"} err="failed to get container status \"24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231\": rpc error: code = NotFound desc = could not find container \"24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231\": container with ID starting with 24441b6f507e3afc1272cfd0b9296303491aeafc34a23ca10eb8a5aad9548231 not found: ID does not exist"
Jul 23 19:57:40.668907 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.668880    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4223ab/test-model-4223ab-kserve-569d584c9c-ssr2g"]
Jul 23 19:57:40.678193 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.678166    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsdp2\" (UniqueName: \"kubernetes.io/projected/0bbb8ae3-1d3d-4a80-b400-bb870e248255-kube-api-access-qsdp2\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:40.678193 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.678193    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb8ae3-1d3d-4a80-b400-bb870e248255-tls-certs\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:40.678193 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.678204    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bbb8ae3-1d3d-4a80-b400-bb870e248255-dshm\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 19:57:40.683495 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.683467    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"]
Jul 23 19:57:40.686597 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.686572    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-111c5d/test-model-111c5d-kserve-849cfc5d67-q9vx4"]
Jul 23 19:57:40.863088 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:40.862999    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:42.567578 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:42.567495    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bbb8ae3-1d3d-4a80-b400-bb870e248255" path="/var/lib/kubelet/pods/0bbb8ae3-1d3d-4a80-b400-bb870e248255/volumes"
Jul 23 19:57:42.567982 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:42.567878    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e92a5fc-9777-45d8-bf82-65defda9f95e" path="/var/lib/kubelet/pods/8e92a5fc-9777-45d8-bf82-65defda9f95e/volumes"
Jul 23 19:57:46.637632 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:46.637582    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:46.739325 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:46.739292    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:46.915277 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:46.915183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:47.118920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:47.118885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:48.015994 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:48.015956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:48.120596 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:48.120566    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:57:57.758565 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:57:57.758514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:02.297245 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:02.297211    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:02.688207 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:02.688095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:08.388142 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:08.388105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:08.451188 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:08.451158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:08.646193 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:08.646101    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:08.861209 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:08.861167    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:09.204812 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:09.204776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:09.524529 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:09.524442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:09.621439 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:09.621405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:10.609346 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:10.609306    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:12.141396 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:12.141334    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:12.235308 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:12.235273    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:12.323190 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:12.323158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:12.830378 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:12.830317    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:12.932608 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:12.932573    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:13.039674 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:13.039642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:16.629002 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:16.628969    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:17.070647 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:17.070603    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:17.386457 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:17.386371    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:17.685700 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:17.685614    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:17.786112 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:17.786073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:20.189385 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:20.189316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:20.288924 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:20.288894    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:20.422553 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:20.422516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:20.615473 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:20.615441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:21.013242 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:21.013203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:21.114823 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:21.114792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:24.779598 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:24.779566    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:33.510034 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:33.509995    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:33.611452 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:33.611417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:41.901980 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:41.901940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:42.002419 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:42.002383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:43.267130 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:43.267095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:43.379440 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:43.379403    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:48.536578 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:48.536547    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:52.792600 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:52.792558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:53.156276 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:53.156175    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:59.085626 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:59.085589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:59.186701 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:59.186667    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:59.350414 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:59.350305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:58:59.561920 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:58:59.561890    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:00.356047 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:00.356013    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:00.456676 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:00.456644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:15.280273 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:15.280176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:19.766557 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:19.766520    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:20.204456 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:20.204427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:26.003995 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:26.003953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:26.103181 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:26.103145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:26.272504 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:26.272419    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:26.495236 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:26.495200    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:26.840489 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:26.840459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:27.151566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:27.151467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:27.394702 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:27.394670    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:29.540454 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:29.540423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:29.621334 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:29.621299    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:29.707898 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:29.707864    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:29.919102 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:29.919008    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:30.419604 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:30.419564    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:30.523628 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:30.523593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:34.010713 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:34.010673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:34.323399 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:34.323279    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:34.619776 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:34.619688    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:34.928901 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:34.928810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:37.594435 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:37.594383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:37.703566 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:37.703533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:37.864045 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:37.863950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:38.033483 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:38.033441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:38.396644 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:38.396604    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:38.496514 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:38.496477    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:42.047791 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:42.047757    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:51.347084 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:51.347029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:51.408608 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:51.408575    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:54.415934 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.415897    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"]
Jul 23 19:59:54.416565 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.416545    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e92a5fc-9777-45d8-bf82-65defda9f95e" containerName="main"
Jul 23 19:59:54.416715 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.416569    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e92a5fc-9777-45d8-bf82-65defda9f95e" containerName="main"
Jul 23 19:59:54.416715 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.416597    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bbb8ae3-1d3d-4a80-b400-bb870e248255" containerName="main"
Jul 23 19:59:54.416715 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.416606    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bbb8ae3-1d3d-4a80-b400-bb870e248255" containerName="main"
Jul 23 19:59:54.416715 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.416705    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bbb8ae3-1d3d-4a80-b400-bb870e248255" containerName="main"
Jul 23 19:59:54.416916 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.416718    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e92a5fc-9777-45d8-bf82-65defda9f95e" containerName="main"
Jul 23 19:59:54.419613 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.419592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.423138 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.423115    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"kube-root-ca.crt\""
Jul 23 19:59:54.423253 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.423115    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"openshift-service-ca.crt\""
Jul 23 19:59:54.423253 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.423175    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"default-dockercfg-hvlbz\""
Jul 23 19:59:54.423253 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.423187    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"auth-test-model-fb64e5-kserve-self-signed-certs\""
Jul 23 19:59:54.429090 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.429062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"]
Jul 23 19:59:54.448993 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.448963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:54.450682 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.450665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-model-cache\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.450775 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.450693    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-dshm\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.450775 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.450753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tmp-dir\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.450846 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.450819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4t8s\" (UniqueName: \"kubernetes.io/projected/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-kube-api-access-f4t8s\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.450937 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.450916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-home\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.451065 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.450981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tls-certs\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552373 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-model-cache\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552411    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-dshm\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tmp-dir\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4t8s\" (UniqueName: \"kubernetes.io/projected/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-kube-api-access-f4t8s\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552529    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-home\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552586 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tls-certs\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552861 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552794    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-model-cache\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552956 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tmp-dir\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.552956 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.552936    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-home\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.554879 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.554856    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-dshm\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.555164 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.555147    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tls-certs\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.561179 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.561151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4t8s\" (UniqueName: \"kubernetes.io/projected/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-kube-api-access-f4t8s\") pod \"auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") " pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.730523 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.730485    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 19:59:54.869475 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:54.869441    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"]
Jul 23 19:59:54.872648 ip-10-0-135-62 kubenswrapper[2561]: W0723 19:59:54.872615    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaee8b9c_4ad1_44d8_a021_601c8cea7ef6.slice/crio-71b0f01bd73017096fb32140260bb0fb9893e366cbf80c215209e7d93e611743 WatchSource:0}: Error finding container 71b0f01bd73017096fb32140260bb0fb9893e366cbf80c215209e7d93e611743: Status 404 returned error can't find the container with id 71b0f01bd73017096fb32140260bb0fb9893e366cbf80c215209e7d93e611743
Jul 23 19:59:55.313005 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:55.312973    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5" event={"ID":"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6","Type":"ContainerStarted","Data":"9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81"}
Jul 23 19:59:55.313005 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:55.313013    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5" event={"ID":"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6","Type":"ContainerStarted","Data":"71b0f01bd73017096fb32140260bb0fb9893e366cbf80c215209e7d93e611743"}
Jul 23 19:59:55.331252 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:55.331201    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5" podStartSLOduration=1.331186926 podStartE2EDuration="1.331186926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:59:55.329332912 +0000 UTC m=+2373.263393060" watchObservedRunningTime="2026-07-23 19:59:55.331186926 +0000 UTC m=+2373.265247072"
Jul 23 19:59:59.389222 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:59.389173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 19:59:59.489590 ip-10-0-135-62 kubenswrapper[2561]: I0723 19:59:59.489556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:00:04.731605 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:04.731565    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 20:00:04.732045 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:04.731620    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 20:00:04.744468 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:04.744437    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 20:00:05.374330 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:05.374299    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 20:00:08.689052 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:08.689013    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:00:08.789164 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:08.789123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:00:11.342506 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:11.342459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:00:12.832248 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.832206    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"]
Jul 23 20:00:12.835825 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.835804    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:12.839299 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.839271    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"default-dockercfg-q6ctn\""
Jul 23 20:00:12.840451 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.840429    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"auth-test-model-470e58-kserve-self-signed-certs\""
Jul 23 20:00:12.840555 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.840500    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"openshift-service-ca.crt\""
Jul 23 20:00:12.840555 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.840442    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"kube-root-ca.crt\""
Jul 23 20:00:12.850369 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.850320    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"]
Jul 23 20:00:12.861157 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.861122    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:00:12.937719 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.937675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-model-cache\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:12.937719 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.937721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7qxg\" (UniqueName: \"kubernetes.io/projected/72f14312-4fe5-45de-8082-97c692636739-kube-api-access-w7qxg\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:12.938065 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.937791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-dshm\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:12.938065 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.937831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72f14312-4fe5-45de-8082-97c692636739-tls-certs\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:12.938065 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.937858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-tmp-dir\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:12.938065 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:12.937873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-home\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039367 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-model-cache\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039560 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7qxg\" (UniqueName: \"kubernetes.io/projected/72f14312-4fe5-45de-8082-97c692636739-kube-api-access-w7qxg\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039560 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-dshm\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039560 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72f14312-4fe5-45de-8082-97c692636739-tls-certs\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039560 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-tmp-dir\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039560 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-home\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039861 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-model-cache\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039912 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039897    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-tmp-dir\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.039949 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.039938    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-home\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.042037 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.042013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-dshm\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.042318 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.042299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72f14312-4fe5-45de-8082-97c692636739-tls-certs\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.051617 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.051586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7qxg\" (UniqueName: \"kubernetes.io/projected/72f14312-4fe5-45de-8082-97c692636739-kube-api-access-w7qxg\") pod \"auth-test-model-470e58-kserve-55fd749df9-jqmns\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") " pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.146401 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.146289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:13.288740 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.288710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"]
Jul 23 20:00:13.290430 ip-10-0-135-62 kubenswrapper[2561]: W0723 20:00:13.290400    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72f14312_4fe5_45de_8082_97c692636739.slice/crio-4ad1f9363b645cee3beeac4f1acda59621f79732179b722f5506a23ac6054759 WatchSource:0}: Error finding container 4ad1f9363b645cee3beeac4f1acda59621f79732179b722f5506a23ac6054759: Status 404 returned error can't find the container with id 4ad1f9363b645cee3beeac4f1acda59621f79732179b722f5506a23ac6054759
Jul 23 20:00:13.406837 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.406747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns" event={"ID":"72f14312-4fe5-45de-8082-97c692636739","Type":"ContainerStarted","Data":"fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631"}
Jul 23 20:00:13.406837 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.406794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns" event={"ID":"72f14312-4fe5-45de-8082-97c692636739","Type":"ContainerStarted","Data":"4ad1f9363b645cee3beeac4f1acda59621f79732179b722f5506a23ac6054759"}
Jul 23 20:00:13.426472 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:13.426414    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns" podStartSLOduration=1.426394858 podStartE2EDuration="1.426394858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:00:13.424817316 +0000 UTC m=+2391.358877461" watchObservedRunningTime="2026-07-23 20:00:13.426394858 +0000 UTC m=+2391.360455005"
Jul 23 20:00:22.648829 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:22.648802    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 20:00:22.660458 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:22.660437    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 20:00:23.146423 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:23.146373    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:23.146649 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:23.146441    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:23.160864 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:23.160838    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:00:23.468989 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:00:23.468955    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:02:11.367539 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:11.367498    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"]
Jul 23 20:02:11.414097 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:11.414062    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:02:12.125040 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:12.125010    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"]
Jul 23 20:02:12.322784 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:12.322746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:02:14.448972 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:14.448922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:02:14.988891 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:14.988857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:02:26.388386 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.388296    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5" podUID="eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" containerName="main" containerID="cri-o://9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81" gracePeriod=45
Jul 23 20:02:26.640666 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.640603    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 20:02:26.746926 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.746898    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-model-cache\") pod \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") "
Jul 23 20:02:26.747123 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.746936    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tls-certs\") pod \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") "
Jul 23 20:02:26.747123 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.746973    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-home\") pod \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") "
Jul 23 20:02:26.747123 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.746990    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tmp-dir\") pod \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") "
Jul 23 20:02:26.747123 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.747010    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4t8s\" (UniqueName: \"kubernetes.io/projected/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-kube-api-access-f4t8s\") pod \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") "
Jul 23 20:02:26.747349 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.747138    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-dshm\") pod \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\" (UID: \"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6\") "
Jul 23 20:02:26.747349 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.747259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-home" (OuterVolumeSpecName: "home") pod "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" (UID: "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:02:26.747349 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.747266    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-model-cache" (OuterVolumeSpecName: "model-cache") pod "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" (UID: "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:02:26.747349 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.747327    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" (UID: "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:02:26.747538 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.747471    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-home\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:26.747538 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.747513    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tmp-dir\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:26.747538 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.747528    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-model-cache\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:26.749484 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.749459    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" (UID: "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 20:02:26.749612 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.749535    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-dshm" (OuterVolumeSpecName: "dshm") pod "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" (UID: "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:02:26.749612 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.749522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-kube-api-access-f4t8s" (OuterVolumeSpecName: "kube-api-access-f4t8s") pod "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" (UID: "eaee8b9c-4ad1-44d8-a021-601c8cea7ef6"). InnerVolumeSpecName "kube-api-access-f4t8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:02:26.848580 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.848545    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-dshm\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:26.848580 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.848574    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-tls-certs\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:26.848580 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:26.848585    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4t8s\" (UniqueName: \"kubernetes.io/projected/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6-kube-api-access-f4t8s\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:27.076883 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.076840    2561 generic.go:356] "Generic (PLEG): container finished" podID="eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" containerID="9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81" exitCode=0
Jul 23 20:02:27.077055 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.076891    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"
Jul 23 20:02:27.077055 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.076923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5" event={"ID":"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6","Type":"ContainerDied","Data":"9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81"}
Jul 23 20:02:27.077055 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.076972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5" event={"ID":"eaee8b9c-4ad1-44d8-a021-601c8cea7ef6","Type":"ContainerDied","Data":"71b0f01bd73017096fb32140260bb0fb9893e366cbf80c215209e7d93e611743"}
Jul 23 20:02:27.077055 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.076993    2561 scope.go:117] "RemoveContainer" containerID="9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81"
Jul 23 20:02:27.086227 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.086206    2561 scope.go:117] "RemoveContainer" containerID="9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81"
Jul 23 20:02:27.086542 ip-10-0-135-62 kubenswrapper[2561]: E0723 20:02:27.086517    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81\": container with ID starting with 9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81 not found: ID does not exist" containerID="9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81"
Jul 23 20:02:27.086607 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.086555    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81"} err="failed to get container status \"9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81\": rpc error: code = NotFound desc = could not find container \"9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81\": container with ID starting with 9e6118362e6ec2f18ab511f33f755654f7feb6882a7a2e537278bf025b38af81 not found: ID does not exist"
Jul 23 20:02:27.098391 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.098347    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"]
Jul 23 20:02:27.102818 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.102793    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/auth-test-model-fb64e5-kserve-578b4f4ff-8dmt5"]
Jul 23 20:02:27.146744 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.146706    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns" podUID="72f14312-4fe5-45de-8082-97c692636739" containerName="main" containerID="cri-o://fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631" gracePeriod=45
Jul 23 20:02:27.388962 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.388936    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:02:27.455212 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455177    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-model-cache\") pod \"72f14312-4fe5-45de-8082-97c692636739\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") "
Jul 23 20:02:27.455410 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455248    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-dshm\") pod \"72f14312-4fe5-45de-8082-97c692636739\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") "
Jul 23 20:02:27.455410 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455296    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7qxg\" (UniqueName: \"kubernetes.io/projected/72f14312-4fe5-45de-8082-97c692636739-kube-api-access-w7qxg\") pod \"72f14312-4fe5-45de-8082-97c692636739\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") "
Jul 23 20:02:27.455410 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455336    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72f14312-4fe5-45de-8082-97c692636739-tls-certs\") pod \"72f14312-4fe5-45de-8082-97c692636739\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") "
Jul 23 20:02:27.455597 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455470    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-home\") pod \"72f14312-4fe5-45de-8082-97c692636739\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") "
Jul 23 20:02:27.455597 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455493    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-tmp-dir\") pod \"72f14312-4fe5-45de-8082-97c692636739\" (UID: \"72f14312-4fe5-45de-8082-97c692636739\") "
Jul 23 20:02:27.455597 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-model-cache" (OuterVolumeSpecName: "model-cache") pod "72f14312-4fe5-45de-8082-97c692636739" (UID: "72f14312-4fe5-45de-8082-97c692636739"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:02:27.455754 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-home" (OuterVolumeSpecName: "home") pod "72f14312-4fe5-45de-8082-97c692636739" (UID: "72f14312-4fe5-45de-8082-97c692636739"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:02:27.455810 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455771    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "72f14312-4fe5-45de-8082-97c692636739" (UID: "72f14312-4fe5-45de-8082-97c692636739"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:02:27.455908 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455888    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-home\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:27.455969 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455912    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-tmp-dir\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:27.455969 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.455927    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-model-cache\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:27.457842 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.457802    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-dshm" (OuterVolumeSpecName: "dshm") pod "72f14312-4fe5-45de-8082-97c692636739" (UID: "72f14312-4fe5-45de-8082-97c692636739"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:02:27.457842 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.457805    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72f14312-4fe5-45de-8082-97c692636739-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "72f14312-4fe5-45de-8082-97c692636739" (UID: "72f14312-4fe5-45de-8082-97c692636739"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 20:02:27.458024 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.457858    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72f14312-4fe5-45de-8082-97c692636739-kube-api-access-w7qxg" (OuterVolumeSpecName: "kube-api-access-w7qxg") pod "72f14312-4fe5-45de-8082-97c692636739" (UID: "72f14312-4fe5-45de-8082-97c692636739"). InnerVolumeSpecName "kube-api-access-w7qxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:02:27.556912 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.556868    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7qxg\" (UniqueName: \"kubernetes.io/projected/72f14312-4fe5-45de-8082-97c692636739-kube-api-access-w7qxg\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:27.556912 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.556901    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72f14312-4fe5-45de-8082-97c692636739-tls-certs\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:27.556912 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:27.556912    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72f14312-4fe5-45de-8082-97c692636739-dshm\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:02:28.083644 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.083609    2561 generic.go:356] "Generic (PLEG): container finished" podID="72f14312-4fe5-45de-8082-97c692636739" containerID="fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631" exitCode=0
Jul 23 20:02:28.083896 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.083662    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"
Jul 23 20:02:28.083896 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.083699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns" event={"ID":"72f14312-4fe5-45de-8082-97c692636739","Type":"ContainerDied","Data":"fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631"}
Jul 23 20:02:28.083896 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.083751    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns" event={"ID":"72f14312-4fe5-45de-8082-97c692636739","Type":"ContainerDied","Data":"4ad1f9363b645cee3beeac4f1acda59621f79732179b722f5506a23ac6054759"}
Jul 23 20:02:28.083896 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.083771    2561 scope.go:117] "RemoveContainer" containerID="fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631"
Jul 23 20:02:28.093130 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.093113    2561 scope.go:117] "RemoveContainer" containerID="fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631"
Jul 23 20:02:28.093481 ip-10-0-135-62 kubenswrapper[2561]: E0723 20:02:28.093459    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631\": container with ID starting with fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631 not found: ID does not exist" containerID="fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631"
Jul 23 20:02:28.093540 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.093488    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631"} err="failed to get container status \"fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631\": rpc error: code = NotFound desc = could not find container \"fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631\": container with ID starting with fd652aec05216ed4df816125cc527d02c0b6058cae3d5af65617323a42897631 not found: ID does not exist"
Jul 23 20:02:28.105968 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.105940    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"]
Jul 23 20:02:28.110225 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.110201    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/auth-test-model-470e58-kserve-55fd749df9-jqmns"]
Jul 23 20:02:28.566858 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.566825    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72f14312-4fe5-45de-8082-97c692636739" path="/var/lib/kubelet/pods/72f14312-4fe5-45de-8082-97c692636739/volumes"
Jul 23 20:02:28.567262 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.567197    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" path="/var/lib/kubelet/pods/eaee8b9c-4ad1-44d8-a021-601c8cea7ef6/volumes"
Jul 23 20:02:28.877991 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.877896    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:02:28.953777 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:28.953737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:02:36.523902 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.523869    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"]
Jul 23 20:02:36.524323 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.524248    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72f14312-4fe5-45de-8082-97c692636739" containerName="main"
Jul 23 20:02:36.524323 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.524259    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="72f14312-4fe5-45de-8082-97c692636739" containerName="main"
Jul 23 20:02:36.524323 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.524277    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" containerName="main"
Jul 23 20:02:36.524323 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.524282    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" containerName="main"
Jul 23 20:02:36.524560 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.524369    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaee8b9c-4ad1-44d8-a021-601c8cea7ef6" containerName="main"
Jul 23 20:02:36.524560 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.524384    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="72f14312-4fe5-45de-8082-97c692636739" containerName="main"
Jul 23 20:02:36.528736 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.528716    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.531412 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.531333    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"kube-root-ca.crt\""
Jul 23 20:02:36.532525 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.532492    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"openshift-service-ca.crt\""
Jul 23 20:02:36.532660 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.532525    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"sub-test-model-470e58-kserve-self-signed-certs\""
Jul 23 20:02:36.532660 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.532564    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"default-dockercfg-q6ctn\""
Jul 23 20:02:36.537959 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.537936    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"]
Jul 23 20:02:36.556195 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.556164    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:02:36.646348 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.646308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvt4w\" (UniqueName: \"kubernetes.io/projected/ee26e9d3-82c5-4afa-8919-604b10e63b54-kube-api-access-lvt4w\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.646583 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.646395    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee26e9d3-82c5-4afa-8919-604b10e63b54-tls-certs\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.646583 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.646528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-dshm\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.646583 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.646572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-tmp-dir\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.646751 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.646616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-model-cache\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.646751 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.646675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-home\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.747431 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.747349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-dshm\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.747620 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.747470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-tmp-dir\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.747620 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.747513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-model-cache\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.747620 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.747546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-home\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.747620 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.747598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvt4w\" (UniqueName: \"kubernetes.io/projected/ee26e9d3-82c5-4afa-8919-604b10e63b54-kube-api-access-lvt4w\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.747837 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.747662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee26e9d3-82c5-4afa-8919-604b10e63b54-tls-certs\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.748029 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.748008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-tmp-dir\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.748106 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.748004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-home\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.748172 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.748128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-model-cache\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.749779 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.749758    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-dshm\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.750138 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.750119    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee26e9d3-82c5-4afa-8919-604b10e63b54-tls-certs\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.756075 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.756052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvt4w\" (UniqueName: \"kubernetes.io/projected/ee26e9d3-82c5-4afa-8919-604b10e63b54-kube-api-access-lvt4w\") pod \"sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") " pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.839337 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.839235    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:36.996796 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:36.996764    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"]
Jul 23 20:02:37.132272 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:37.132177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2" event={"ID":"ee26e9d3-82c5-4afa-8919-604b10e63b54","Type":"ContainerStarted","Data":"96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304"}
Jul 23 20:02:37.132535 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:37.132490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2" event={"ID":"ee26e9d3-82c5-4afa-8919-604b10e63b54","Type":"ContainerStarted","Data":"0799d8081ddb9b8a35ac01f2373ab130f6c8302e1f9c6c0ec7a5531dd55f3a7a"}
Jul 23 20:02:37.152858 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:37.152805    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2" podStartSLOduration=1.152789254 podStartE2EDuration="1.152789254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:02:37.151944219 +0000 UTC m=+2535.086004368" watchObservedRunningTime="2026-07-23 20:02:37.152789254 +0000 UTC m=+2535.086849416"
Jul 23 20:02:46.839429 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:46.839382    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:46.839429 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:46.839440    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:46.852041 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:46.852013    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:02:47.191152 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:02:47.191062    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:03:09.923605 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:09.923566    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:03:10.733463 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:10.733430    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"]
Jul 23 20:03:11.333455 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:11.333418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:03:18.862770 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:18.862730    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:03:25.754246 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:25.754186    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2" podUID="ee26e9d3-82c5-4afa-8919-604b10e63b54" containerName="main" containerID="cri-o://96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304" gracePeriod=45
Jul 23 20:03:26.007170 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.007097    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:03:26.124557 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.124518    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-dshm\") pod \"ee26e9d3-82c5-4afa-8919-604b10e63b54\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") "
Jul 23 20:03:26.124754 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.124598    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-home\") pod \"ee26e9d3-82c5-4afa-8919-604b10e63b54\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") "
Jul 23 20:03:26.124754 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.124643    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-tmp-dir\") pod \"ee26e9d3-82c5-4afa-8919-604b10e63b54\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") "
Jul 23 20:03:26.124754 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.124671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee26e9d3-82c5-4afa-8919-604b10e63b54-tls-certs\") pod \"ee26e9d3-82c5-4afa-8919-604b10e63b54\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") "
Jul 23 20:03:26.124754 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.124731    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-model-cache\") pod \"ee26e9d3-82c5-4afa-8919-604b10e63b54\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") "
Jul 23 20:03:26.124984 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.124781    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvt4w\" (UniqueName: \"kubernetes.io/projected/ee26e9d3-82c5-4afa-8919-604b10e63b54-kube-api-access-lvt4w\") pod \"ee26e9d3-82c5-4afa-8919-604b10e63b54\" (UID: \"ee26e9d3-82c5-4afa-8919-604b10e63b54\") "
Jul 23 20:03:26.124984 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.124825    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-home" (OuterVolumeSpecName: "home") pod "ee26e9d3-82c5-4afa-8919-604b10e63b54" (UID: "ee26e9d3-82c5-4afa-8919-604b10e63b54"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:03:26.124984 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.124953    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee26e9d3-82c5-4afa-8919-604b10e63b54" (UID: "ee26e9d3-82c5-4afa-8919-604b10e63b54"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:03:26.125109 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.125034    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee26e9d3-82c5-4afa-8919-604b10e63b54" (UID: "ee26e9d3-82c5-4afa-8919-604b10e63b54"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:03:26.125165 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.125143    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-home\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:03:26.125227 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.125169    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-tmp-dir\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:03:26.125227 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.125184    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-model-cache\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:03:26.126895 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.126874    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-dshm" (OuterVolumeSpecName: "dshm") pod "ee26e9d3-82c5-4afa-8919-604b10e63b54" (UID: "ee26e9d3-82c5-4afa-8919-604b10e63b54"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:03:26.126895 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.126881    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee26e9d3-82c5-4afa-8919-604b10e63b54-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee26e9d3-82c5-4afa-8919-604b10e63b54" (UID: "ee26e9d3-82c5-4afa-8919-604b10e63b54"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 20:03:26.127028 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.126927    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee26e9d3-82c5-4afa-8919-604b10e63b54-kube-api-access-lvt4w" (OuterVolumeSpecName: "kube-api-access-lvt4w") pod "ee26e9d3-82c5-4afa-8919-604b10e63b54" (UID: "ee26e9d3-82c5-4afa-8919-604b10e63b54"). InnerVolumeSpecName "kube-api-access-lvt4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:03:26.226537 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.226492    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee26e9d3-82c5-4afa-8919-604b10e63b54-tls-certs\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:03:26.226537 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.226530    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvt4w\" (UniqueName: \"kubernetes.io/projected/ee26e9d3-82c5-4afa-8919-604b10e63b54-kube-api-access-lvt4w\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:03:26.226537 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.226543    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee26e9d3-82c5-4afa-8919-604b10e63b54-dshm\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:03:26.373687 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.373593    2561 generic.go:356] "Generic (PLEG): container finished" podID="ee26e9d3-82c5-4afa-8919-604b10e63b54" containerID="96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304" exitCode=0
Jul 23 20:03:26.373687 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.373646    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"
Jul 23 20:03:26.373925 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.373679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2" event={"ID":"ee26e9d3-82c5-4afa-8919-604b10e63b54","Type":"ContainerDied","Data":"96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304"}
Jul 23 20:03:26.373925 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.373724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2" event={"ID":"ee26e9d3-82c5-4afa-8919-604b10e63b54","Type":"ContainerDied","Data":"0799d8081ddb9b8a35ac01f2373ab130f6c8302e1f9c6c0ec7a5531dd55f3a7a"}
Jul 23 20:03:26.373925 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.373741    2561 scope.go:117] "RemoveContainer" containerID="96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304"
Jul 23 20:03:26.383385 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.383347    2561 scope.go:117] "RemoveContainer" containerID="96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304"
Jul 23 20:03:26.383677 ip-10-0-135-62 kubenswrapper[2561]: E0723 20:03:26.383655    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304\": container with ID starting with 96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304 not found: ID does not exist" containerID="96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304"
Jul 23 20:03:26.383734 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.383690    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304"} err="failed to get container status \"96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304\": rpc error: code = NotFound desc = could not find container \"96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304\": container with ID starting with 96d1c6d3f5c319840c6c03c0ecd855649cbb7ad0be4930ec18b207b224967304 not found: ID does not exist"
Jul 23 20:03:26.399027 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.399000    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"]
Jul 23 20:03:26.407495 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.407468    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/sub-test-model-470e58-kserve-7bd7f9ddcc-q9cw2"]
Jul 23 20:03:26.566731 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:26.566697    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee26e9d3-82c5-4afa-8919-604b10e63b54" path="/var/lib/kubelet/pods/ee26e9d3-82c5-4afa-8919-604b10e63b54/volumes"
Jul 23 20:03:44.385226 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:44.385130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:03:54.221754 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.221710    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"]
Jul 23 20:03:54.222288 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.222232    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee26e9d3-82c5-4afa-8919-604b10e63b54" containerName="main"
Jul 23 20:03:54.222288 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.222256    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee26e9d3-82c5-4afa-8919-604b10e63b54" containerName="main"
Jul 23 20:03:54.222439 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.222383    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee26e9d3-82c5-4afa-8919-604b10e63b54" containerName="main"
Jul 23 20:03:54.225786 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.225768    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.228300 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.228276    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"kube-root-ca.crt\""
Jul 23 20:03:54.228482 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.228463    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"default-dockercfg-q6ctn\""
Jul 23 20:03:54.229560 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.229541    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"openshift-service-ca.crt\""
Jul 23 20:03:54.229636 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.229550    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-470e58\"/\"rate-test-model-470e58-kserve-self-signed-certs\""
Jul 23 20:03:54.234287 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.234264    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"]
Jul 23 20:03:54.253816 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.253787    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:03:54.289476 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.289437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-tmp-dir\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.289648 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.289501    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7sbl\" (UniqueName: \"kubernetes.io/projected/2ff409b2-b21c-4b32-a693-c5b70919e96f-kube-api-access-r7sbl\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.289648 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.289595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-home\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.289648 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.289623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-model-cache\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.289648 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.289645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff409b2-b21c-4b32-a693-c5b70919e96f-tls-certs\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.289788 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.289717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-dshm\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390252 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7sbl\" (UniqueName: \"kubernetes.io/projected/2ff409b2-b21c-4b32-a693-c5b70919e96f-kube-api-access-r7sbl\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390479 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-home\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390479 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-model-cache\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390479 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff409b2-b21c-4b32-a693-c5b70919e96f-tls-certs\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390479 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-dshm\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390743 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-tmp-dir\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390816 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390790    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-model-cache\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390872 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-home\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.390872 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.390850    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-tmp-dir\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.392927 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.392905    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-dshm\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.393097 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.393077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff409b2-b21c-4b32-a693-c5b70919e96f-tls-certs\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.399046 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.399021    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7sbl\" (UniqueName: \"kubernetes.io/projected/2ff409b2-b21c-4b32-a693-c5b70919e96f-kube-api-access-r7sbl\") pod \"rate-test-model-470e58-kserve-547549c4bc-fxvqw\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") " pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.536733 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.536651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:03:54.671073 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:54.671046    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"]
Jul 23 20:03:54.673427 ip-10-0-135-62 kubenswrapper[2561]: W0723 20:03:54.673389    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ff409b2_b21c_4b32_a693_c5b70919e96f.slice/crio-a4722e7a99e90813294f22d53d8d52de836a2535416d05ac957426d881c9899a WatchSource:0}: Error finding container a4722e7a99e90813294f22d53d8d52de836a2535416d05ac957426d881c9899a: Status 404 returned error can't find the container with id a4722e7a99e90813294f22d53d8d52de836a2535416d05ac957426d881c9899a
Jul 23 20:03:55.524875 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:55.524838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw" event={"ID":"2ff409b2-b21c-4b32-a693-c5b70919e96f","Type":"ContainerStarted","Data":"836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712"}
Jul 23 20:03:55.525274 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:55.524889    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw" event={"ID":"2ff409b2-b21c-4b32-a693-c5b70919e96f","Type":"ContainerStarted","Data":"a4722e7a99e90813294f22d53d8d52de836a2535416d05ac957426d881c9899a"}
Jul 23 20:03:55.542273 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:03:55.542221    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw" podStartSLOduration=1.5422039220000001 podStartE2EDuration="1.542203922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:03:55.540874428 +0000 UTC m=+2613.474934577" watchObservedRunningTime="2026-07-23 20:03:55.542203922 +0000 UTC m=+2613.476264110"
Jul 23 20:04:04.537167 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:04.537128    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:04:04.537683 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:04.537176    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:04:04.549725 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:04.549697    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:04:04.589650 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:04.589619    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:04:36.961404 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:36.961371    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:04:37.792557 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:37.792520    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"]
Jul 23 20:04:37.817580 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:37.817548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:04:52.228528 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:52.228487    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:04:52.328915 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:52.328880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:04:52.813252 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:52.813211    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw" podUID="2ff409b2-b21c-4b32-a693-c5b70919e96f" containerName="main" containerID="cri-o://836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712" gracePeriod=45
Jul 23 20:04:53.065020 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.064961    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:04:53.133302 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133266    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff409b2-b21c-4b32-a693-c5b70919e96f-tls-certs\") pod \"2ff409b2-b21c-4b32-a693-c5b70919e96f\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") "
Jul 23 20:04:53.133553 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133314    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7sbl\" (UniqueName: \"kubernetes.io/projected/2ff409b2-b21c-4b32-a693-c5b70919e96f-kube-api-access-r7sbl\") pod \"2ff409b2-b21c-4b32-a693-c5b70919e96f\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") "
Jul 23 20:04:53.133553 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133342    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-home\") pod \"2ff409b2-b21c-4b32-a693-c5b70919e96f\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") "
Jul 23 20:04:53.133553 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133391    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-model-cache\") pod \"2ff409b2-b21c-4b32-a693-c5b70919e96f\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") "
Jul 23 20:04:53.133553 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133479    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-tmp-dir\") pod \"2ff409b2-b21c-4b32-a693-c5b70919e96f\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") "
Jul 23 20:04:53.133553 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133502    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-dshm\") pod \"2ff409b2-b21c-4b32-a693-c5b70919e96f\" (UID: \"2ff409b2-b21c-4b32-a693-c5b70919e96f\") "
Jul 23 20:04:53.133839 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133643    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-home" (OuterVolumeSpecName: "home") pod "2ff409b2-b21c-4b32-a693-c5b70919e96f" (UID: "2ff409b2-b21c-4b32-a693-c5b70919e96f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:04:53.133839 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133712    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-model-cache" (OuterVolumeSpecName: "model-cache") pod "2ff409b2-b21c-4b32-a693-c5b70919e96f" (UID: "2ff409b2-b21c-4b32-a693-c5b70919e96f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:04:53.133839 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133741    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2ff409b2-b21c-4b32-a693-c5b70919e96f" (UID: "2ff409b2-b21c-4b32-a693-c5b70919e96f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:04:53.133983 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133858    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-tmp-dir\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:04:53.133983 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133872    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-home\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:04:53.133983 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.133881    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-model-cache\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:04:53.135721 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.135688    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff409b2-b21c-4b32-a693-c5b70919e96f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ff409b2-b21c-4b32-a693-c5b70919e96f" (UID: "2ff409b2-b21c-4b32-a693-c5b70919e96f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 20:04:53.135833 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.135730    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-dshm" (OuterVolumeSpecName: "dshm") pod "2ff409b2-b21c-4b32-a693-c5b70919e96f" (UID: "2ff409b2-b21c-4b32-a693-c5b70919e96f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:04:53.135833 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.135744    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff409b2-b21c-4b32-a693-c5b70919e96f-kube-api-access-r7sbl" (OuterVolumeSpecName: "kube-api-access-r7sbl") pod "2ff409b2-b21c-4b32-a693-c5b70919e96f" (UID: "2ff409b2-b21c-4b32-a693-c5b70919e96f"). InnerVolumeSpecName "kube-api-access-r7sbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:04:53.234450 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.234404    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff409b2-b21c-4b32-a693-c5b70919e96f-dshm\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:04:53.234450 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.234440    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff409b2-b21c-4b32-a693-c5b70919e96f-tls-certs\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:04:53.234450 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.234451    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7sbl\" (UniqueName: \"kubernetes.io/projected/2ff409b2-b21c-4b32-a693-c5b70919e96f-kube-api-access-r7sbl\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:04:53.832731 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.832695    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ff409b2-b21c-4b32-a693-c5b70919e96f" containerID="836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712" exitCode=0
Jul 23 20:04:53.832932 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.832741    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"
Jul 23 20:04:53.832932 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.832790    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw" event={"ID":"2ff409b2-b21c-4b32-a693-c5b70919e96f","Type":"ContainerDied","Data":"836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712"}
Jul 23 20:04:53.832932 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.832833    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw" event={"ID":"2ff409b2-b21c-4b32-a693-c5b70919e96f","Type":"ContainerDied","Data":"a4722e7a99e90813294f22d53d8d52de836a2535416d05ac957426d881c9899a"}
Jul 23 20:04:53.832932 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.832854    2561 scope.go:117] "RemoveContainer" containerID="836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712"
Jul 23 20:04:53.842739 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.842718    2561 scope.go:117] "RemoveContainer" containerID="836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712"
Jul 23 20:04:53.843031 ip-10-0-135-62 kubenswrapper[2561]: E0723 20:04:53.843012    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712\": container with ID starting with 836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712 not found: ID does not exist" containerID="836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712"
Jul 23 20:04:53.843093 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.843040    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712"} err="failed to get container status \"836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712\": rpc error: code = NotFound desc = could not find container \"836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712\": container with ID starting with 836eaed09be706f8c86cf7f134ce16b941e06169c60470b44dd2f0cb8a261712 not found: ID does not exist"
Jul 23 20:04:53.854167 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.854125    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"]
Jul 23 20:04:53.862106 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:53.862080    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-470e58/rate-test-model-470e58-kserve-547549c4bc-fxvqw"]
Jul 23 20:04:54.114625 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.114545    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-139672225593792"]
Jul 23 20:04:54.114957 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.114944    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff409b2-b21c-4b32-a693-c5b70919e96f" containerName="main"
Jul 23 20:04:54.115006 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.114958    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff409b2-b21c-4b32-a693-c5b70919e96f" containerName="main"
Jul 23 20:04:54.115041 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.115020    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff409b2-b21c-4b32-a693-c5b70919e96f" containerName="main"
Jul 23 20:04:54.118015 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.117997    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-139672225593792"
Jul 23 20:04:54.120459 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.120437    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7hsc4\""
Jul 23 20:04:54.124468 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.124440    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-139672225593792"]
Jul 23 20:04:54.141318 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.141278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkdd9\" (UniqueName: \"kubernetes.io/projected/86bc94b5-f79a-4b8d-aa4f-d7c31c32d586-kube-api-access-wkdd9\") pod \"test-curl-7456-139672225593792\" (UID: \"86bc94b5-f79a-4b8d-aa4f-d7c31c32d586\") " pod="opendatahub/test-curl-7456-139672225593792"
Jul 23 20:04:54.241924 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.241880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkdd9\" (UniqueName: \"kubernetes.io/projected/86bc94b5-f79a-4b8d-aa4f-d7c31c32d586-kube-api-access-wkdd9\") pod \"test-curl-7456-139672225593792\" (UID: \"86bc94b5-f79a-4b8d-aa4f-d7c31c32d586\") " pod="opendatahub/test-curl-7456-139672225593792"
Jul 23 20:04:54.249983 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.249956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkdd9\" (UniqueName: \"kubernetes.io/projected/86bc94b5-f79a-4b8d-aa4f-d7c31c32d586-kube-api-access-wkdd9\") pod \"test-curl-7456-139672225593792\" (UID: \"86bc94b5-f79a-4b8d-aa4f-d7c31c32d586\") " pod="opendatahub/test-curl-7456-139672225593792"
Jul 23 20:04:54.430638 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.430542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-139672225593792"
Jul 23 20:04:54.565820 ip-10-0-135-62 kubenswrapper[2561]: W0723 20:04:54.565784    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86bc94b5_f79a_4b8d_aa4f_d7c31c32d586.slice/crio-985042db6842e17b1ab296db86d628e44bb31bd23efacf5dee6758227603a1dc WatchSource:0}: Error finding container 985042db6842e17b1ab296db86d628e44bb31bd23efacf5dee6758227603a1dc: Status 404 returned error can't find the container with id 985042db6842e17b1ab296db86d628e44bb31bd23efacf5dee6758227603a1dc
Jul 23 20:04:54.567187 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.567169    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 20:04:54.567839 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.567816    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff409b2-b21c-4b32-a693-c5b70919e96f" path="/var/lib/kubelet/pods/2ff409b2-b21c-4b32-a693-c5b70919e96f/volumes"
Jul 23 20:04:54.568198 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.568180    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-139672225593792"]
Jul 23 20:04:54.841021 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:54.840987    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-139672225593792" event={"ID":"86bc94b5-f79a-4b8d-aa4f-d7c31c32d586","Type":"ContainerStarted","Data":"985042db6842e17b1ab296db86d628e44bb31bd23efacf5dee6758227603a1dc"}
Jul 23 20:04:55.847758 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:55.847723    2561 generic.go:356] "Generic (PLEG): container finished" podID="86bc94b5-f79a-4b8d-aa4f-d7c31c32d586" containerID="724bf1fd11d4567fe4e4cc1fbb997b6595cbded65328978429430de6fe0b7b9f" exitCode=0
Jul 23 20:04:55.848172 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:55.847807    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-139672225593792" event={"ID":"86bc94b5-f79a-4b8d-aa4f-d7c31c32d586","Type":"ContainerDied","Data":"724bf1fd11d4567fe4e4cc1fbb997b6595cbded65328978429430de6fe0b7b9f"}
Jul 23 20:04:56.984385 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:56.984338    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-139672225593792"
Jul 23 20:04:57.003192 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:57.003136    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7456-139672225593792_86bc94b5-f79a-4b8d-aa4f-d7c31c32d586/test-curl-7456-139672225593792/0.log"
Jul 23 20:04:57.024913 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:57.024876    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-139672225593792"]
Jul 23 20:04:57.030977 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:57.030947    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-139672225593792"]
Jul 23 20:04:57.069429 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:57.069324    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkdd9\" (UniqueName: \"kubernetes.io/projected/86bc94b5-f79a-4b8d-aa4f-d7c31c32d586-kube-api-access-wkdd9\") pod \"86bc94b5-f79a-4b8d-aa4f-d7c31c32d586\" (UID: \"86bc94b5-f79a-4b8d-aa4f-d7c31c32d586\") "
Jul 23 20:04:57.071646 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:57.071620    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86bc94b5-f79a-4b8d-aa4f-d7c31c32d586-kube-api-access-wkdd9" (OuterVolumeSpecName: "kube-api-access-wkdd9") pod "86bc94b5-f79a-4b8d-aa4f-d7c31c32d586" (UID: "86bc94b5-f79a-4b8d-aa4f-d7c31c32d586"). InnerVolumeSpecName "kube-api-access-wkdd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:04:57.170684 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:57.170597    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkdd9\" (UniqueName: \"kubernetes.io/projected/86bc94b5-f79a-4b8d-aa4f-d7c31c32d586-kube-api-access-wkdd9\") on node \"ip-10-0-135-62.ec2.internal\" DevicePath \"\""
Jul 23 20:04:57.858860 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:57.858823    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-139672225593792"
Jul 23 20:04:57.858860 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:57.858858    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="985042db6842e17b1ab296db86d628e44bb31bd23efacf5dee6758227603a1dc"
Jul 23 20:04:57.868330 ip-10-0-135-62 kubenswrapper[2561]: E0723 20:04:57.868303    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-139672225593792\" is forbidden: User \"system:node:ip-10-0-135-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-62.ec2.internal' and this object" podUID="86bc94b5-f79a-4b8d-aa4f-d7c31c32d586" pod="opendatahub/test-curl-7456-139672225593792"
Jul 23 20:04:58.566335 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:04:58.566299    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86bc94b5-f79a-4b8d-aa4f-d7c31c32d586" path="/var/lib/kubelet/pods/86bc94b5-f79a-4b8d-aa4f-d7c31c32d586/volumes"
Jul 23 20:05:00.154597 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:00.154557    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:00.252838 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:00.252803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:07.895509 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:07.895474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:08.178276 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:08.178182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:08.277105 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:08.277069    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:09.498811 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:09.498780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:09.596040 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:09.596001    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:12.304837 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:12.304801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:12.694365 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:12.694233    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:18.520609 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:18.520569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:18.581642 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:18.581603    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:18.769991 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:18.769957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:18.995049 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:18.995022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:19.865044 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:19.865008    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:19.965595 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:19.965558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:22.680855 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:22.680829    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 20:05:22.691817 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:22.691795    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbv2r_ac059306-3195-4a9c-ae47-6a492fd56822/ovn-acl-logging/0.log"
Jul 23 20:05:29.696201 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:29.696165    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:30.447670 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:30.447632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:30.500444 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:30.500410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:34.234615 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:34.234562    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:34.678566 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:34.678477    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:40.354320 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:40.354283    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:40.454275 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:40.454247    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:40.618875 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:40.618771    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:40.831683 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:40.831645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:41.274860 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:41.274818    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57d56f486d-4q768_54f4be6f-e28a-4ffd-8452-29445e98e4d0/authorino/0.log"
Jul 23 20:05:47.269137 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:47.269102    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f567dc-lsh25_6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32/manager/0.log"
Jul 23 20:05:47.275263 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:47.275243    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f567dc-lsh25_6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32/copy-manifests/0.log"
Jul 23 20:05:48.062786 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:48.062756    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-k2xch_ca93b0cb-4033-4631-8358-f5d1287e616a/postgres/0.log"
Jul 23 20:05:49.388618 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:49.388584    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57d56f486d-4q768_54f4be6f-e28a-4ffd-8452-29445e98e4d0/authorino/0.log"
Jul 23 20:05:49.501402 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:49.501363    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lpxm7_2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1/manager/0.log"
Jul 23 20:05:50.770409 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:50.770378    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fdd4658f-756bf_e6eeb4b7-ec9e-4458-80d2-83824925abd2/kube-auth-proxy/0.log"
Jul 23 20:05:51.123005 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:51.122879    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qlhr9_0a96776d-69c1-4463-ae69-9dbb875e6ba9/payload-pre-processing/0.log"
Jul 23 20:05:51.918770 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:51.918738    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-n88sf_c540a67a-8099-4959-b717-8261bbf41076/main/0.log"
Jul 23 20:05:52.244479 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:52.244449    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-95kw5_62d54e78-1cea-4c30-b33a-ffcdfa0826af/main/0.log"
Jul 23 20:05:58.438211 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:58.438162    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:05:58.604917 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:05:58.604881    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log" limit=1024
Jul 23 20:06:01.124318 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:01.124286    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5w2l7_25ec972a-8ec2-4b87-bd61-db6172fa0330/global-pull-secret-syncer/0.log"
Jul 23 20:06:01.277394 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:01.277346    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2w7ch_8053b455-d0e6-4260-9c77-b681a37e4034/konnectivity-agent/0.log"
Jul 23 20:06:01.407493 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:01.407390    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-62.ec2.internal_d1bfa0f96230760ac8ad794fbe17eeef/haproxy/0.log"
Jul 23 20:06:06.926829 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:06.926784    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57d56f486d-4q768_54f4be6f-e28a-4ffd-8452-29445e98e4d0/authorino/0.log"
Jul 23 20:06:06.964907 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:06.964873    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lpxm7_2cdbbc71-1f3e-4b72-81b7-130bcdcbf7a1/manager/0.log"
Jul 23 20:06:09.316410 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.316380    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cc33efe-5aa8-478d-88d0-0d104492b3b6/alertmanager/0.log"
Jul 23 20:06:09.337975 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.337941    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cc33efe-5aa8-478d-88d0-0d104492b3b6/config-reloader/0.log"
Jul 23 20:06:09.357137 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.357106    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cc33efe-5aa8-478d-88d0-0d104492b3b6/kube-rbac-proxy-web/0.log"
Jul 23 20:06:09.377054 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.377025    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cc33efe-5aa8-478d-88d0-0d104492b3b6/kube-rbac-proxy/0.log"
Jul 23 20:06:09.397754 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.397723    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cc33efe-5aa8-478d-88d0-0d104492b3b6/kube-rbac-proxy-metric/0.log"
Jul 23 20:06:09.416899 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.416873    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cc33efe-5aa8-478d-88d0-0d104492b3b6/prom-label-proxy/0.log"
Jul 23 20:06:09.438940 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.438911    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cc33efe-5aa8-478d-88d0-0d104492b3b6/init-config-reloader/0.log"
Jul 23 20:06:09.519235 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.519146    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2k8kl_0b086f44-dd8c-42ab-9802-a616b6927a43/kube-state-metrics/0.log"
Jul 23 20:06:09.535688 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.535657    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2k8kl_0b086f44-dd8c-42ab-9802-a616b6927a43/kube-rbac-proxy-main/0.log"
Jul 23 20:06:09.566790 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.566752    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2k8kl_0b086f44-dd8c-42ab-9802-a616b6927a43/kube-rbac-proxy-self/0.log"
Jul 23 20:06:09.590333 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.590301    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-bb5bdbbb6-kkl7j_07ee3198-5b92-4119-a20d-9830bb8a4205/metrics-server/0.log"
Jul 23 20:06:09.613913 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.613876    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-7trb4_e428dc45-8f63-409e-bf40-595f6d9868df/monitoring-plugin/0.log"
Jul 23 20:06:09.653234 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.653204    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nvf_017e3b4d-82e2-4db9-9095-f212a69cf50c/node-exporter/0.log"
Jul 23 20:06:09.676220 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.676192    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nvf_017e3b4d-82e2-4db9-9095-f212a69cf50c/kube-rbac-proxy/0.log"
Jul 23 20:06:09.695254 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.695228    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nvf_017e3b4d-82e2-4db9-9095-f212a69cf50c/init-textfile/0.log"
Jul 23 20:06:09.873267 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.873158    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4p8wc_2612821d-a8f2-4303-9dd7-ac3855eefe54/kube-rbac-proxy-main/0.log"
Jul 23 20:06:09.894039 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.894005    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4p8wc_2612821d-a8f2-4303-9dd7-ac3855eefe54/kube-rbac-proxy-self/0.log"
Jul 23 20:06:09.914371 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.914322    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4p8wc_2612821d-a8f2-4303-9dd7-ac3855eefe54/openshift-state-metrics/0.log"
Jul 23 20:06:09.950802 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.950777    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc8ac976-9c87-484f-986c-ad8dafa1ea9b/prometheus/0.log"
Jul 23 20:06:09.970538 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.970510    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc8ac976-9c87-484f-986c-ad8dafa1ea9b/config-reloader/0.log"
Jul 23 20:06:09.995535 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:09.995491    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc8ac976-9c87-484f-986c-ad8dafa1ea9b/thanos-sidecar/0.log"
Jul 23 20:06:10.015494 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.015466    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc8ac976-9c87-484f-986c-ad8dafa1ea9b/kube-rbac-proxy-web/0.log"
Jul 23 20:06:10.036111 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.036083    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc8ac976-9c87-484f-986c-ad8dafa1ea9b/kube-rbac-proxy/0.log"
Jul 23 20:06:10.059790 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.059764    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc8ac976-9c87-484f-986c-ad8dafa1ea9b/kube-rbac-proxy-thanos/0.log"
Jul 23 20:06:10.080528 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.080501    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc8ac976-9c87-484f-986c-ad8dafa1ea9b/init-config-reloader/0.log"
Jul 23 20:06:10.112463 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.112426    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-bjbhq_1ca948e0-e798-4183-9797-cc8facd75bb1/prometheus-operator/0.log"
Jul 23 20:06:10.129020 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.128927    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-bjbhq_1ca948e0-e798-4183-9797-cc8facd75bb1/kube-rbac-proxy/0.log"
Jul 23 20:06:10.151569 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.151535    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-lgm62_8b1a7828-d189-4eb4-b370-3b6671cdbb71/prometheus-operator-admission-webhook/0.log"
Jul 23 20:06:10.266544 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.266512    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbcb98bb6-wxfsc_4bd4679d-93ce-4dcf-99a5-914213acf20c/thanos-query/0.log"
Jul 23 20:06:10.285752 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.285725    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbcb98bb6-wxfsc_4bd4679d-93ce-4dcf-99a5-914213acf20c/kube-rbac-proxy-web/0.log"
Jul 23 20:06:10.306079 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.306046    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbcb98bb6-wxfsc_4bd4679d-93ce-4dcf-99a5-914213acf20c/kube-rbac-proxy/0.log"
Jul 23 20:06:10.339490 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.339461    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbcb98bb6-wxfsc_4bd4679d-93ce-4dcf-99a5-914213acf20c/prom-label-proxy/0.log"
Jul 23 20:06:10.359381 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.359340    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbcb98bb6-wxfsc_4bd4679d-93ce-4dcf-99a5-914213acf20c/kube-rbac-proxy-rules/0.log"
Jul 23 20:06:10.381182 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.381101    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fbcb98bb6-wxfsc_4bd4679d-93ce-4dcf-99a5-914213acf20c/kube-rbac-proxy-metrics/0.log"
Jul 23 20:06:10.909314 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.909283    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"]
Jul 23 20:06:10.909677 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.909664    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86bc94b5-f79a-4b8d-aa4f-d7c31c32d586" containerName="test-curl-7456-139672225593792"
Jul 23 20:06:10.909717 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.909678    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="86bc94b5-f79a-4b8d-aa4f-d7c31c32d586" containerName="test-curl-7456-139672225593792"
Jul 23 20:06:10.909763 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.909753    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="86bc94b5-f79a-4b8d-aa4f-d7c31c32d586" containerName="test-curl-7456-139672225593792"
Jul 23 20:06:10.912191 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.912175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:10.915921 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.915902    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjlxs\"/\"kube-root-ca.crt\""
Jul 23 20:06:10.916908 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.916888    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjlxs\"/\"openshift-service-ca.crt\""
Jul 23 20:06:10.917016 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.916893    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjlxs\"/\"default-dockercfg-sm7kz\""
Jul 23 20:06:10.935657 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:10.935626    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"]
Jul 23 20:06:11.080719 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.080678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c75w\" (UniqueName: \"kubernetes.io/projected/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-kube-api-access-5c75w\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.080908 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.080744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-sys\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.080908 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.080845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-podres\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.081057 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.080919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-proc\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.081057 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.080978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-lib-modules\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182045 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.181944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-sys\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182045 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.181999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-podres\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182045 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.182035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-proc\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182289 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.182067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-lib-modules\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182289 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.182068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-sys\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182289 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.182150    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-proc\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182289 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.182161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-podres\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182289 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.182112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c75w\" (UniqueName: \"kubernetes.io/projected/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-kube-api-access-5c75w\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.182289 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.182207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-lib-modules\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.191614 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.191589    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c75w\" (UniqueName: \"kubernetes.io/projected/9df8209e-0efc-4c0b-a405-56e1e17fd5b8-kube-api-access-5c75w\") pod \"perf-node-gather-daemonset-ltz46\" (UID: \"9df8209e-0efc-4c0b-a405-56e1e17fd5b8\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.222205 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.222167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:11.364079 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:11.364053    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"]
Jul 23 20:06:11.366276 ip-10-0-135-62 kubenswrapper[2561]: W0723 20:06:11.366245    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9df8209e_0efc_4c0b_a405_56e1e17fd5b8.slice/crio-442be1a9027f808f6957a794b3f434bffffd50b1e70bd048daf1ff8bb7596f8c WatchSource:0}: Error finding container 442be1a9027f808f6957a794b3f434bffffd50b1e70bd048daf1ff8bb7596f8c: Status 404 returned error can't find the container with id 442be1a9027f808f6957a794b3f434bffffd50b1e70bd048daf1ff8bb7596f8c
Jul 23 20:06:12.224566 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:12.224528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46" event={"ID":"9df8209e-0efc-4c0b-a405-56e1e17fd5b8","Type":"ContainerStarted","Data":"093836bd143f04e47e73879e8f7efc351416b14c498e0082a70b36b458c1e0f1"}
Jul 23 20:06:12.224755 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:12.224578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46" event={"ID":"9df8209e-0efc-4c0b-a405-56e1e17fd5b8","Type":"ContainerStarted","Data":"442be1a9027f808f6957a794b3f434bffffd50b1e70bd048daf1ff8bb7596f8c"}
Jul 23 20:06:12.224755 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:12.224617    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:12.244580 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:12.244526    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46" podStartSLOduration=2.244507582 podStartE2EDuration="2.244507582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:06:12.242831794 +0000 UTC m=+2750.176891945" watchObservedRunningTime="2026-07-23 20:06:12.244507582 +0000 UTC m=+2750.178567779"
Jul 23 20:06:12.682198 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:12.682104    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6559cbb8d4-crztw_5aff214d-2513-4f10-835d-ed26391f7144/console/0.log"
Jul 23 20:06:14.339376 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:14.339314    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r8x62_20a09c36-1cb6-4144-a627-f0233c2cb178/dns/0.log"
Jul 23 20:06:14.374831 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:14.374797    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r8x62_20a09c36-1cb6-4144-a627-f0233c2cb178/kube-rbac-proxy/0.log"
Jul 23 20:06:14.629387 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:14.629286    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v79w9_fc796ffa-5d96-4991-9556-aa95883b8805/dns-node-resolver/0.log"
Jul 23 20:06:15.217954 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:15.217919    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ktw85_62347d60-d327-45d6-bfbb-601c7cfbd421/node-ca/0.log"
Jul 23 20:06:16.541175 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:16.541142    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fdd4658f-756bf_e6eeb4b7-ec9e-4458-80d2-83824925abd2/kube-auth-proxy/0.log"
Jul 23 20:06:16.700151 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:16.700109    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qlhr9_0a96776d-69c1-4463-ae69-9dbb875e6ba9/payload-pre-processing/0.log"
Jul 23 20:06:17.563035 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:17.563007    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f8dlm_c2296a13-9ecc-427d-b868-d885b41a86d6/serve-healthcheck-canary/0.log"
Jul 23 20:06:18.180644 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:18.180606    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmd89_927e4654-6ce8-458f-954d-fc476a7c733f/kube-rbac-proxy/0.log"
Jul 23 20:06:18.201140 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:18.201117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmd89_927e4654-6ce8-458f-954d-fc476a7c733f/exporter/0.log"
Jul 23 20:06:18.221568 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:18.221533    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmd89_927e4654-6ce8-458f-954d-fc476a7c733f/extractor/0.log"
Jul 23 20:06:18.240420 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:18.240390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-ltz46"
Jul 23 20:06:21.443925 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:21.443891    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f567dc-lsh25_6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32/manager/0.log"
Jul 23 20:06:21.463903 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:21.463875    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f567dc-lsh25_6a2fe33f-544e-4d00-a99f-c5e9b6a7ac32/copy-manifests/0.log"
Jul 23 20:06:21.695280 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:21.695198    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fdd4658f-756bf_e6eeb4b7-ec9e-4458-80d2-83824925abd2/kube-auth-proxy/0.log"
Jul 23 20:06:21.824436 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:21.824399    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qlhr9_0a96776d-69c1-4463-ae69-9dbb875e6ba9/payload-pre-processing/0.log"
Jul 23 20:06:22.781187 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:22.781152    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84c9b5-2pjz7_3d2efd96-5d61-4b70-977b-31bd2e000923/manager/0.log"
Jul 23 20:06:22.843323 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:22.843277    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-94qlk_ca60345b-04f9-4198-b5a2-ecc3875cdd6e/openshift-lws-operator/0.log"
Jul 23 20:06:23.297561 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:23.297534    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fdd4658f-756bf_e6eeb4b7-ec9e-4458-80d2-83824925abd2/kube-auth-proxy/0.log"
Jul 23 20:06:23.425782 ip-10-0-135-62 kubenswrapper[2561]: I0723 20:06:23.425753    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qlhr9_0a96776d-69c1-4463-ae69-9dbb875e6ba9/payload-pre-processing/0.log"