Jul 10 02:46:38.522171 ip-10-0-134-61 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 02:46:38.522185 ip-10-0-134-61 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 02:46:38.522194 ip-10-0-134-61 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 02:46:38.522622 ip-10-0-134-61 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 02:46:48.745743 ip-10-0-134-61 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 02:46:48.745761 ip-10-0-134-61 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 90945296abe2492eb5b639097f41916c --
Jul 10 02:48:45.462857 ip-10-0-134-61 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 02:48:45.820158 ip-10-0-134-61 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:48:45.820158 ip-10-0-134-61 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 02:48:45.820158 ip-10-0-134-61 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:48:45.820158 ip-10-0-134-61 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 02:48:45.820158 ip-10-0-134-61 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:48:45.820921 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.820838    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 02:48:45.826736 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826720    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:48:45.826736 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826736    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826740    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826744    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826747    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826749    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826753    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826756    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826758    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826761    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826764    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826772    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826775    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826778    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826780    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826783    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826786    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826788    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826791    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826793    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826796    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:48:45.826804 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826798    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826801    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826803    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826806    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826808    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826811    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826814    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826817    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826819    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826822    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826824    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826826    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826829    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826831    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826834    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826836    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826841    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826844    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826847    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826850    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:48:45.827279 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826852    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826855    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826858    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826861    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826864    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826866    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826869    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826872    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826874    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826877    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826880    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826882    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826885    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826888    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826892    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826895    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826897    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826900    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826903    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:48:45.827792 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826905    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826907    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826912    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826915    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826918    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826921    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826924    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826926    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826929    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826931    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826934    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826937    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826939    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826942    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826945    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826947    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826950    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826952    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826955    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826957    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:48:45.828267 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826960    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826962    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826965    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826967    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826970    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826972    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826977    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826981    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826983    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826986    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826988    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826991    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826993    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826996    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.826998    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827000    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827003    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827006    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827008    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:48:45.828908 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827719    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827726    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827729    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827732    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827735    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827738    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827741    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827745    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827749    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827752    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827754    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827757    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827760    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827763    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827765    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827768    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827772    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827775    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:48:45.829399 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827779    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827782    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827785    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827788    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827791    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827794    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827797    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827800    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827803    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827806    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827809    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827812    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827815    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827817    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827820    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827823    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827826    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827828    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827831    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827834    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:48:45.829866 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827836    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827839    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827841    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827844    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827847    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827849    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827852    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827854    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827857    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827859    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827861    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827864    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827867    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827870    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827873    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827875    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827878    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827881    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827884    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827886    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:48:45.830370 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827889    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827891    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827894    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827897    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827899    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827902    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827904    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827907    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827910    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827912    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827914    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827917    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827919    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827923    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827926    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827930    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827933    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827936    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827938    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:48:45.830855 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827946    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827948    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827951    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827953    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827956    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827958    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827961    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827964    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827966    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827969    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827972    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827974    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827977    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827979    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827982    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827984    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827986    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827989    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827991    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827994    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:48:45.831316 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827997    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.827999    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828364    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828371    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828375    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828379    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828382    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828385    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828388    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828391    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828394    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828397    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828401    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828406    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828410    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828413    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828416    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828419    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:48:45.831817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828422    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828424    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828427    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828430    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828433    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828436    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828438    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828441    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828443    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828446    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828448    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828450    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828453    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828455    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828458    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828461    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828463    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828466    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828469    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828471    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:48:45.832253 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828474    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828476    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828481    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828484    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828487    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828489    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828491    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828495    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828506    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828509    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828511    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828514    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828518    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828520    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828523    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828525    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828528    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828530    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828532    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828535    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:48:45.832756 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828537    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828540    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828542    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828545    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828561    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828563    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828566    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828570    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828573    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828576    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828578    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828581    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828583    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828586    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828589    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828592    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828594    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828597    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828599    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828602    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:48:45.833264 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828615    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828618    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828620    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828622    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828625    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828627    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828630    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828632    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828634    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828637    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828639    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828642    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828644    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828647    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828649    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828651    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828654    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828657    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828659    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828663    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:48:45.833786 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828665    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828668    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.828670    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828733    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828740    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828746    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828752    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828756    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828759    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828765    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828771    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828777    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828781    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828787    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828794    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828799    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828802    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828805    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828808    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828811    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828813    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828817    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828820    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828823    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 02:48:45.834268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828826    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828829    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828833    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828836    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828839    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828842    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828845    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828849    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828852    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828855    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828858    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828862    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828865    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828868    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828872    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828875    2578 flags.go:64] FLAG: --enable-server="true"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828878    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828883    2578 flags.go:64] FLAG: --event-burst="100"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828885    2578 flags.go:64] FLAG: --event-qps="50"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828888    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828891    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828894    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828898    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828901    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828904    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 02:48:45.834863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828907    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828910    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828913    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828916    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828919    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828921    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828924    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828927    2578 flags.go:64] FLAG: --feature-gates=""
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828931    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828933    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828936    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828939    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828942    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828945    2578 flags.go:64] FLAG: --help="false"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828948    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-134-61.ec2.internal"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828951    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828954    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828957    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828960    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828963    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828966    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828969    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828972    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 02:48:45.835458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828975    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828977    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828980    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828983    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828986    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828988    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828991    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828994    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.828997    2578 flags.go:64] FLAG: --lock-file=""
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829000    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829002    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829005    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829010    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829013    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829016    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829018    2578 flags.go:64] FLAG: --logging-format="text"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829021    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829024    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829026    2578 flags.go:64] FLAG: --manifest-url=""
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829029    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829036    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829040    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829044    2578 flags.go:64] FLAG: --max-pods="110"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829047    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829049    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 02:48:45.836100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829052    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829055    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829058    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829060    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829063    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829070    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829073    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829076    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829079    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829082    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829087    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829090    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829093    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829096    2578 flags.go:64] FLAG: --port="10250"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829099    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829102    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b857c3b757c07821"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829105    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829108    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829110    2578 flags.go:64] FLAG: --register-node="true"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829113    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829117    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829119    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829122    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829125    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829128    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 02:48:45.836720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829131    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829134    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829137    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829139    2578 flags.go:64] FLAG: --runonce="false"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829142    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829145    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829148    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829151    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829153    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829156    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829159    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829162    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829165    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829167    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829170    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829173    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829176    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829179    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829181    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829186    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829189    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829191    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829195    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829198    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829201    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 02:48:45.837331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829204    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829206    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829209    2578 flags.go:64] FLAG: --v="2"
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829213    2578 flags.go:64] FLAG: --version="false"
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829217    2578 flags.go:64] FLAG: --vmodule=""
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829220    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.829223    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829337    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829341    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829344    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829347    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829350    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829352    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829355    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829357    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829360    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829362    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829364    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829367    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829369    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829372    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:48:45.838025 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829375    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829377    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829380    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829382    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829384    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829387    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829391    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829395    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829398    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829401    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829409    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829412    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829414    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829416    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829419    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829422    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829424    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829427    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829429    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:48:45.838530 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829431    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829434    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829438    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829441    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829444    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829446    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829449    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829451    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829454    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829456    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829460    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829463    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829465    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829468    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829470    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829473    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829475    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829478    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829480    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:48:45.839013 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829483    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829487    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829489    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829492    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829495    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829502    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829505    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829507    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829510    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829513    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829515    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829517    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829520    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829522    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829525    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829527    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829530    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829532    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829534    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829538    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:48:45.839511 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829541    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829544    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829563    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829567    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829569    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829572    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829575    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829577    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829579    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829582    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829585    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829587    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829589    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829593    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829595    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829598    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829600    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829603    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829614    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829617    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:48:45.840011 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829619    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829621    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829624    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829626    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829629    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829632    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.829634    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.830262    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.837004    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.837019    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.837032    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.837039    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837091    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837095    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837099    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:48:45.840505 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837101    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837104    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837107    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837110    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837112    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837115    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837118    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837120    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837124    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837127    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837131    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837134    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837136    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837139    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837142    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837145    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837147    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837150    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837152    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837155    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:48:45.840926 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837158    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837160    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837163    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837165    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837168    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837170    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837175    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837178    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837180    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837183    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837185    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837188    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837190    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837193    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837195    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837199    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837203    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837205    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837208    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:48:45.841409 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837210    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837213    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837216    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837218    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837221    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837224    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837226    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837229    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837231    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837234    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837237    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837239    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837242    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837244    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837247    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837249    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837252    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837254    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837256    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:48:45.841896 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837260    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837263    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837266    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837268    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837271    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837273    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837276    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837278    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837281    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837283    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837286    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837288    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837290    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837293    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837295    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837299    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837303    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837306    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837308    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:48:45.842363 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837311    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837314    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837316    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837319    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837321    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837324    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837326    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837329    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837331    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837333    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837336    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837339    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837341    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837345    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837347    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837350    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837353    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837356    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:48:45.842847 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837358    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.837363    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837490    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837496    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837499    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837502    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837505    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837507    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837510    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837512    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837514    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837517    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837520    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837524    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:48:45.843293 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837528    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837530    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837533    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837536    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837538    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837541    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837544    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837560    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837563    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837565    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837568    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837571    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837573    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837576    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837579    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837582    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837585    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837588    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837590    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837593    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:48:45.843647 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837595    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837598    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837601    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837603    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837605    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837608    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837610    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837613    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837616    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837620    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837623    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837625    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837628    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837631    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837634    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837636    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837639    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837641    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837644    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837647    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:48:45.844130 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837649    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837651    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837654    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837657    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837660    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837663    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837666    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837668    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837670    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837673    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837676    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837678    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837680    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837683    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837685    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837688    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837690    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837693    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837696    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837698    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:48:45.844655 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837700    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837703    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837705    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837708    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837710    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837713    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837715    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837717    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837721    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837724    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837727    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837730    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837732    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837735    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837737    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837739    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837742    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837744    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837747    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:48:45.845137 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837749    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837752    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837754    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837757    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837759    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837762    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837764    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:45.837766    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.837771    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.837882    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.840154    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.841586    2578 server.go:1019] "Starting client certificate rotation"
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.841691    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 02:48:45.845652 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.841749    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 02:48:45.846714 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.846681    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 02:48:45.850591 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.850572    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 02:48:45.859479 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.859463    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 10 02:48:45.861885 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.861871    2578 log.go:25] "Validated CRI v1 image API"
Jul 10 02:48:45.864568 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.864533    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 02:48:45.867393 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.867375    2578 fs.go:135] Filesystem UUIDs: map[3acca46a-a2ba-4e42-b999-9a7ddd77fe83:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f35ddd39-f86b-4e3f-b25d-eb46d4a316d0:/dev/nvme0n1p4]
Jul 10 02:48:45.867453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.867393    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 02:48:45.872479 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.872372    2578 manager.go:216] Machine: {Timestamp:2026-07-10 02:48:45.870960875 +0000 UTC m=+0.298293284 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3146258 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f4d8da7d4abb7fb6fcc7fb26825e SystemUUID:ec26f4d8-da7d-4abb-7fb6-fcc7fb26825e BootID:90945296-abe2-492e-b5b6-39097f41916c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:98:0f:ac:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:98:0f:ac:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:69:ac:43:f8:61 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 02:48:45.872479 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.872474    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 02:48:45.872608 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.872568    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 02:48:45.874273 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.874259    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 02:48:45.875370 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.875345    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 02:48:45.875500 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.875375    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 02:48:45.876230 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.876219    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 02:48:45.876230 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.876231    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 02:48:45.876303 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.876238    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 02:48:45.876929 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.876919    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 02:48:45.878048 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.878039    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 02:48:45.881298 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881286    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 02:48:45.881392 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881383    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 02:48:45.881423 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881416    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 02:48:45.881449 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881429    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 02:48:45.881449 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881438    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 02:48:45.881449 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881448    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 10 02:48:45.881578 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881456    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 02:48:45.881841 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881826    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 02:48:45.881903 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.881853    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 02:48:45.883822 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.883805    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 02:48:45.885360 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.885347    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 02:48:45.885422 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.885377    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 02:48:45.886013 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886002    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 02:48:45.886046 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886019    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 02:48:45.886046 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886025    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 02:48:45.886046 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886031    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 02:48:45.886046 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886039    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 02:48:45.886046 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886044    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 02:48:45.886181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886062    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 02:48:45.886181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886067    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 02:48:45.886181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886073    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 02:48:45.886181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886078    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 02:48:45.886181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886086    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 02:48:45.886181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886095    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 02:48:45.886813 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886803    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 02:48:45.886813 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.886812    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 02:48:45.889965 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.889940    2578 server.go:1268] "Started kubelet"
Jul 10 02:48:45.890466 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.890340    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 02:48:45.890685 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.890624    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 02:48:45.890743 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.890698    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 02:48:45.890829 ip-10-0-134-61 systemd[1]: Started Kubernetes Kubelet.
Jul 10 02:48:45.891813 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.891644    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 02:48:45.892222 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.892204    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 02:48:45.892349 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.892332    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fx7pz"
Jul 10 02:48:45.892597 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.892515    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 02:48:45.892597 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.892519    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 02:48:45.893340 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.893320    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 02:48:45.897567 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.897524    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 02:48:45.898273 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.898254    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 02:48:45.898366 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.898275    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 02:48:45.898366 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.898352    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:45.898957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.898895    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 02:48:45.899033 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.898965    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 02:48:45.899033 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.898996    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 02:48:45.899033 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899010    2578 factory.go:55] Registering systemd factory
Jul 10 02:48:45.899033 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899022    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 10 02:48:45.899189 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899101    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 02:48:45.899189 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899112    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 02:48:45.899361 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899346    2578 factory.go:153] Registering CRI-O factory
Jul 10 02:48:45.899361 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899360    2578 factory.go:223] Registration of the crio container factory successfully
Jul 10 02:48:45.899523 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899408    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 02:48:45.899523 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899428    2578 factory.go:103] Registering Raw factory
Jul 10 02:48:45.899523 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899439    2578 manager.go:1196] Started watching for new ooms in manager
Jul 10 02:48:45.899523 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.898750    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-61.ec2.internal.18c0cdcb64ae4508  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-61.ec2.internal,UID:ip-10-0-134-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-61.ec2.internal,},FirstTimestamp:2026-07-10 02:48:45.88991412 +0000 UTC m=+0.317246526,LastTimestamp:2026-07-10 02:48:45.88991412 +0000 UTC m=+0.317246526,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-61.ec2.internal,}"
Jul 10 02:48:45.899872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899855    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fx7pz"
Jul 10 02:48:45.899990 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.899976    2578 manager.go:349] Starting recovery of all containers
Jul 10 02:48:45.907480 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.907459    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:48:45.910587 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.910446    2578 manager.go:354] Recovery completed
Jul 10 02:48:45.910699 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.910457    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-61.ec2.internal\" not found" node="ip-10-0-134-61.ec2.internal"
Jul 10 02:48:45.915187 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.915175    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:48:45.920444 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.920428    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:48:45.920523 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.920459    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:48:45.920523 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.920484    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:48:45.920955 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.920942    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 02:48:45.920955 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.920954    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 02:48:45.921051 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.920945    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:48:45.921051 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.920969    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 02:48:45.921658 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.921643    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:48:45.921717 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.921671    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:48:45.921717 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.921680    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:48:45.922103 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.922091    2578 policy_none.go:49] "None policy: Start"
Jul 10 02:48:45.922135 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.922108    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 02:48:45.922135 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.922118    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 02:48:45.923176 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.923165    2578 policy_none.go:47] "Start"
Jul 10 02:48:45.957068 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.957054    2578 manager.go:337] "Starting Device Plugin manager"
Jul 10 02:48:45.957152 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.957083    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 02:48:45.957152 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.957093    2578 server.go:87] "Starting device plugin registration server"
Jul 10 02:48:45.957322 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.957310    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 02:48:45.957355 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.957327    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 02:48:45.957429 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.957410    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 02:48:45.957499 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.957492    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 02:48:45.957565 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:45.957504    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 02:48:45.957941 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.957921    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 02:48:45.958024 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:45.957966    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.033984 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.033957    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 02:48:46.035290 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.035273    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 02:48:46.035340 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.035320    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 02:48:46.035372 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.035345    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 02:48:46.035414 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.035382    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 02:48:46.037746 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.037727    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:48:46.057777 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.057758    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:48:46.058889 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.058875    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:48:46.058960 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.058905    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:48:46.058960 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.058915    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:48:46.058960 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.058934    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.067043 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.067023    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.067043 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.067043    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-61.ec2.internal\": node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.076291 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.076253    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.136839 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.136816    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal"]
Jul 10 02:48:46.136886 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.136874    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:48:46.137592 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.137579    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:48:46.137667 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.137605    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:48:46.137667 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.137620    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:48:46.139024 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.139011    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:48:46.139150 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.139135    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.139196 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.139174    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:48:46.139737 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.139724    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:48:46.139790 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.139751    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:48:46.139790 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.139764    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:48:46.140287 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.140275    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:48:46.140319 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.140301    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:48:46.140319 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.140310    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:48:46.140992 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.140974    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.141074 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.141006    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:48:46.141636 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.141619    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:48:46.141718 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.141644    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:48:46.141718 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.141657    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:48:46.156095 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.156076    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-61.ec2.internal\" not found" node="ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.159990 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.159976    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-61.ec2.internal\" not found" node="ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.176825 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.176806    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.277780 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.277761    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.300104 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.300085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3984128191a768de8282e6033794994-config\") pod \"kube-apiserver-proxy-ip-10-0-134-61.ec2.internal\" (UID: \"a3984128191a768de8282e6033794994\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.300183 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.300108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e366c483c51ae5e650f97d236dfc935e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal\" (UID: \"e366c483c51ae5e650f97d236dfc935e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.300183 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.300125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e366c483c51ae5e650f97d236dfc935e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal\" (UID: \"e366c483c51ae5e650f97d236dfc935e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.378359 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.378297    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.400727 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.400698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e366c483c51ae5e650f97d236dfc935e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal\" (UID: \"e366c483c51ae5e650f97d236dfc935e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.400806 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.400734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e366c483c51ae5e650f97d236dfc935e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal\" (UID: \"e366c483c51ae5e650f97d236dfc935e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.400806 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.400752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3984128191a768de8282e6033794994-config\") pod \"kube-apiserver-proxy-ip-10-0-134-61.ec2.internal\" (UID: \"a3984128191a768de8282e6033794994\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.400806 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.400791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3984128191a768de8282e6033794994-config\") pod \"kube-apiserver-proxy-ip-10-0-134-61.ec2.internal\" (UID: \"a3984128191a768de8282e6033794994\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.400933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.400820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e366c483c51ae5e650f97d236dfc935e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal\" (UID: \"e366c483c51ae5e650f97d236dfc935e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.400933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.400828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e366c483c51ae5e650f97d236dfc935e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal\" (UID: \"e366c483c51ae5e650f97d236dfc935e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.458800 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.458778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.463653 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.463475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:46.478513 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.478493    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.579021 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.578988    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.679504 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.679443    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.779925 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.779893    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.841408 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.841380    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 02:48:46.841955 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.841530    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 02:48:46.841955 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.841586    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 02:48:46.880687 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.880661    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.904896 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.904855    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 02:43:47 +0000 UTC" deadline="2028-03-22 17:11:19.798753494 +0000 UTC"
Jul 10 02:48:46.904896 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.904892    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14918h22m32.893864806s"
Jul 10 02:48:46.981456 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:46.981425    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:46.982817 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:46.982790    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3984128191a768de8282e6033794994.slice/crio-7b18bbe20fec18cc2f27dce1af1e1bb90ec87646af81c513d04e01406c4cef1e WatchSource:0}: Error finding container 7b18bbe20fec18cc2f27dce1af1e1bb90ec87646af81c513d04e01406c4cef1e: Status 404 returned error can't find the container with id 7b18bbe20fec18cc2f27dce1af1e1bb90ec87646af81c513d04e01406c4cef1e
Jul 10 02:48:46.983313 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:46.983293    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode366c483c51ae5e650f97d236dfc935e.slice/crio-4813d56dba090c7fac408dc57dee874f383579385d54807b25150dd81e0b7884 WatchSource:0}: Error finding container 4813d56dba090c7fac408dc57dee874f383579385d54807b25150dd81e0b7884: Status 404 returned error can't find the container with id 4813d56dba090c7fac408dc57dee874f383579385d54807b25150dd81e0b7884
Jul 10 02:48:46.987944 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:46.987930    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:48:47.038719 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:47.038680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal" event={"ID":"e366c483c51ae5e650f97d236dfc935e","Type":"ContainerStarted","Data":"4813d56dba090c7fac408dc57dee874f383579385d54807b25150dd81e0b7884"}
Jul 10 02:48:47.039677 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:47.039661    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal" event={"ID":"a3984128191a768de8282e6033794994","Type":"ContainerStarted","Data":"7b18bbe20fec18cc2f27dce1af1e1bb90ec87646af81c513d04e01406c4cef1e"}
Jul 10 02:48:47.081823 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:47.081806    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:47.117130 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:47.117111    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:48:47.182068 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:47.182048    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:47.282530 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:47.282486    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-61.ec2.internal\" not found"
Jul 10 02:48:47.312703 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:47.312686    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:48:47.399232 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:47.399211    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:47.412710 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:47.412691    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 02:48:47.413678 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:47.413667    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal"
Jul 10 02:48:47.427050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:47.425872    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 02:48:48.973023 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:48.972945    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:48:48.975139 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:48.975005    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:48:49.188295 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.188229    2578 apiserver.go:52] "Watching apiserver"
Jul 10 02:48:49.196386 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.196362    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 02:48:49.196864 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.196840    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal","openshift-cluster-node-tuning-operator/tuned-vpk52","openshift-multus/multus-additional-cni-plugins-hldvt","openshift-network-diagnostics/network-check-target-99nw9","openshift-ovn-kubernetes/ovnkube-node-tpldh","kube-system/global-pull-secret-syncer-mncdm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz","openshift-dns/node-resolver-gp7vb","openshift-image-registry/node-ca-g5vs5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal","openshift-multus/multus-zcskg","openshift-multus/network-metrics-daemon-zx4tf","openshift-network-operator/iptables-alerter-zm7mh","kube-system/konnectivity-agent-h2wmc"]
Jul 10 02:48:49.198380 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.198331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.199479 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.199451    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.202506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.200777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.202506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.201952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hd2gq\""
Jul 10 02:48:49.202506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.202113    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:48:49.202506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.202144    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 02:48:49.202506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.202215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 02:48:49.202506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.202342    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 02:48:49.202506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.202393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:49.202506 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.202457    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:48:49.202984 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.202675    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 02:48:49.202984 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.202769    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vdwhm\""
Jul 10 02:48:49.202984 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.202953    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 02:48:49.203537 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.203277    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 02:48:49.203537 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.203460    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 02:48:49.203537 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.203536    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-626dv\""
Jul 10 02:48:49.203786 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.203764    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 02:48:49.203901 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.203791    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 02:48:49.203901 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.203879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.204009 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.203997    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 02:48:49.205808 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.205789    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 02:48:49.206426 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.206407    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 02:48:49.206493 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.206425    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 02:48:49.206620 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.206603    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d8brx\""
Jul 10 02:48:49.206725 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.206621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 02:48:49.206725 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.206706    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 02:48:49.206827 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.206750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 02:48:49.206911 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.206878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.206962 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.206932    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:48:49.207733 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.207543    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 02:48:49.209213 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.209193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.211552 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.211530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:48:49.214050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.212787    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 02:48:49.214050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.213067    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.214050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.213589    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 02:48:49.214050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.213769    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-64qm7\""
Jul 10 02:48:49.214050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.213930    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 02:48:49.214927 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.214909    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 02:48:49.215090 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-log-socket\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215153 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-ovnkube-config\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215153 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-env-overrides\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215244 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b18a770-3def-4e63-acde-1ba84ad187bc-ovn-node-metrics-cert\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215244 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:49.215244 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-slash\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215244 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-sys-fs\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.215419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.215419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fc7af32-bb69-4270-b16d-baa7b178244c-iptables-alerter-script\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.215419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt4pv\" (UniqueName: \"kubernetes.io/projected/4fc7af32-bb69-4270-b16d-baa7b178244c-kube-api-access-qt4pv\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.215419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-system-cni-dir\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.215419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-cnibin\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.215419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-cni-binary-copy\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.215419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.215419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqmd4\" (UniqueName: \"kubernetes.io/projected/32d11469-731f-41a0-86b3-8326bab87c44-kube-api-access-sqmd4\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-systemd-units\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-registration-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-run-netns\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-etc-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzjh8\" (UniqueName: \"kubernetes.io/projected/3b18a770-3def-4e63-acde-1ba84ad187bc-kube-api-access-qzjh8\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc7af32-bb69-4270-b16d-baa7b178244c-host-slash\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-kubelet\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-systemd\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-ovnkube-script-lib\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/128b98af-e789-4aa2-a300-f7bc264afc7e-dbus\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.215818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-socket-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-os-release\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-node-log\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-cni-bin\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-cni-netd\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.215985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/128b98af-e789-4aa2-a300-f7bc264afc7e-kubelet-config\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-device-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn7zx\" (UniqueName: \"kubernetes.io/projected/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-kube-api-access-fn7zx\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-var-lib-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216096    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-ovn\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216186    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q5m54\""
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216299    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8l456\""
Jul 10 02:48:49.216543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216366    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 02:48:49.217423 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.216601    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.217423 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.217369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:49.217521 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.217436    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:48:49.217941 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.217895    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 02:48:49.218069 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.218038    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 02:48:49.218130 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.218065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jgnl5\""
Jul 10 02:48:49.218739 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.218717    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 02:48:49.219210 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.219193    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 02:48:49.219383 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.219351    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x288b\""
Jul 10 02:48:49.240375 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.239396    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w5lzl"
Jul 10 02:48:49.246540 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.246480    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w5lzl"
Jul 10 02:48:49.306106 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.306084    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 02:48:49.317158 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.317271 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcfsx\" (UniqueName: \"kubernetes.io/projected/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-kube-api-access-jcfsx\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:49.317271 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysctl-d\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.317271 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79f302d7-8044-4a7d-b448-2512a954519c-tmp-dir\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.317271 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-conf-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.317271 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.317271 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-cni-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f238384e-cf4a-420a-bf38-bae6ec627f4c-cni-binary-copy\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-multus-certs\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-ovn\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-ovnkube-config\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-systemd\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-cni-multus\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-sys-fs\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-host\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.317586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.317552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fc7af32-bb69-4270-b16d-baa7b178244c-iptables-alerter-script\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.318152 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-ovnkube-config\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.318152 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fc7af32-bb69-4270-b16d-baa7b178244c-iptables-alerter-script\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.318255 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-ovn\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.318255 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-sys-fs\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.318255 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt4pv\" (UniqueName: \"kubernetes.io/projected/4fc7af32-bb69-4270-b16d-baa7b178244c-kube-api-access-qt4pv\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.318255 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-system-cni-dir\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.318453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-cnibin\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.318453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-cni-binary-copy\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.318453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.318453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqmd4\" (UniqueName: \"kubernetes.io/projected/32d11469-731f-41a0-86b3-8326bab87c44-kube-api-access-sqmd4\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.318453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-systemd-units\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.318453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.318453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.318453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-registration-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c5dcb40-cc6f-497b-bc15-af5219c166f4-host\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpwwm\" (UniqueName: \"kubernetes.io/projected/1c5dcb40-cc6f-497b-bc15-af5219c166f4-kube-api-access-mpwwm\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/096c206a-8c10-4fe6-8bc5-da37a862180f-agent-certs\") pod \"konnectivity-agent-h2wmc\" (UID: \"096c206a-8c10-4fe6-8bc5-da37a862180f\") " pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-run-netns\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-etc-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-modprobe-d\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-lib-modules\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-tmp\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-kubelet\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysconfig\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc7af32-bb69-4270-b16d-baa7b178244c-host-slash\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-kubelet\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c5dcb40-cc6f-497b-bc15-af5219c166f4-serviceca\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.318872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhvgg\" (UniqueName: \"kubernetes.io/projected/79f302d7-8044-4a7d-b448-2512a954519c-kube-api-access-xhvgg\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-node-log\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-cni-bin\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-cni-binary-copy\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-cni-netd\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.318972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/128b98af-e789-4aa2-a300-f7bc264afc7e-kubelet-config\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-cni-netd\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319089    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-system-cni-dir\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-cnibin\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-registration-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-device-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79f302d7-8044-4a7d-b448-2512a954519c-hosts-file\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-cnibin\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn7zx\" (UniqueName: \"kubernetes.io/projected/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-kube-api-access-fn7zx\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-sys\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-k8s-cni-cncf-io\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-cni-bin\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.319502 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-var-lib-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-log-socket\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-env-overrides\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b18a770-3def-4e63-acde-1ba84ad187bc-ovn-node-metrics-cert\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysctl-conf\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-tuned\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-etc-kubernetes\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-run-netns\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc7af32-bb69-4270-b16d-baa7b178244c-host-slash\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.319530    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-slash\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/096c206a-8c10-4fe6-8bc5-da37a862180f-konnectivity-ca\") pod \"konnectivity-agent-h2wmc\" (UID: \"096c206a-8c10-4fe6-8bc5-da37a862180f\") " pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319765    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-system-cni-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319769    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-netns\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.320185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319472    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-kubelet\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.321006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.319802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-cni-bin\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.321006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.320189    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 02:48:49.321006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.320492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.321006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.320577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/128b98af-e789-4aa2-a300-f7bc264afc7e-kubelet-config\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.321006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.320662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-systemd-units\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.321006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.320915    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-log-socket\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.321006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.320948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdnjs\" (UniqueName: \"kubernetes.io/projected/f238384e-cf4a-420a-bf38-bae6ec627f4c-kube-api-access-qdnjs\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.321335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.321320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-env-overrides\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.321381 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.321296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-var-lib-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.321500 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.321482    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-device-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.321584 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.321568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-etc-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.321821 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.321799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32d11469-731f-41a0-86b3-8326bab87c44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.321900 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.321804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-node-log\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.321900 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.321837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.322010 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.321966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-host-slash\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.322068 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-daemon-config\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.322121 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzjh8\" (UniqueName: \"kubernetes.io/projected/3b18a770-3def-4e63-acde-1ba84ad187bc-kube-api-access-qzjh8\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.322184 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-kubernetes\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.322251 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.322333 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-run\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.322333 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-os-release\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.322455 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-systemd\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.322455 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-ovnkube-script-lib\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.322455 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/128b98af-e789-4aa2-a300-f7bc264afc7e-dbus\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.322662 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-socket-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.322662 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-socket-dir\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.322832 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/128b98af-e789-4aa2-a300-f7bc264afc7e-dbus\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.322897 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-systemd\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.322965 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-var-lib-kubelet\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.323003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.322969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcq84\" (UniqueName: \"kubernetes.io/projected/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-kube-api-access-rcq84\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.323039 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.323001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-socket-dir-parent\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.323072 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.323048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-hostroot\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.323109 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.323097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-os-release\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.323148 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.323134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.323218 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.323204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32d11469-731f-41a0-86b3-8326bab87c44-os-release\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.323252 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.323214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b18a770-3def-4e63-acde-1ba84ad187bc-run-openvswitch\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.323638 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.323617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b18a770-3def-4e63-acde-1ba84ad187bc-ovnkube-script-lib\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.324377 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.324069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b18a770-3def-4e63-acde-1ba84ad187bc-ovn-node-metrics-cert\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.324791 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.324775    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret podName:128b98af-e789-4aa2-a300-f7bc264afc7e nodeName:}" failed. No retries permitted until 2026-07-10 02:48:49.824750425 +0000 UTC m=+2.945949401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret") pod "global-pull-secret-syncer-mncdm" (UID: "128b98af-e789-4aa2-a300-f7bc264afc7e") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:49.328510 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.328396    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:48:49.328510 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.328420    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:48:49.328510 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.328433    2578 projected.go:196] Error preparing data for projected volume kube-api-access-5sh9n for pod openshift-network-diagnostics/network-check-target-99nw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:49.328510 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.328489    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n podName:aa1ef0bd-941a-48cf-86f8-f6864eefd594 nodeName:}" failed. No retries permitted until 2026-07-10 02:48:49.828471519 +0000 UTC m=+2.949670494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5sh9n" (UniqueName: "kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n") pod "network-check-target-99nw9" (UID: "aa1ef0bd-941a-48cf-86f8-f6864eefd594") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:49.329725 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.329054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt4pv\" (UniqueName: \"kubernetes.io/projected/4fc7af32-bb69-4270-b16d-baa7b178244c-kube-api-access-qt4pv\") pod \"iptables-alerter-zm7mh\" (UID: \"4fc7af32-bb69-4270-b16d-baa7b178244c\") " pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.330921 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.330898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzjh8\" (UniqueName: \"kubernetes.io/projected/3b18a770-3def-4e63-acde-1ba84ad187bc-kube-api-access-qzjh8\") pod \"ovnkube-node-tpldh\" (UID: \"3b18a770-3def-4e63-acde-1ba84ad187bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.331059 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.331034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn7zx\" (UniqueName: \"kubernetes.io/projected/eff48e1c-5646-4029-b0a2-1e9be5be8d5a-kube-api-access-fn7zx\") pod \"aws-ebs-csi-driver-node-zcgtz\" (UID: \"eff48e1c-5646-4029-b0a2-1e9be5be8d5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.331337 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.331307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqmd4\" (UniqueName: \"kubernetes.io/projected/32d11469-731f-41a0-86b3-8326bab87c44-kube-api-access-sqmd4\") pod \"multus-additional-cni-plugins-hldvt\" (UID: \"32d11469-731f-41a0-86b3-8326bab87c44\") " pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.423593 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-var-lib-kubelet\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.423593 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcq84\" (UniqueName: \"kubernetes.io/projected/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-kube-api-access-rcq84\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-socket-dir-parent\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-hostroot\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfsx\" (UniqueName: \"kubernetes.io/projected/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-kube-api-access-jcfsx\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysctl-d\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423674    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79f302d7-8044-4a7d-b448-2512a954519c-tmp-dir\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-conf-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-cni-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-var-lib-kubelet\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-hostroot\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-cni-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f238384e-cf4a-420a-bf38-bae6ec627f4c-cni-binary-copy\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-socket-dir-parent\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.423859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-multus-certs\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysctl-d\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-conf-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-systemd\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-multus-certs\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-cni-multus\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-host\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-cni-multus\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-systemd\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.423998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c5dcb40-cc6f-497b-bc15-af5219c166f4-host\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpwwm\" (UniqueName: \"kubernetes.io/projected/1c5dcb40-cc6f-497b-bc15-af5219c166f4-kube-api-access-mpwwm\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c5dcb40-cc6f-497b-bc15-af5219c166f4-host\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-host\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/096c206a-8c10-4fe6-8bc5-da37a862180f-agent-certs\") pod \"konnectivity-agent-h2wmc\" (UID: \"096c206a-8c10-4fe6-8bc5-da37a862180f\") " pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-modprobe-d\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-lib-modules\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79f302d7-8044-4a7d-b448-2512a954519c-tmp-dir\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-tmp\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.424434 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-kubelet\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-modprobe-d\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysconfig\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-kubelet\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-lib-modules\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c5dcb40-cc6f-497b-bc15-af5219c166f4-serviceca\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhvgg\" (UniqueName: \"kubernetes.io/projected/79f302d7-8044-4a7d-b448-2512a954519c-kube-api-access-xhvgg\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysconfig\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79f302d7-8044-4a7d-b448-2512a954519c-hosts-file\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-cnibin\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-sys\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-k8s-cni-cncf-io\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424447    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f238384e-cf4a-420a-bf38-bae6ec627f4c-cni-binary-copy\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-cni-bin\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-cnibin\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysctl-conf\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-tuned\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.425327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79f302d7-8044-4a7d-b448-2512a954519c-hosts-file\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-etc-kubernetes\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-sys\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/096c206a-8c10-4fe6-8bc5-da37a862180f-konnectivity-ca\") pod \"konnectivity-agent-h2wmc\" (UID: \"096c206a-8c10-4fe6-8bc5-da37a862180f\") " pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-var-lib-cni-bin\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-system-cni-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424646    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-sysctl-conf\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-netns\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.424673    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdnjs\" (UniqueName: \"kubernetes.io/projected/f238384e-cf4a-420a-bf38-bae6ec627f4c-kube-api-access-qdnjs\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-daemon-config\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-kubernetes\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c5dcb40-cc6f-497b-bc15-af5219c166f4-serviceca\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-run\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-os-release\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.424550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-k8s-cni-cncf-io\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.424986    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs podName:96df90f3-2b21-40e8-ab9a-cab5310d7fb6 nodeName:}" failed. No retries permitted until 2026-07-10 02:48:49.924967215 +0000 UTC m=+3.046166188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs") pod "network-metrics-daemon-zx4tf" (UID: "96df90f3-2b21-40e8-ab9a-cab5310d7fb6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.425001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-kubernetes\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.426003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.425043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-system-cni-dir\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.425047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-os-release\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.425076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-host-run-netns\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.425141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-run\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.426764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.425168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f238384e-cf4a-420a-bf38-bae6ec627f4c-etc-kubernetes\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.425221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/096c206a-8c10-4fe6-8bc5-da37a862180f-konnectivity-ca\") pod \"konnectivity-agent-h2wmc\" (UID: \"096c206a-8c10-4fe6-8bc5-da37a862180f\") " pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:48:49.426764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.425380    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f238384e-cf4a-420a-bf38-bae6ec627f4c-multus-daemon-config\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.426999 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.426972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-tmp\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.427072 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.427050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-etc-tuned\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.427418 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.427395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/096c206a-8c10-4fe6-8bc5-da37a862180f-agent-certs\") pod \"konnectivity-agent-h2wmc\" (UID: \"096c206a-8c10-4fe6-8bc5-da37a862180f\") " pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:48:49.436583 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.436559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcfsx\" (UniqueName: \"kubernetes.io/projected/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-kube-api-access-jcfsx\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:49.437280 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.437250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdnjs\" (UniqueName: \"kubernetes.io/projected/f238384e-cf4a-420a-bf38-bae6ec627f4c-kube-api-access-qdnjs\") pod \"multus-zcskg\" (UID: \"f238384e-cf4a-420a-bf38-bae6ec627f4c\") " pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.437430 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.437413    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhvgg\" (UniqueName: \"kubernetes.io/projected/79f302d7-8044-4a7d-b448-2512a954519c-kube-api-access-xhvgg\") pod \"node-resolver-gp7vb\" (UID: \"79f302d7-8044-4a7d-b448-2512a954519c\") " pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.437906 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.437889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcq84\" (UniqueName: \"kubernetes.io/projected/4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1-kube-api-access-rcq84\") pod \"tuned-vpk52\" (UID: \"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1\") " pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.437906 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.437897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpwwm\" (UniqueName: \"kubernetes.io/projected/1c5dcb40-cc6f-497b-bc15-af5219c166f4-kube-api-access-mpwwm\") pod \"node-ca-g5vs5\" (UID: \"1c5dcb40-cc6f-497b-bc15-af5219c166f4\") " pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.515301 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.515228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz"
Jul 10 02:48:49.524832 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.524809    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zm7mh"
Jul 10 02:48:49.535540 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.535513    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hldvt"
Jul 10 02:48:49.541469 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.541440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:48:49.550705 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.550520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g5vs5"
Jul 10 02:48:49.557457 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.557435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:48:49.566146 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.566119    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vpk52"
Jul 10 02:48:49.575845 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.575824    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gp7vb"
Jul 10 02:48:49.582377 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.582361    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcskg"
Jul 10 02:48:49.827916 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.827828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:49.828064 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.827985    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:49.828064 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.828054    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret podName:128b98af-e789-4aa2-a300-f7bc264afc7e nodeName:}" failed. No retries permitted until 2026-07-10 02:48:50.828034363 +0000 UTC m=+3.949233326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret") pod "global-pull-secret-syncer-mncdm" (UID: "128b98af-e789-4aa2-a300-f7bc264afc7e") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:49.928766 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.928737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:49.928766 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:49.928769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:49.928962 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.928889    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:49.928962 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.928900    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:48:49.928962 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.928916    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:48:49.928962 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.928929    2578 projected.go:196] Error preparing data for projected volume kube-api-access-5sh9n for pod openshift-network-diagnostics/network-check-target-99nw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:49.928962 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.928955    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs podName:96df90f3-2b21-40e8-ab9a-cab5310d7fb6 nodeName:}" failed. No retries permitted until 2026-07-10 02:48:50.928938037 +0000 UTC m=+4.050136998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs") pod "network-metrics-daemon-zx4tf" (UID: "96df90f3-2b21-40e8-ab9a-cab5310d7fb6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:49.929121 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:49.928971    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n podName:aa1ef0bd-941a-48cf-86f8-f6864eefd594 nodeName:}" failed. No retries permitted until 2026-07-10 02:48:50.928962793 +0000 UTC m=+4.050161754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sh9n" (UniqueName: "kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n") pod "network-check-target-99nw9" (UID: "aa1ef0bd-941a-48cf-86f8-f6864eefd594") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:50.237978 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:50.237950    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b18a770_3def_4e63_acde_1ba84ad187bc.slice/crio-c8324cf6bf49b6faa4baed5b1d396217aedea00d78d0df1c2a0eb53581af9c05 WatchSource:0}: Error finding container c8324cf6bf49b6faa4baed5b1d396217aedea00d78d0df1c2a0eb53581af9c05: Status 404 returned error can't find the container with id c8324cf6bf49b6faa4baed5b1d396217aedea00d78d0df1c2a0eb53581af9c05
Jul 10 02:48:50.248830 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.248801    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 02:43:49 +0000 UTC" deadline="2028-04-03 21:10:55.170587128 +0000 UTC"
Jul 10 02:48:50.248830 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.248827    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15210h22m4.921762949s"
Jul 10 02:48:50.255829 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:50.255276    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd0f35d_a244_4d31_9baf_f4c7cf2e78c1.slice/crio-3e8b08d35f65bc8a905a90872cb6b9b80b064bfdec430ec5b25ce0b85f1dcd6c WatchSource:0}: Error finding container 3e8b08d35f65bc8a905a90872cb6b9b80b064bfdec430ec5b25ce0b85f1dcd6c: Status 404 returned error can't find the container with id 3e8b08d35f65bc8a905a90872cb6b9b80b064bfdec430ec5b25ce0b85f1dcd6c
Jul 10 02:48:50.257087 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:50.257019    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5dcb40_cc6f_497b_bc15_af5219c166f4.slice/crio-cd44b2f5d173cf227dae7cca69b67d86a83a9dafd211a4988ef29e123f12d302 WatchSource:0}: Error finding container cd44b2f5d173cf227dae7cca69b67d86a83a9dafd211a4988ef29e123f12d302: Status 404 returned error can't find the container with id cd44b2f5d173cf227dae7cca69b67d86a83a9dafd211a4988ef29e123f12d302
Jul 10 02:48:50.260829 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:48:50.257980    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff48e1c_5646_4029_b0a2_1e9be5be8d5a.slice/crio-760a0a405c20ee6d24f4687f4508fbe7497695b7642638b276ca2841e19211ce WatchSource:0}: Error finding container 760a0a405c20ee6d24f4687f4508fbe7497695b7642638b276ca2841e19211ce: Status 404 returned error can't find the container with id 760a0a405c20ee6d24f4687f4508fbe7497695b7642638b276ca2841e19211ce
Jul 10 02:48:50.354436 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.354301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcskg" event={"ID":"f238384e-cf4a-420a-bf38-bae6ec627f4c","Type":"ContainerStarted","Data":"57cdbd7dca103065202a71387b58a47e478f5addafd3f6b13ecde113ee5d157f"}
Jul 10 02:48:50.358922 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.358899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gp7vb" event={"ID":"79f302d7-8044-4a7d-b448-2512a954519c","Type":"ContainerStarted","Data":"1bfb941e009c803b9c657461bb69c93e0b2dc109053e91fbdff8207b9f93f554"}
Jul 10 02:48:50.361838 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.361810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zm7mh" event={"ID":"4fc7af32-bb69-4270-b16d-baa7b178244c","Type":"ContainerStarted","Data":"94241432777ec990b0ad214fa4fbc0dc8292267b636d0021ea969af66003603f"}
Jul 10 02:48:50.363249 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.363227    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hldvt" event={"ID":"32d11469-731f-41a0-86b3-8326bab87c44","Type":"ContainerStarted","Data":"1374b1824c8d0ffed8c92e0367f001ba9614396503c1bdf7c023e22d706de719"}
Jul 10 02:48:50.364245 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.364218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g5vs5" event={"ID":"1c5dcb40-cc6f-497b-bc15-af5219c166f4","Type":"ContainerStarted","Data":"cd44b2f5d173cf227dae7cca69b67d86a83a9dafd211a4988ef29e123f12d302"}
Jul 10 02:48:50.365271 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.365240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"c8324cf6bf49b6faa4baed5b1d396217aedea00d78d0df1c2a0eb53581af9c05"}
Jul 10 02:48:50.366928 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.366907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal" event={"ID":"a3984128191a768de8282e6033794994","Type":"ContainerStarted","Data":"80ce6bb61f975742b7efd58f2a390972554714f5c9e6c687b487ac65dacf96bc"}
Jul 10 02:48:50.369948 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.369921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2wmc" event={"ID":"096c206a-8c10-4fe6-8bc5-da37a862180f","Type":"ContainerStarted","Data":"480227b00806b644154d586b84d0530e7a7c147a19e417e73b40f09730541da1"}
Jul 10 02:48:50.372055 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.372038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz" event={"ID":"eff48e1c-5646-4029-b0a2-1e9be5be8d5a","Type":"ContainerStarted","Data":"760a0a405c20ee6d24f4687f4508fbe7497695b7642638b276ca2841e19211ce"}
Jul 10 02:48:50.375225 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.375200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vpk52" event={"ID":"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1","Type":"ContainerStarted","Data":"3e8b08d35f65bc8a905a90872cb6b9b80b064bfdec430ec5b25ce0b85f1dcd6c"}
Jul 10 02:48:50.388698 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.388645    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-61.ec2.internal" podStartSLOduration=2.388632849 podStartE2EDuration="2.388632849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:48:50.388128181 +0000 UTC m=+3.509327162" watchObservedRunningTime="2026-07-10 02:48:50.388632849 +0000 UTC m=+3.509831828"
Jul 10 02:48:50.834727 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.834618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:50.834884 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:50.834829    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:50.834950 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:50.834897    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret podName:128b98af-e789-4aa2-a300-f7bc264afc7e nodeName:}" failed. No retries permitted until 2026-07-10 02:48:52.83487795 +0000 UTC m=+5.956076911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret") pod "global-pull-secret-syncer-mncdm" (UID: "128b98af-e789-4aa2-a300-f7bc264afc7e") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:50.935610 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.935368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:50.935610 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:50.935410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:50.935610 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:50.935562    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:48:50.935610 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:50.935582    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:48:50.935610 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:50.935593    2578 projected.go:196] Error preparing data for projected volume kube-api-access-5sh9n for pod openshift-network-diagnostics/network-check-target-99nw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:50.935991 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:50.935648    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n podName:aa1ef0bd-941a-48cf-86f8-f6864eefd594 nodeName:}" failed. No retries permitted until 2026-07-10 02:48:52.935630735 +0000 UTC m=+6.056829696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sh9n" (UniqueName: "kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n") pod "network-check-target-99nw9" (UID: "aa1ef0bd-941a-48cf-86f8-f6864eefd594") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:50.936059 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:50.936037    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:50.936107 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:50.936085    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs podName:96df90f3-2b21-40e8-ab9a-cab5310d7fb6 nodeName:}" failed. No retries permitted until 2026-07-10 02:48:52.936070149 +0000 UTC m=+6.057269111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs") pod "network-metrics-daemon-zx4tf" (UID: "96df90f3-2b21-40e8-ab9a-cab5310d7fb6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:51.249553 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:51.249495    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 02:43:49 +0000 UTC" deadline="2027-12-06 06:32:06.174385386 +0000 UTC"
Jul 10 02:48:51.249553 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:51.249551    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12339h43m14.924838276s"
Jul 10 02:48:51.345513 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:51.344711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:51.345513 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:51.344835    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:48:51.345513 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:51.345215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:51.345513 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:51.345313    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:48:51.345513 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:51.345386    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:51.345513 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:51.345466    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:48:51.404532 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:51.403515    2578 generic.go:356] "Generic (PLEG): container finished" podID="e366c483c51ae5e650f97d236dfc935e" containerID="1bd266206a7d67467925856f4b63607f0788fac75e17597d86a34bafaa9f5288" exitCode=0
Jul 10 02:48:51.404532 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:51.404345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal" event={"ID":"e366c483c51ae5e650f97d236dfc935e","Type":"ContainerDied","Data":"1bd266206a7d67467925856f4b63607f0788fac75e17597d86a34bafaa9f5288"}
Jul 10 02:48:52.427123 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:52.427084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal" event={"ID":"e366c483c51ae5e650f97d236dfc935e","Type":"ContainerStarted","Data":"666c1e2b05b8a03b5c73cab8c584f4ee644faccbd49672c76ab8b008d9428c76"}
Jul 10 02:48:52.854244 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:52.853606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:52.854244 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:52.853818    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:52.854244 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:52.853878    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret podName:128b98af-e789-4aa2-a300-f7bc264afc7e nodeName:}" failed. No retries permitted until 2026-07-10 02:48:56.853860045 +0000 UTC m=+9.975059023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret") pod "global-pull-secret-syncer-mncdm" (UID: "128b98af-e789-4aa2-a300-f7bc264afc7e") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:52.954701 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:52.954649    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:52.954882 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:52.954712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:52.954882 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:52.954860    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:48:52.954882 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:52.954878    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:48:52.955037 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:52.954890    2578 projected.go:196] Error preparing data for projected volume kube-api-access-5sh9n for pod openshift-network-diagnostics/network-check-target-99nw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:52.955037 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:52.954947    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n podName:aa1ef0bd-941a-48cf-86f8-f6864eefd594 nodeName:}" failed. No retries permitted until 2026-07-10 02:48:56.954927387 +0000 UTC m=+10.076126350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sh9n" (UniqueName: "kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n") pod "network-check-target-99nw9" (UID: "aa1ef0bd-941a-48cf-86f8-f6864eefd594") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:52.955349 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:52.955330    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:52.955426 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:52.955388    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs podName:96df90f3-2b21-40e8-ab9a-cab5310d7fb6 nodeName:}" failed. No retries permitted until 2026-07-10 02:48:56.955371171 +0000 UTC m=+10.076570135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs") pod "network-metrics-daemon-zx4tf" (UID: "96df90f3-2b21-40e8-ab9a-cab5310d7fb6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:53.343408 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:53.342826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:53.343408 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:53.342825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:53.343408 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:53.342973    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:48:53.343408 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:53.343053    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:48:53.343408 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:53.342824    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:53.343408 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:53.343157    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:48:55.343225 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:55.342788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:55.343225 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:55.342816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:55.343225 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:55.342794    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:55.343225 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:55.342916    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:48:55.343225 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:55.343028    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:48:55.343225 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:55.343120    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:48:56.887280 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:56.887243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:56.887770 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:56.887402    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:56.887770 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:56.887478    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret podName:128b98af-e789-4aa2-a300-f7bc264afc7e nodeName:}" failed. No retries permitted until 2026-07-10 02:49:04.887457787 +0000 UTC m=+18.008656765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret") pod "global-pull-secret-syncer-mncdm" (UID: "128b98af-e789-4aa2-a300-f7bc264afc7e") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:48:56.988217 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:56.988177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:56.988389 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:56.988225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:56.988389 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:56.988355    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:56.988503 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:56.988390    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:48:56.988503 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:56.988410    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:48:56.988503 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:56.988423    2578 projected.go:196] Error preparing data for projected volume kube-api-access-5sh9n for pod openshift-network-diagnostics/network-check-target-99nw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:56.988503 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:56.988429    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs podName:96df90f3-2b21-40e8-ab9a-cab5310d7fb6 nodeName:}" failed. No retries permitted until 2026-07-10 02:49:04.988410072 +0000 UTC m=+18.109609050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs") pod "network-metrics-daemon-zx4tf" (UID: "96df90f3-2b21-40e8-ab9a-cab5310d7fb6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:48:56.988503 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:56.988474    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n podName:aa1ef0bd-941a-48cf-86f8-f6864eefd594 nodeName:}" failed. No retries permitted until 2026-07-10 02:49:04.988457282 +0000 UTC m=+18.109656263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sh9n" (UniqueName: "kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n") pod "network-check-target-99nw9" (UID: "aa1ef0bd-941a-48cf-86f8-f6864eefd594") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:48:57.342933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:57.342858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:57.343070 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:57.342952    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:48:57.343070 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:57.343041    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:57.343185 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:57.343125    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:48:57.343185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:57.343176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:57.343308 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:57.343259    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:48:59.342666 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:59.342236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:48:59.342666 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:59.342280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:48:59.342666 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:59.342359    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:48:59.342666 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:48:59.342239    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:48:59.342666 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:59.342480    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:48:59.342666 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:48:59.342564    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:01.342795 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:01.342762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:01.343233 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:01.342773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:01.343233 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:01.342889    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:01.343233 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:01.342774    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:01.343233 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:01.342970    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:01.343233 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:01.343049    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:03.341712 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:03.341667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:03.342137 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:03.341667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:03.342137 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:03.341845    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:03.342137 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:03.341908    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:03.342137 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:03.341672    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:03.342137 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:03.342015    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:04.948334 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:04.948283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:04.948894 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:04.948432    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:49:04.948894 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:04.948501    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret podName:128b98af-e789-4aa2-a300-f7bc264afc7e nodeName:}" failed. No retries permitted until 2026-07-10 02:49:20.948486262 +0000 UTC m=+34.069685219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret") pod "global-pull-secret-syncer-mncdm" (UID: "128b98af-e789-4aa2-a300-f7bc264afc7e") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:49:05.048612 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:05.048578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:05.048612 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:05.048617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:05.048798 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.048746    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:49:05.048798 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.048782    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:49:05.048879 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.048798    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:49:05.048879 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.048810    2578 projected.go:196] Error preparing data for projected volume kube-api-access-5sh9n for pod openshift-network-diagnostics/network-check-target-99nw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:49:05.048879 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.048818    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs podName:96df90f3-2b21-40e8-ab9a-cab5310d7fb6 nodeName:}" failed. No retries permitted until 2026-07-10 02:49:21.048797194 +0000 UTC m=+34.169996173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs") pod "network-metrics-daemon-zx4tf" (UID: "96df90f3-2b21-40e8-ab9a-cab5310d7fb6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:49:05.048879 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.048842    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n podName:aa1ef0bd-941a-48cf-86f8-f6864eefd594 nodeName:}" failed. No retries permitted until 2026-07-10 02:49:21.048832646 +0000 UTC m=+34.170031603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sh9n" (UniqueName: "kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n") pod "network-check-target-99nw9" (UID: "aa1ef0bd-941a-48cf-86f8-f6864eefd594") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:49:05.342728 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:05.342639    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:05.342728 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:05.342642    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:05.342913 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:05.342791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:05.342913 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.342805    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:05.342988 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.342929    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:05.343026 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:05.342995    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:07.343144 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:07.343112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:07.343570 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:07.343187    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:07.343570 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:07.343210    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:07.343570 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:07.343332    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:07.343570 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:07.343366    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:07.343570 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:07.343420    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:09.342497 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.342333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:09.342497 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.342350    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:09.342497 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:09.342449    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:09.343126 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:09.342535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:09.343126 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.342636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:09.343126 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:09.342760    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:09.473881 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.473856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vpk52" event={"ID":"4dd0f35d-a244-4d31-9baf-f4c7cf2e78c1","Type":"ContainerStarted","Data":"210a13d53520368fce54989a1891d36a782788e4da5706b8e2050d2c5e51fe23"}
Jul 10 02:49:09.475373 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.475345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcskg" event={"ID":"f238384e-cf4a-420a-bf38-bae6ec627f4c","Type":"ContainerStarted","Data":"2c3e53b8deb51adaa1bad0e16765fb26bc9a2997dc242d1260fb33e251e8681b"}
Jul 10 02:49:09.476765 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.476746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gp7vb" event={"ID":"79f302d7-8044-4a7d-b448-2512a954519c","Type":"ContainerStarted","Data":"ddbd04797e8c97fad9cf37c04d41ab37e5bcd675bdea9b6304e599c998684b76"}
Jul 10 02:49:09.478266 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.478243    2578 generic.go:356] "Generic (PLEG): container finished" podID="32d11469-731f-41a0-86b3-8326bab87c44" containerID="d7927ecb75b873c73bb06760f381c33c8ab4a76064c566c30795fe0bd3e9f4b6" exitCode=0
Jul 10 02:49:09.478342 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.478324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hldvt" event={"ID":"32d11469-731f-41a0-86b3-8326bab87c44","Type":"ContainerDied","Data":"d7927ecb75b873c73bb06760f381c33c8ab4a76064c566c30795fe0bd3e9f4b6"}
Jul 10 02:49:09.480039 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.479968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g5vs5" event={"ID":"1c5dcb40-cc6f-497b-bc15-af5219c166f4","Type":"ContainerStarted","Data":"4a22c8dba2e5416f860398b7eb0040e0c85b9f03390da88a12e8d6a6f4874833"}
Jul 10 02:49:09.485217 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.485198    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:49:09.485543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.485525    2578 generic.go:356] "Generic (PLEG): container finished" podID="3b18a770-3def-4e63-acde-1ba84ad187bc" containerID="29034cd27850884d740e1b8d26d440eba054ce0b9bc024a5374275090bc7dfb4" exitCode=1
Jul 10 02:49:09.485662 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.485597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"006c4a26b05ef5e08a33a5d1ebb900186bc45e2cd73c66096a4ea4a578b75e33"}
Jul 10 02:49:09.485749 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.485708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerDied","Data":"29034cd27850884d740e1b8d26d440eba054ce0b9bc024a5374275090bc7dfb4"}
Jul 10 02:49:09.485801 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.485770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"ad4273cf5de9dcb883ee4ac1b3c6321cabf687fafdf853533264c35b376fa22a"}
Jul 10 02:49:09.487078 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.487056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2wmc" event={"ID":"096c206a-8c10-4fe6-8bc5-da37a862180f","Type":"ContainerStarted","Data":"8c3470eba71706a4f766a6628650370a722a79a2eed4f0f0c252463a88217bb9"}
Jul 10 02:49:09.488495 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.488468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz" event={"ID":"eff48e1c-5646-4029-b0a2-1e9be5be8d5a","Type":"ContainerStarted","Data":"4a7857a05ecedafed27c6b63223f6eee7df64b18491f874d4c76a06fd2915e2e"}
Jul 10 02:49:09.502103 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.502065    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-61.ec2.internal" podStartSLOduration=21.502053795 podStartE2EDuration="21.502053795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:48:52.443388327 +0000 UTC m=+5.564587308" watchObservedRunningTime="2026-07-10 02:49:09.502053795 +0000 UTC m=+22.623252775"
Jul 10 02:49:09.516121 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.516075    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g5vs5" podStartSLOduration=3.663298741 podStartE2EDuration="22.516058802s" totalImagesPullingTime="18.852760061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:09.515678668 +0000 UTC m=+22.636877648" watchObservedRunningTime="2026-07-10 02:49:09.516058802 +0000 UTC m=+22.637257783"
Jul 10 02:49:09.550172 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.550138    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zcskg" podStartSLOduration=3.642781829 podStartE2EDuration="22.55012471s" totalImagesPullingTime="18.907342881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:09.549927769 +0000 UTC m=+22.671126750" watchObservedRunningTime="2026-07-10 02:49:09.55012471 +0000 UTC m=+22.671323690"
Jul 10 02:49:09.550349 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.550323    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h2wmc" podStartSLOduration=11.946668945999999 podStartE2EDuration="22.550316096s" totalImagesPullingTime="10.60364715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:09.529071528 +0000 UTC m=+22.650270506" watchObservedRunningTime="2026-07-10 02:49:09.550316096 +0000 UTC m=+22.671515145"
Jul 10 02:49:09.588967 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.588932    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gp7vb" podStartSLOduration=3.7439313629999997 podStartE2EDuration="22.588919357s" totalImagesPullingTime="18.844987994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:09.58881613 +0000 UTC m=+22.710015109" watchObservedRunningTime="2026-07-10 02:49:09.588919357 +0000 UTC m=+22.710118336"
Jul 10 02:49:09.589200 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.589182    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vpk52" podStartSLOduration=3.733991616 podStartE2EDuration="22.589178414s" totalImagesPullingTime="18.855186798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:09.57326687 +0000 UTC m=+22.694465846" watchObservedRunningTime="2026-07-10 02:49:09.589178414 +0000 UTC m=+22.710377436"
Jul 10 02:49:09.855648 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.855466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:49:09.856002 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:09.855987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:49:10.491706 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:10.491650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zm7mh" event={"ID":"4fc7af32-bb69-4270-b16d-baa7b178244c","Type":"ContainerStarted","Data":"27fa93cc612126982dd74d3634a9cfeb475992882a68e453a81891d4491c4126"}
Jul 10 02:49:10.494302 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:10.494284    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:49:10.494671 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:10.494645    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"fd67c7e851b0b7c3031567269a18579c8c350d71f25397d89526124bba8cfc7a"}
Jul 10 02:49:10.494759 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:10.494740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"030c4614d1d354be0c4d961091c8faac8a1f09932b9f9dd9a1216f3c06a3bd14"}
Jul 10 02:49:10.494808 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:10.494793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"ed96925346f33b34e860f434c54336f149b348f10bc7d7dc9b77cd46ccb6f32e"}
Jul 10 02:49:10.505897 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:10.505859    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zm7mh" podStartSLOduration=4.658500508 podStartE2EDuration="23.505848642s" totalImagesPullingTime="18.847348134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:10.505773367 +0000 UTC m=+23.626972346" watchObservedRunningTime="2026-07-10 02:49:10.505848642 +0000 UTC m=+23.627047622"
Jul 10 02:49:10.826848 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:10.826827    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 02:49:11.275057 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.274964    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T02:49:10.826843678Z","UUID":"485fd052-0fb4-47a0-a9a8-30a39a933399","Handler":null,"Name":"","Endpoint":""}
Jul 10 02:49:11.277546 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.277523    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 02:49:11.277660 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.277559    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 02:49:11.342093 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.342067    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:11.342093 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.342089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:11.342333 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:11.342185    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:11.342333 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:11.342226    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:11.342333 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.342277    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:11.342443 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:11.342369    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:11.500316 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.499879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz" event={"ID":"eff48e1c-5646-4029-b0a2-1e9be5be8d5a","Type":"ContainerStarted","Data":"035129faa3c51c8a8a2ab62421b5150da1841617db8f04fc366e5deada7f181d"}
Jul 10 02:49:11.500316 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.500072    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 02:49:11.911034 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:11.910859    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:12.007629 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.007603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:12.108059 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.108026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:12.210426 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.210392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:12.505342 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.505318    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:49:12.505849 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.505710    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"bbb706951ae38e9c5b95c996c9e594db11dc78452f9aefa1eb1ac329c1c4832c"}
Jul 10 02:49:12.507745 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.507713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz" event={"ID":"eff48e1c-5646-4029-b0a2-1e9be5be8d5a","Type":"ContainerStarted","Data":"d7ab040ecfd5ecdc5ce039bee15b35de6ab651b8191ddbae245ed1fa849419ed"}
Jul 10 02:49:12.526873 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.526220    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcgtz" podStartSLOduration=4.152992663 podStartE2EDuration="25.526203196s" totalImagesPullingTime="21.373210533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:12.525638859 +0000 UTC m=+25.646837841" watchObservedRunningTime="2026-07-10 02:49:12.526203196 +0000 UTC m=+25.647402177"
Jul 10 02:49:12.570114 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.570083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:12.670651 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.670599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:12.768958 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.768890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:12.966141 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:12.966111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:13.067290 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.067210    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:13.322970 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.322891    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:49:13.323117 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.323071    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 02:49:13.323494 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.323468    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h2wmc"
Jul 10 02:49:13.342580 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.342559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:13.342718 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.342562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:13.342718 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:13.342704    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:13.342830 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:13.342806    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:13.342865 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.342852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:13.342955 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:13.342940    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:13.384986 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.384953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:13.785851 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.785814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:13.993754 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:13.993716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:14.158235 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:14.158154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:14.286480 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:14.286442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:14.362246 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:14.362216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:14.462330 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:14.462300    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:14.663029 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:14.662995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:14.718322 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:14.718259    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:15.342053 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.341768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:15.342535 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.341841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:15.342535 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:15.342115    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:15.342535 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.341854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:15.342535 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:15.342169    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:15.342535 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:15.342246    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:15.516403 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.516372    2578 generic.go:356] "Generic (PLEG): container finished" podID="32d11469-731f-41a0-86b3-8326bab87c44" containerID="6719c178d71f4a3a4800914f0a6ba0e235afffec14d53908d2c29084fb3a8dc9" exitCode=0
Jul 10 02:49:15.516563 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.516450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hldvt" event={"ID":"32d11469-731f-41a0-86b3-8326bab87c44","Type":"ContainerDied","Data":"6719c178d71f4a3a4800914f0a6ba0e235afffec14d53908d2c29084fb3a8dc9"}
Jul 10 02:49:15.520079 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.520064    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:49:15.520463 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.520442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"6674fdf1fc202fe571171d3f4815400fdc56b00e44a20a78a254d53a2e5a6b3e"}
Jul 10 02:49:15.520726 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.520707    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:49:15.520827 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.520771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:49:15.520827 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.520819    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:49:15.520938 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.520892    2578 scope.go:117] "RemoveContainer" containerID="29034cd27850884d740e1b8d26d440eba054ce0b9bc024a5374275090bc7dfb4"
Jul 10 02:49:15.538168 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.538149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:49:15.538262 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:15.538252    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:49:16.526526 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.526500    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:49:16.527090 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.526858    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" event={"ID":"3b18a770-3def-4e63-acde-1ba84ad187bc","Type":"ContainerStarted","Data":"a96d17babc85e53115411cf74b522c5268be55c81cbbb939998d0dfdcd9664cc"}
Jul 10 02:49:16.554723 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.554657    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh" podStartSLOduration=10.621743282 podStartE2EDuration="29.554642344s" totalImagesPullingTime="18.932899062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:16.554329191 +0000 UTC m=+29.675528172" watchObservedRunningTime="2026-07-10 02:49:16.554642344 +0000 UTC m=+29.675841324"
Jul 10 02:49:16.868153 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.867981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99nw9"]
Jul 10 02:49:16.868295 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.868233    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:16.868338 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:16.868312    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:16.868451 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.868431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mncdm"]
Jul 10 02:49:16.868526 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.868515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:16.868598 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:16.868583    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:16.869748 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.869727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zx4tf"]
Jul 10 02:49:16.869850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:16.869831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:16.869951 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:16.869932    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:17.530375 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:17.530343    2578 generic.go:356] "Generic (PLEG): container finished" podID="32d11469-731f-41a0-86b3-8326bab87c44" containerID="fee57a579065065b1e9508fe4e2ca89636457eded35cd98af6af804c7384050e" exitCode=0
Jul 10 02:49:17.530889 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:17.530383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hldvt" event={"ID":"32d11469-731f-41a0-86b3-8326bab87c44","Type":"ContainerDied","Data":"fee57a579065065b1e9508fe4e2ca89636457eded35cd98af6af804c7384050e"}
Jul 10 02:49:17.901702 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:17.901603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:17.998351 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:17.998322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:18.062117 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:18.062081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:18.341809 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:18.341738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:18.341809 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:18.341761    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:18.341809 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:18.341761    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:18.342085 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:18.341833    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:18.342085 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:18.341928    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:18.342085 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:18.342036    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:18.470950 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:18.470926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:19.025542 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:19.025501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:19.074948 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:19.074921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:19.537181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:19.537151    2578 generic.go:356] "Generic (PLEG): container finished" podID="32d11469-731f-41a0-86b3-8326bab87c44" containerID="a2f185cdf0e908ffcbf6a1427cb4444bae1af4c554bcbec7d6811114a380da3a" exitCode=0
Jul 10 02:49:19.537333 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:19.537203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hldvt" event={"ID":"32d11469-731f-41a0-86b3-8326bab87c44","Type":"ContainerDied","Data":"a2f185cdf0e908ffcbf6a1427cb4444bae1af4c554bcbec7d6811114a380da3a"}
Jul 10 02:49:20.342627 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:20.342584    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:20.342627 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:20.342614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:20.342627 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:20.342624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:20.343181 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:20.342745    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zx4tf" podUID="96df90f3-2b21-40e8-ab9a-cab5310d7fb6"
Jul 10 02:49:20.343181 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:20.342809    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99nw9" podUID="aa1ef0bd-941a-48cf-86f8-f6864eefd594"
Jul 10 02:49:20.343181 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:20.342883    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mncdm" podUID="128b98af-e789-4aa2-a300-f7bc264afc7e"
Jul 10 02:49:20.633351 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:20.633317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:20.967822 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:20.967788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:20.967977 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:20.967933    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:49:20.968017 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:20.967997    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret podName:128b98af-e789-4aa2-a300-f7bc264afc7e nodeName:}" failed. No retries permitted until 2026-07-10 02:49:52.96798017 +0000 UTC m=+66.089179129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret") pod "global-pull-secret-syncer-mncdm" (UID: "128b98af-e789-4aa2-a300-f7bc264afc7e") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:49:21.026002 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.025967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:21.068242 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.068210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:21.068242 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.068254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:21.068478 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:21.068366    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:49:21.068478 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:21.068381    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:49:21.068478 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:21.068399    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:49:21.068478 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:21.068411    2578 projected.go:196] Error preparing data for projected volume kube-api-access-5sh9n for pod openshift-network-diagnostics/network-check-target-99nw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:49:21.068478 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:21.068443    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs podName:96df90f3-2b21-40e8-ab9a-cab5310d7fb6 nodeName:}" failed. No retries permitted until 2026-07-10 02:49:53.068420963 +0000 UTC m=+66.189619941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs") pod "network-metrics-daemon-zx4tf" (UID: "96df90f3-2b21-40e8-ab9a-cab5310d7fb6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:49:21.068478 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:21.068465    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n podName:aa1ef0bd-941a-48cf-86f8-f6864eefd594 nodeName:}" failed. No retries permitted until 2026-07-10 02:49:53.068450414 +0000 UTC m=+66.189649386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sh9n" (UniqueName: "kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n") pod "network-check-target-99nw9" (UID: "aa1ef0bd-941a-48cf-86f8-f6864eefd594") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:49:21.088429 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.088397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:21.716164 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.715938    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-61.ec2.internal" event="NodeReady"
Jul 10 02:49:21.716590 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.716286    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 02:49:21.762044 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.762012    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sgl9s"]
Jul 10 02:49:21.763875 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.763856    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgl9s"
Jul 10 02:49:21.765944 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.765919    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q4fgt"]
Jul 10 02:49:21.766268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.766250    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 02:49:21.766910 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.766889    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-45zzw\""
Jul 10 02:49:21.767117 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.767102    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 02:49:21.767324 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.767301    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 02:49:21.767760 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.767730    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.770521 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.770066    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 02:49:21.770521 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.770218    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f756g\""
Jul 10 02:49:21.770521 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.770301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 02:49:21.770521 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.770306    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 02:49:21.771367 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.771345    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 02:49:21.774361 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.774344    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgl9s"]
Jul 10 02:49:21.778800 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.777914    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q4fgt"]
Jul 10 02:49:21.778800 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.778303    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5mg7v"]
Jul 10 02:49:21.781106 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.780348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.782904 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.782886    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 02:49:21.782992 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.782914    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 02:49:21.783064 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.783031    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l9gjz\""
Jul 10 02:49:21.790765 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.790749    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5mg7v"]
Jul 10 02:49:21.874493 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjhvg\" (UniqueName: \"kubernetes.io/projected/b472ff97-f489-424c-94da-975404734b2a-kube-api-access-wjhvg\") pod \"ingress-canary-sgl9s\" (UID: \"b472ff97-f489-424c-94da-975404734b2a\") " pod="openshift-ingress-canary/ingress-canary-sgl9s"
Jul 10 02:49:21.874493 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c91a3e50-db1a-4931-950d-cf4d214ebfd8-metrics-tls\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.874764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f95ed84-94f9-4184-9911-a9e29d38732e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.874764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c91a3e50-db1a-4931-950d-cf4d214ebfd8-config-volume\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.874764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4hk5\" (UniqueName: \"kubernetes.io/projected/c91a3e50-db1a-4931-950d-cf4d214ebfd8-kube-api-access-z4hk5\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.874764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b472ff97-f489-424c-94da-975404734b2a-cert\") pod \"ingress-canary-sgl9s\" (UID: \"b472ff97-f489-424c-94da-975404734b2a\") " pod="openshift-ingress-canary/ingress-canary-sgl9s"
Jul 10 02:49:21.874764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f95ed84-94f9-4184-9911-a9e29d38732e-data-volume\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.875022 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f95ed84-94f9-4184-9911-a9e29d38732e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.875022 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fgnd\" (UniqueName: \"kubernetes.io/projected/9f95ed84-94f9-4184-9911-a9e29d38732e-kube-api-access-8fgnd\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.875022 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91a3e50-db1a-4931-950d-cf4d214ebfd8-tmp-dir\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.875022 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.874924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f95ed84-94f9-4184-9911-a9e29d38732e-crio-socket\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.892160 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.892049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:21.945471 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.945443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:21.975513 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91a3e50-db1a-4931-950d-cf4d214ebfd8-tmp-dir\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.975663 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f95ed84-94f9-4184-9911-a9e29d38732e-crio-socket\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.975663 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjhvg\" (UniqueName: \"kubernetes.io/projected/b472ff97-f489-424c-94da-975404734b2a-kube-api-access-wjhvg\") pod \"ingress-canary-sgl9s\" (UID: \"b472ff97-f489-424c-94da-975404734b2a\") " pod="openshift-ingress-canary/ingress-canary-sgl9s"
Jul 10 02:49:21.975663 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c91a3e50-db1a-4931-950d-cf4d214ebfd8-metrics-tls\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.975663 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f95ed84-94f9-4184-9911-a9e29d38732e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.975663 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c91a3e50-db1a-4931-950d-cf4d214ebfd8-config-volume\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.975927 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f95ed84-94f9-4184-9911-a9e29d38732e-crio-socket\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.975927 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91a3e50-db1a-4931-950d-cf4d214ebfd8-tmp-dir\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.975927 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4hk5\" (UniqueName: \"kubernetes.io/projected/c91a3e50-db1a-4931-950d-cf4d214ebfd8-kube-api-access-z4hk5\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.976064 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.975955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b472ff97-f489-424c-94da-975404734b2a-cert\") pod \"ingress-canary-sgl9s\" (UID: \"b472ff97-f489-424c-94da-975404734b2a\") " pod="openshift-ingress-canary/ingress-canary-sgl9s"
Jul 10 02:49:21.976064 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.976007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f95ed84-94f9-4184-9911-a9e29d38732e-data-volume\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.976064 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.976048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f95ed84-94f9-4184-9911-a9e29d38732e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.976197 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.976076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fgnd\" (UniqueName: \"kubernetes.io/projected/9f95ed84-94f9-4184-9911-a9e29d38732e-kube-api-access-8fgnd\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.976197 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.976174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c91a3e50-db1a-4931-950d-cf4d214ebfd8-config-volume\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.976798 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.976453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f95ed84-94f9-4184-9911-a9e29d38732e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.976798 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.976535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f95ed84-94f9-4184-9911-a9e29d38732e-data-volume\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.980406 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.980384    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f95ed84-94f9-4184-9911-a9e29d38732e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.980488 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.980426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c91a3e50-db1a-4931-950d-cf4d214ebfd8-metrics-tls\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.980917 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.980899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b472ff97-f489-424c-94da-975404734b2a-cert\") pod \"ingress-canary-sgl9s\" (UID: \"b472ff97-f489-424c-94da-975404734b2a\") " pod="openshift-ingress-canary/ingress-canary-sgl9s"
Jul 10 02:49:21.985567 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.985544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fgnd\" (UniqueName: \"kubernetes.io/projected/9f95ed84-94f9-4184-9911-a9e29d38732e-kube-api-access-8fgnd\") pod \"insights-runtime-extractor-q4fgt\" (UID: \"9f95ed84-94f9-4184-9911-a9e29d38732e\") " pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:21.986249 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.986225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4hk5\" (UniqueName: \"kubernetes.io/projected/c91a3e50-db1a-4931-950d-cf4d214ebfd8-kube-api-access-z4hk5\") pod \"dns-default-5mg7v\" (UID: \"c91a3e50-db1a-4931-950d-cf4d214ebfd8\") " pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:21.986329 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:21.986314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjhvg\" (UniqueName: \"kubernetes.io/projected/b472ff97-f489-424c-94da-975404734b2a-kube-api-access-wjhvg\") pod \"ingress-canary-sgl9s\" (UID: \"b472ff97-f489-424c-94da-975404734b2a\") " pod="openshift-ingress-canary/ingress-canary-sgl9s"
Jul 10 02:49:22.077280 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.077244    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgl9s"
Jul 10 02:49:22.083271 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.083249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q4fgt"
Jul 10 02:49:22.089106 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.089084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:22.250910 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.250881    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgl9s"]
Jul 10 02:49:22.255416 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.255323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5mg7v"]
Jul 10 02:49:22.256243 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.256218    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q4fgt"]
Jul 10 02:49:22.256243 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:22.256231    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb472ff97_f489_424c_94da_975404734b2a.slice/crio-3b1e4d57a6ae2dad962c92cfbb55aca8858875571d2f4d011ec3c1360bbfe4e9 WatchSource:0}: Error finding container 3b1e4d57a6ae2dad962c92cfbb55aca8858875571d2f4d011ec3c1360bbfe4e9: Status 404 returned error can't find the container with id 3b1e4d57a6ae2dad962c92cfbb55aca8858875571d2f4d011ec3c1360bbfe4e9
Jul 10 02:49:22.259598 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:22.259572    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91a3e50_db1a_4931_950d_cf4d214ebfd8.slice/crio-225a86abd0234a9ee45fbf109c79bccee27859ab45acd2c41193df730fb2259c WatchSource:0}: Error finding container 225a86abd0234a9ee45fbf109c79bccee27859ab45acd2c41193df730fb2259c: Status 404 returned error can't find the container with id 225a86abd0234a9ee45fbf109c79bccee27859ab45acd2c41193df730fb2259c
Jul 10 02:49:22.260342 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:22.260318    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f95ed84_94f9_4184_9911_a9e29d38732e.slice/crio-26dcb25b68e158628abc2f2ef70b280c5c34895fb0c9e479e8e0342e8d8d6db0 WatchSource:0}: Error finding container 26dcb25b68e158628abc2f2ef70b280c5c34895fb0c9e479e8e0342e8d8d6db0: Status 404 returned error can't find the container with id 26dcb25b68e158628abc2f2ef70b280c5c34895fb0c9e479e8e0342e8d8d6db0
Jul 10 02:49:22.341889 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.341810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:22.342062 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.341816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:22.342062 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.341965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:22.344713 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.344637    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 02:49:22.344833 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.344644    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 02:49:22.344888 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.344875    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9j2r\""
Jul 10 02:49:22.344944 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.344918    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5msv\""
Jul 10 02:49:22.344995 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.344958    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 02:49:22.345049 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.345018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 02:49:22.546450 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.546414    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mg7v" event={"ID":"c91a3e50-db1a-4931-950d-cf4d214ebfd8","Type":"ContainerStarted","Data":"225a86abd0234a9ee45fbf109c79bccee27859ab45acd2c41193df730fb2259c"}
Jul 10 02:49:22.547723 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.547679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4fgt" event={"ID":"9f95ed84-94f9-4184-9911-a9e29d38732e","Type":"ContainerStarted","Data":"26dcb25b68e158628abc2f2ef70b280c5c34895fb0c9e479e8e0342e8d8d6db0"}
Jul 10 02:49:22.548822 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:22.548792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgl9s" event={"ID":"b472ff97-f489-424c-94da-975404734b2a","Type":"ContainerStarted","Data":"3b1e4d57a6ae2dad962c92cfbb55aca8858875571d2f4d011ec3c1360bbfe4e9"}
Jul 10 02:49:23.206105 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.206071    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75767f5c99-2qt65"]
Jul 10 02:49:23.210064 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.208524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.211541 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.211516    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 02:49:23.211782 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.211765    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fc9d5\""
Jul 10 02:49:23.212615 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.212594    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 02:49:23.212870 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.212847    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 02:49:23.213080 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.213061    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 02:49:23.214146 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.213772    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 02:49:23.221708 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.220660    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 02:49:23.221708 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.220895    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 02:49:23.228509 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.225664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:23.228509 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.227231    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75767f5c99-2qt65"]
Jul 10 02:49:23.228509 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.227724    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 02:49:23.288265 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.288232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-serving-cert\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.288442 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.288318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-oauth-serving-cert\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.288442 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.288351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-service-ca\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.288442 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.288387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-console-config\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.288442 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.288409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj42d\" (UniqueName: \"kubernetes.io/projected/beecd666-527c-47ed-bafd-427385f97608-kube-api-access-gj42d\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.288442 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.288436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-oauth-config\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.288722 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.288459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-trusted-ca-bundle\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.389552 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.389518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-oauth-serving-cert\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.389552 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.389569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-service-ca\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.389872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.389609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-console-config\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.389872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.389633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj42d\" (UniqueName: \"kubernetes.io/projected/beecd666-527c-47ed-bafd-427385f97608-kube-api-access-gj42d\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.389872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.389661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-oauth-config\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.389872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.389703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-trusted-ca-bundle\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.389872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.389767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-serving-cert\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.391710 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.390653    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-console-config\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.391710 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.391064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-oauth-serving-cert\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.391710 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.391642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-service-ca\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.392002 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.391981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-trusted-ca-bundle\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.399805 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.399765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-oauth-config\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.402304 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.402276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-serving-cert\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.402867 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.402826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj42d\" (UniqueName: \"kubernetes.io/projected/beecd666-527c-47ed-bafd-427385f97608-kube-api-access-gj42d\") pod \"console-75767f5c99-2qt65\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") " pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:23.529372 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:23.529291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:26.082082 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:26.081788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:26.157137 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:26.157109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:26.370506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:26.370474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:26.470479 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:26.470451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:26.998486 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:26.998456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:27.099110 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:27.099074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:29.357494 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:29.357462    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75767f5c99-2qt65"]
Jul 10 02:49:29.675005 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:29.674973    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeecd666_527c_47ed_bafd_427385f97608.slice/crio-30b20fdffedad04b243b59c1b9fd73332dfcc5fe4a466b4d2c1802b0646d5acc WatchSource:0}: Error finding container 30b20fdffedad04b243b59c1b9fd73332dfcc5fe4a466b4d2c1802b0646d5acc: Status 404 returned error can't find the container with id 30b20fdffedad04b243b59c1b9fd73332dfcc5fe4a466b4d2c1802b0646d5acc
Jul 10 02:49:29.755390 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:29.755359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:30.082643 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.082617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:30.574598 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.574097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mg7v" event={"ID":"c91a3e50-db1a-4931-950d-cf4d214ebfd8","Type":"ContainerStarted","Data":"ea5aae73302b0533648694036684fe27cf7e3b80bfee00ff4923f734af82a3bd"}
Jul 10 02:49:30.574598 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.574201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mg7v" event={"ID":"c91a3e50-db1a-4931-950d-cf4d214ebfd8","Type":"ContainerStarted","Data":"4bec6c60175e4f8acbb0ff7992eb5a25f8c5625cc4a1e42e9ad8aa03a9888df4"}
Jul 10 02:49:30.574598 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.574232    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:30.576824 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.576795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4fgt" event={"ID":"9f95ed84-94f9-4184-9911-a9e29d38732e","Type":"ContainerStarted","Data":"8e58920f5ba4ddf08bd0a68d7f095598992bfd74fe009555ea52d75f781d27e2"}
Jul 10 02:49:30.582086 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.581529    2578 generic.go:356] "Generic (PLEG): container finished" podID="32d11469-731f-41a0-86b3-8326bab87c44" containerID="693d5611bf262a09c3ac8f9781e909f78752b0f60629863527e1abe40d04504a" exitCode=0
Jul 10 02:49:30.582086 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.581614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hldvt" event={"ID":"32d11469-731f-41a0-86b3-8326bab87c44","Type":"ContainerDied","Data":"693d5611bf262a09c3ac8f9781e909f78752b0f60629863527e1abe40d04504a"}
Jul 10 02:49:30.583435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.583405    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75767f5c99-2qt65" event={"ID":"beecd666-527c-47ed-bafd-427385f97608","Type":"ContainerStarted","Data":"30b20fdffedad04b243b59c1b9fd73332dfcc5fe4a466b4d2c1802b0646d5acc"}
Jul 10 02:49:30.585442 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.585422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgl9s" event={"ID":"b472ff97-f489-424c-94da-975404734b2a","Type":"ContainerStarted","Data":"6c2df2c3922544435b1682247e19bfa6c5119fcf096c7d471bf54f27353d691e"}
Jul 10 02:49:30.595213 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.595177    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5mg7v" podStartSLOduration=2.18476057 podStartE2EDuration="9.595166048s" totalImagesPullingTime="7.410405478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:30.594563975 +0000 UTC m=+43.715762955" watchObservedRunningTime="2026-07-10 02:49:30.595166048 +0000 UTC m=+43.716365027"
Jul 10 02:49:30.612996 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.612951    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sgl9s" podStartSLOduration=2.198460785 podStartE2EDuration="9.612938594s" totalImagesPullingTime="7.414477809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:30.612399999 +0000 UTC m=+43.733598980" watchObservedRunningTime="2026-07-10 02:49:30.612938594 +0000 UTC m=+43.734137574"
Jul 10 02:49:30.805570 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.805536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:30.909787 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:30.909750    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:31.589790 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:31.589748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4fgt" event={"ID":"9f95ed84-94f9-4184-9911-a9e29d38732e","Type":"ContainerStarted","Data":"54faac1a6f12a86be846e8826cfa48e861f167ad7414ecf3fa895dbcc4419dc5"}
Jul 10 02:49:31.593147 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:31.593124    2578 generic.go:356] "Generic (PLEG): container finished" podID="32d11469-731f-41a0-86b3-8326bab87c44" containerID="994a7268379ccd0b37d73ba6d1a13efeb14bed78030047e492f3304b62134c84" exitCode=0
Jul 10 02:49:31.593364 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:31.593305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hldvt" event={"ID":"32d11469-731f-41a0-86b3-8326bab87c44","Type":"ContainerDied","Data":"994a7268379ccd0b37d73ba6d1a13efeb14bed78030047e492f3304b62134c84"}
Jul 10 02:49:32.211315 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.211273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:32.445667 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.445632    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:32.453805 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.453781    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"]
Jul 10 02:49:32.490567 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.490499    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"]
Jul 10 02:49:32.490726 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.490637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.493425 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.493398    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 10 02:49:32.493425 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.493403    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 02:49:32.493694 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.493496    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-72snh\""
Jul 10 02:49:32.494459 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.494438    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 02:49:32.494547 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.494489    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 10 02:49:32.494616 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.494552    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 02:49:32.497414 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.497390    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5wcmr"]
Jul 10 02:49:32.509941 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.509921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.512586 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.512564    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 02:49:32.512794 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.512767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 02:49:32.512892 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.512875    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z5cbw\""
Jul 10 02:49:32.513335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.513312    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 02:49:32.522164 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.522140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:32.667424 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9rfx\" (UniqueName: \"kubernetes.io/projected/d4f8a7bb-81c1-4f04-a764-7771d15416c9-kube-api-access-q9rfx\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.667789 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-root\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.667789 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.667789 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.667789 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-metrics-client-ca\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.667789 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf6pv\" (UniqueName: \"kubernetes.io/projected/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-kube-api-access-lf6pv\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.667789 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-tls\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.667789 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f8a7bb-81c1-4f04-a764-7771d15416c9-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.668012 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.668012 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-sys\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.668012 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.668012 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-wtmp\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.668012 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.667924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-textfile\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.745957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.745896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:32.769249 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9rfx\" (UniqueName: \"kubernetes.io/projected/d4f8a7bb-81c1-4f04-a764-7771d15416c9-kube-api-access-q9rfx\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.769373 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-root\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769373 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.769373 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769373 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-root\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769373 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-metrics-client-ca\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6pv\" (UniqueName: \"kubernetes.io/projected/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-kube-api-access-lf6pv\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-tls\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f8a7bb-81c1-4f04-a764-7771d15416c9-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:32.769484    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-sys\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:32.769538    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:32.769544    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-tls podName:d4f8a7bb-81c1-4f04-a764-7771d15416c9 nodeName:}" failed. No retries permitted until 2026-07-10 02:49:33.269524586 +0000 UTC m=+46.390723548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-mq7h8" (UID: "d4f8a7bb-81c1-4f04-a764-7771d15416c9") : secret "openshift-state-metrics-tls" not found
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-sys\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.769614 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:32.769592    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-tls podName:68f54298-fbc2-4358-b8c0-4e0f01d5f7fb nodeName:}" failed. No retries permitted until 2026-07-10 02:49:33.269577364 +0000 UTC m=+46.390776326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-tls") pod "node-exporter-5wcmr" (UID: "68f54298-fbc2-4358-b8c0-4e0f01d5f7fb") : secret "node-exporter-tls" not found
Jul 10 02:49:32.770084 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.770084 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-wtmp\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.770084 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-textfile\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.770084 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-wtmp\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.770084 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.770084 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.769998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-metrics-client-ca\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.770084 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.770029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-textfile\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.770352 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.770218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f8a7bb-81c1-4f04-a764-7771d15416c9-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.772547 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.772520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.772626 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.772606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.782703 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.782662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf6pv\" (UniqueName: \"kubernetes.io/projected/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-kube-api-access-lf6pv\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:32.783478 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.783461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9rfx\" (UniqueName: \"kubernetes.io/projected/d4f8a7bb-81c1-4f04-a764-7771d15416c9-kube-api-access-q9rfx\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:32.886266 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:32.886233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:33.061596 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.061524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:33.161124 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.161085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:33.273704 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.273655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:33.273881 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.273743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-tls\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:33.276347 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.276314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/68f54298-fbc2-4358-b8c0-4e0f01d5f7fb-node-exporter-tls\") pod \"node-exporter-5wcmr\" (UID: \"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb\") " pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:33.276519 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.276502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f8a7bb-81c1-4f04-a764-7771d15416c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-mq7h8\" (UID: \"d4f8a7bb-81c1-4f04-a764-7771d15416c9\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:33.402011 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.401760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"
Jul 10 02:49:33.419956 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.419924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wcmr"
Jul 10 02:49:33.440877 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.440850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:33.467109 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:33.467013    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f54298_fbc2_4358_b8c0_4e0f01d5f7fb.slice/crio-7290deb064f816a5f33cdaf3d928f25f2cbea7164bca70ecb24ba4068c96605c WatchSource:0}: Error finding container 7290deb064f816a5f33cdaf3d928f25f2cbea7164bca70ecb24ba4068c96605c: Status 404 returned error can't find the container with id 7290deb064f816a5f33cdaf3d928f25f2cbea7164bca70ecb24ba4068c96605c
Jul 10 02:49:33.518638 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.518568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:33.523347 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.523311    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:49:33.549447 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.549419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:49:33.549593 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.549580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.552592 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.552547    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 02:49:33.553440 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.552906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 02:49:33.553440 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.553045    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bd7qn\""
Jul 10 02:49:33.553440 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.553107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 02:49:33.553440 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.553065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 02:49:33.553440 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.553264    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 02:49:33.553759 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.553462    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 02:49:33.553759 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.553521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 02:49:33.553759 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.553756    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 02:49:33.553881 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.553794    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 02:49:33.578126 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.578099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8"]
Jul 10 02:49:33.583010 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:33.582985    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f8a7bb_81c1_4f04_a764_7771d15416c9.slice/crio-7474f2d0e8e19f844f8dfd9cb0680a774f324416875c7d81be1668195c499a82 WatchSource:0}: Error finding container 7474f2d0e8e19f844f8dfd9cb0680a774f324416875c7d81be1668195c499a82: Status 404 returned error can't find the container with id 7474f2d0e8e19f844f8dfd9cb0680a774f324416875c7d81be1668195c499a82
Jul 10 02:49:33.584381 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.584354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:33.599991 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.599965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wcmr" event={"ID":"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb","Type":"ContainerStarted","Data":"7290deb064f816a5f33cdaf3d928f25f2cbea7164bca70ecb24ba4068c96605c"}
Jul 10 02:49:33.601209 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.601188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8" event={"ID":"d4f8a7bb-81c1-4f04-a764-7771d15416c9","Type":"ContainerStarted","Data":"7474f2d0e8e19f844f8dfd9cb0680a774f324416875c7d81be1668195c499a82"}
Jul 10 02:49:33.605618 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.605593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hldvt" event={"ID":"32d11469-731f-41a0-86b3-8326bab87c44","Type":"ContainerStarted","Data":"a45dffa28d25e2b85f86f43f9276f3c6220e3ebc91a6055a0123d3d883bce9c7"}
Jul 10 02:49:33.607419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.607397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75767f5c99-2qt65" event={"ID":"beecd666-527c-47ed-bafd-427385f97608","Type":"ContainerStarted","Data":"2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4"}
Jul 10 02:49:33.625894 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.625846    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hldvt" podStartSLOduration=10.088611228 podStartE2EDuration="46.625830708s" totalImagesPullingTime="36.53721948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:33.624524013 +0000 UTC m=+46.745722996" watchObservedRunningTime="2026-07-10 02:49:33.625830708 +0000 UTC m=+46.747029692"
Jul 10 02:49:33.643464 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.643422    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75767f5c99-2qt65" podStartSLOduration=7.407514421 podStartE2EDuration="10.643410516s" totalImagesPullingTime="3.235896095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:33.642263382 +0000 UTC m=+46.763462362" watchObservedRunningTime="2026-07-10 02:49:33.643410516 +0000 UTC m=+46.764609474"
Jul 10 02:49:33.676737 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.676711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.676748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-config-out\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.676832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.676890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.676937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-config-volume\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.676961    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.676986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.677043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxbn7\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-kube-api-access-hxbn7\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.677099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.677125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-web-config\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.677151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677790 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.677225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.677790 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.677260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.759561 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.759533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:33.778221 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-config-out\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778221 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778379 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778379 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-config-volume\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778482 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778482 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778482 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxbn7\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-kube-api-access-hxbn7\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778635 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778635 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-web-config\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778635 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778800 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778800 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.778800 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.778794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.780256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.779216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.780256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.779579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.780256 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:33.779979    2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 10 02:49:33.780256 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:33.780055    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls podName:10c21c2f-c337-4234-b028-bfe2291f8881 nodeName:}" failed. No retries permitted until 2026-07-10 02:49:34.2800341 +0000 UTC m=+47.401233061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881") : secret "alertmanager-main-tls" not found
Jul 10 02:49:33.781784 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.780529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.781784 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.781750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.781939 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.781910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-web-config\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.782102 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.782018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.782102 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.782095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-config-out\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.782974 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.782948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-config-volume\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.783859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.783831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.784375 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.784338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.784445 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.784373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.795051 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.795032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxbn7\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-kube-api-access-hxbn7\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:33.855790 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.855754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:33.956158 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:33.956127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:34.056963 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:34.056912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:34.115073 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:34.115038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:34.283612 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:34.283524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:34.286628 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:34.286596    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:34.462180 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:34.462139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:49:34.613727 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:34.613620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8" event={"ID":"d4f8a7bb-81c1-4f04-a764-7771d15416c9","Type":"ContainerStarted","Data":"4afbc4cb7e09e1bf51f64eac9e10fa8f8a7fb2d929ef4809852d601e717ae1eb"}
Jul 10 02:49:34.613885 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:34.613731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8" event={"ID":"d4f8a7bb-81c1-4f04-a764-7771d15416c9","Type":"ContainerStarted","Data":"73538ea31fd1c54b987179ef6da429c7edbf9d3058042a6edcb9e483885a3341"}
Jul 10 02:49:35.373488 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.373454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:35.438604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.438552    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"]
Jul 10 02:49:35.440292 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.440266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:35.469139 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.469118    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"]
Jul 10 02:49:35.469274 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.469255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.472232 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.472213    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 10 02:49:35.472341 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.472254    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 10 02:49:35.472341 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.472301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 10 02:49:35.472341 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.472322    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dod4qp76qjsai\""
Jul 10 02:49:35.472505 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.472217    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 10 02:49:35.472505 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.472215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wcmfb\""
Jul 10 02:49:35.472634 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.472563    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 10 02:49:35.596503 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.596470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.596645 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.596520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-tls\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.596645 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.596562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.596645 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.596605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-grpc-tls\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.596645 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.596636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-metrics-client-ca\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.596837 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.596662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.596837 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.596720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmnwb\" (UniqueName: \"kubernetes.io/projected/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-kube-api-access-zmnwb\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.596837 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.596793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.697305 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.697269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.697453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.697326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-tls\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.697453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.697353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.697557 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.697524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-grpc-tls\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.697616 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.697567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-metrics-client-ca\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.697667 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.697612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.697667 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.697650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmnwb\" (UniqueName: \"kubernetes.io/projected/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-kube-api-access-zmnwb\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.697782 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.697746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.698648 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.698617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-metrics-client-ca\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.700200 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.700178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-tls\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.700297 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.700177    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.700747 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.700721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.700852 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.700748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.700852 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.700747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.701031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.701012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-secret-grpc-tls\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.705197 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.705178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmnwb\" (UniqueName: \"kubernetes.io/projected/cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9-kube-api-access-zmnwb\") pod \"thanos-querier-67ccd95c9b-rggp8\" (UID: \"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9\") " pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.778660 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.778627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:35.868702 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:35.868650    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:36.089563 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.089533    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"]
Jul 10 02:49:36.093291 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:36.093255    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf0db97_a2b0_47dd_97ec_cb4e8ddd49b9.slice/crio-94febb840955bb8955e8c09284a6ce19c9ea286739d63d6077035d3e20ca14d5 WatchSource:0}: Error finding container 94febb840955bb8955e8c09284a6ce19c9ea286739d63d6077035d3e20ca14d5: Status 404 returned error can't find the container with id 94febb840955bb8955e8c09284a6ce19c9ea286739d63d6077035d3e20ca14d5
Jul 10 02:49:36.116315 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.116295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:49:36.119553 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:36.119521    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c21c2f_c337_4234_b028_bfe2291f8881.slice/crio-401738b39aa36d8e2c07b5e2617fb5c8b858d007b536446a7a5941c18adefa57 WatchSource:0}: Error finding container 401738b39aa36d8e2c07b5e2617fb5c8b858d007b536446a7a5941c18adefa57: Status 404 returned error can't find the container with id 401738b39aa36d8e2c07b5e2617fb5c8b858d007b536446a7a5941c18adefa57
Jul 10 02:49:36.430422 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.430338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:36.621930 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.621894    2578 generic.go:356] "Generic (PLEG): container finished" podID="68f54298-fbc2-4358-b8c0-4e0f01d5f7fb" containerID="efbd5ee34f8290a0b9de735dbdfcb963fba0f6d73bf7efa4e1a1ae2e410f013d" exitCode=0
Jul 10 02:49:36.622085 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.621969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wcmr" event={"ID":"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb","Type":"ContainerDied","Data":"efbd5ee34f8290a0b9de735dbdfcb963fba0f6d73bf7efa4e1a1ae2e410f013d"}
Jul 10 02:49:36.623156 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.623134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8" event={"ID":"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9","Type":"ContainerStarted","Data":"94febb840955bb8955e8c09284a6ce19c9ea286739d63d6077035d3e20ca14d5"}
Jul 10 02:49:36.625026 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.625002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4fgt" event={"ID":"9f95ed84-94f9-4184-9911-a9e29d38732e","Type":"ContainerStarted","Data":"88e810d40462df698bdf15b29ad5d81531577cb0975e2b4e43b3cfc483b35310"}
Jul 10 02:49:36.626082 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.626064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerStarted","Data":"401738b39aa36d8e2c07b5e2617fb5c8b858d007b536446a7a5941c18adefa57"}
Jul 10 02:49:36.662532 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:36.662485    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q4fgt" podStartSLOduration=2.213139312 podStartE2EDuration="15.662471792s" totalImagesPullingTime="13.44933248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:49:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:36.662287386 +0000 UTC m=+49.783486369" watchObservedRunningTime="2026-07-10 02:49:36.662471792 +0000 UTC m=+49.783670772"
Jul 10 02:49:37.239660 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.239623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:37.243083 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.243052    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"]
Jul 10 02:49:37.262006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.261472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:37.262006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.261668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"]
Jul 10 02:49:37.264326 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.264087    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 10 02:49:37.264326 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.264105    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jswnf\""
Jul 10 02:49:37.282962 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.282939    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9cd99648c-fqbxj"]
Jul 10 02:49:37.307713 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.307666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9cd99648c-fqbxj"]
Jul 10 02:49:37.307857 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.307803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.312717 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.312668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-console-config\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.312858 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.312777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-trusted-ca-bundle\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.312858 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.312813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zvnch\" (UID: \"80b17993-acec-404d-bc39-37034d43bbaa\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:37.312858 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.312849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47bx6\" (UniqueName: \"kubernetes.io/projected/469f68aa-d42f-4e71-8c82-baed335edbec-kube-api-access-47bx6\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.313020 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.312875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-oauth-serving-cert\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.313020 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.312924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-oauth-config\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.313020 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.312975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlrp8\" (UniqueName: \"kubernetes.io/projected/80b17993-acec-404d-bc39-37034d43bbaa-kube-api-access-mlrp8\") pod \"monitoring-plugin-5f68df7f58-zvnch\" (UID: \"80b17993-acec-404d-bc39-37034d43bbaa\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:37.313125 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.313078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-service-ca\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.313169 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.313120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-serving-cert\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.326767 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.326738    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.413842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-oauth-config\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.413894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlrp8\" (UniqueName: \"kubernetes.io/projected/80b17993-acec-404d-bc39-37034d43bbaa-kube-api-access-mlrp8\") pod \"monitoring-plugin-5f68df7f58-zvnch\" (UID: \"80b17993-acec-404d-bc39-37034d43bbaa\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.413960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-service-ca\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.413996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-serving-cert\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.414031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-console-config\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.414083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-trusted-ca-bundle\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.414111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zvnch\" (UID: \"80b17993-acec-404d-bc39-37034d43bbaa\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.414143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47bx6\" (UniqueName: \"kubernetes.io/projected/469f68aa-d42f-4e71-8c82-baed335edbec-kube-api-access-47bx6\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.414163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-oauth-serving-cert\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415099 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:37.415111    2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 10 02:49:37.415711 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:37.415174    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert podName:80b17993-acec-404d-bc39-37034d43bbaa nodeName:}" failed. No retries permitted until 2026-07-10 02:49:37.915154966 +0000 UTC m=+51.036353928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-zvnch" (UID: "80b17993-acec-404d-bc39-37034d43bbaa") : secret "monitoring-plugin-cert" not found
Jul 10 02:49:37.415711 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.415563    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-console-config\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415711 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.415620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-trusted-ca-bundle\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.415970 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.415944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-service-ca\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.416156 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.416115    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-oauth-serving-cert\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.418039 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.417995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-oauth-config\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.418717 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.418676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-serving-cert\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.425193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.425170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47bx6\" (UniqueName: \"kubernetes.io/projected/469f68aa-d42f-4e71-8c82-baed335edbec-kube-api-access-47bx6\") pod \"console-9cd99648c-fqbxj\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") " pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.426827 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.426807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlrp8\" (UniqueName: \"kubernetes.io/projected/80b17993-acec-404d-bc39-37034d43bbaa-kube-api-access-mlrp8\") pod \"monitoring-plugin-5f68df7f58-zvnch\" (UID: \"80b17993-acec-404d-bc39-37034d43bbaa\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:37.618855 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.618778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:37.633122 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.633090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wcmr" event={"ID":"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb","Type":"ContainerStarted","Data":"beca1b9722eef185790ff2671e421243d5140210aef7a5dd395138577af40ce8"}
Jul 10 02:49:37.633285 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.633137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wcmr" event={"ID":"68f54298-fbc2-4358-b8c0-4e0f01d5f7fb","Type":"ContainerStarted","Data":"b3e3e1c202238600c9fd3e338d7a41fcb571e3b9be20fedd3ceae047d3bc44c7"}
Jul 10 02:49:37.635263 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.635237    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8" event={"ID":"d4f8a7bb-81c1-4f04-a764-7771d15416c9","Type":"ContainerStarted","Data":"b0fca32b639d7aa8efdda7ede9bcb06043436820835d4628ea25ee81a1b16639"}
Jul 10 02:49:37.651128 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.651079    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5wcmr" podStartSLOduration=3.079307062 podStartE2EDuration="5.651046541s" totalImagesPullingTime="2.465022486s" totalInitContainerRuntime="106.716993ms" isStatefulPod=true podCreationTimestamp="2026-07-10 02:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:37.649755383 +0000 UTC m=+50.770954359" watchObservedRunningTime="2026-07-10 02:49:37.651046541 +0000 UTC m=+50.772245521"
Jul 10 02:49:37.666518 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.666468    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mq7h8" podStartSLOduration=2.86850251 podStartE2EDuration="5.666453662s" totalImagesPullingTime="2.797951152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:37.666291001 +0000 UTC m=+50.787489982" watchObservedRunningTime="2026-07-10 02:49:37.666453662 +0000 UTC m=+50.787652642"
Jul 10 02:49:37.765695 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.765646    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9cd99648c-fqbxj"]
Jul 10 02:49:37.877783 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:37.877710    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469f68aa_d42f_4e71_8c82_baed335edbec.slice/crio-45e32cbf0088f1034914e84f652889bb63cce019ef6d5ddfe16331af4f90b8ff WatchSource:0}: Error finding container 45e32cbf0088f1034914e84f652889bb63cce019ef6d5ddfe16331af4f90b8ff: Status 404 returned error can't find the container with id 45e32cbf0088f1034914e84f652889bb63cce019ef6d5ddfe16331af4f90b8ff
Jul 10 02:49:37.921993 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:37.921959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zvnch\" (UID: \"80b17993-acec-404d-bc39-37034d43bbaa\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:37.922105 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:37.922082    2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 10 02:49:37.922162 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:49:37.922131    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert podName:80b17993-acec-404d-bc39-37034d43bbaa nodeName:}" failed. No retries permitted until 2026-07-10 02:49:38.922115772 +0000 UTC m=+52.043314757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-zvnch" (UID: "80b17993-acec-404d-bc39-37034d43bbaa") : secret "monitoring-plugin-cert" not found
Jul 10 02:49:38.084331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.084298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:38.421080 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.421030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:38.520909 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.520811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:38.630750 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.630722    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:49:38.631147 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.631044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:38.641877 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.641856    2578 generic.go:356] "Generic (PLEG): container finished" podID="10c21c2f-c337-4234-b028-bfe2291f8881" containerID="c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906" exitCode=0
Jul 10 02:49:38.654897 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.654869    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:49:38.654980 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.654926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cd99648c-fqbxj" event={"ID":"469f68aa-d42f-4e71-8c82-baed335edbec","Type":"ContainerStarted","Data":"2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146"}
Jul 10 02:49:38.654980 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.654950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cd99648c-fqbxj" event={"ID":"469f68aa-d42f-4e71-8c82-baed335edbec","Type":"ContainerStarted","Data":"45e32cbf0088f1034914e84f652889bb63cce019ef6d5ddfe16331af4f90b8ff"}
Jul 10 02:49:38.654980 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.654963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerDied","Data":"c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906"}
Jul 10 02:49:38.655091 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.655074    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.657965 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.657942    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 02:49:38.658077 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.657977    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 02:49:38.658077 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.658060    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 02:49:38.658196 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.658121    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 02:49:38.658252 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.658230    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 02:49:38.658370 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.658355    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 02:49:38.658909 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.658887    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 02:49:38.659000 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.658891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 02:49:38.659000 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.658945    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5j6pr\""
Jul 10 02:49:38.659000 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.658952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 02:49:38.659172 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.659135    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 02:49:38.659393 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.659375    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 02:49:38.659393 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.659392    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8g5rm3efgn426\""
Jul 10 02:49:38.660204 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.659881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 02:49:38.660204 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.659891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 02:49:38.663845 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.663822    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 02:49:38.665500 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.665428    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9cd99648c-fqbxj" podStartSLOduration=1.6654129439999998 podStartE2EDuration="1.665412944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:38.665193268 +0000 UTC m=+51.786392277" watchObservedRunningTime="2026-07-10 02:49:38.665412944 +0000 UTC m=+51.786611927"
Jul 10 02:49:38.665864 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.665834    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 02:49:38.730734 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.730711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-config\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.730882 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.730747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.730882 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.730774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731026 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.730927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731026 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.730956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731026 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.730974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrq2\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-kube-api-access-zzrq2\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731026 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.730990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731026 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731266 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731266 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731266 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731422 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731422 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731609 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731726 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731726 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.731818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.731795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.732185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.732168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833013 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.832982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833013 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833256 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-config\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrq2\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-kube-api-access-zzrq2\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.833715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.834364 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.834364 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.833900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.834465 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.834405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.834728 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.834699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.834977 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.834953    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.835227 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.835200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.836302 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.836112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.836302 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.836208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.836445 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.836343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.836930 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.836906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.837136 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.837111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.838122 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.838096    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.838879 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.838856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-config\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.838975 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.838862    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.839092 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.839066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.839261 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.839224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.839427 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.839405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.839617 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.839602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.839992 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.839976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.846541 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.846522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrq2\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-kube-api-access-zzrq2\") pod \"prometheus-k8s-0\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:38.934705 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.934657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zvnch\" (UID: \"80b17993-acec-404d-bc39-37034d43bbaa\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:38.937100 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.937076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80b17993-acec-404d-bc39-37034d43bbaa-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zvnch\" (UID: \"80b17993-acec-404d-bc39-37034d43bbaa\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:38.954034 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.954002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:38.967112 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:38.967082    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:39.006922 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.006894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:39.073906 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.073203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:39.221573 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.221547    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:49:39.224163 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:39.224139    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac61e721_07fb_4444_8bbc_61bad656c452.slice/crio-33e03a3f74457cc1e1d6fafd7587b580d9ccea5ca2bda8479ae73f2a25515819 WatchSource:0}: Error finding container 33e03a3f74457cc1e1d6fafd7587b580d9ccea5ca2bda8479ae73f2a25515819: Status 404 returned error can't find the container with id 33e03a3f74457cc1e1d6fafd7587b580d9ccea5ca2bda8479ae73f2a25515819
Jul 10 02:49:39.227678 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.227657    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"]
Jul 10 02:49:39.230716 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:39.230676    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b17993_acec_404d_bc39_37034d43bbaa.slice/crio-cd19dd9d1a057bf702f309956bbf55151d56767760bc63ff060dcb48b39d2f57 WatchSource:0}: Error finding container cd19dd9d1a057bf702f309956bbf55151d56767760bc63ff060dcb48b39d2f57: Status 404 returned error can't find the container with id cd19dd9d1a057bf702f309956bbf55151d56767760bc63ff060dcb48b39d2f57
Jul 10 02:49:39.646911 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.646820    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac61e721-07fb-4444-8bbc-61bad656c452" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db" exitCode=0
Jul 10 02:49:39.647342 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.646920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerDied","Data":"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"}
Jul 10 02:49:39.647342 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.647052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerStarted","Data":"33e03a3f74457cc1e1d6fafd7587b580d9ccea5ca2bda8479ae73f2a25515819"}
Jul 10 02:49:39.649149 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.649109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8" event={"ID":"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9","Type":"ContainerStarted","Data":"9f6ff15f6ea20cce065dfcf3ddb176e6331fe333d174ffd9347f19a616ca9911"}
Jul 10 02:49:39.649259 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.649225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8" event={"ID":"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9","Type":"ContainerStarted","Data":"f1d9cc949bd8518b93a4e058c774386ac6e49ffda2e943a6e5a499c26e29478b"}
Jul 10 02:49:39.649304 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.649270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8" event={"ID":"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9","Type":"ContainerStarted","Data":"95c7f8b1fb4bbe5fd962d091a50c69d830b971487010faf72bed9114e17da363"}
Jul 10 02:49:39.650330 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:39.650300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch" event={"ID":"80b17993-acec-404d-bc39-37034d43bbaa","Type":"ContainerStarted","Data":"cd19dd9d1a057bf702f309956bbf55151d56767760bc63ff060dcb48b39d2f57"}
Jul 10 02:49:40.596244 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:40.596216    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5mg7v"
Jul 10 02:49:41.004445 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.004411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:41.101373 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.101336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:41.663961 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.663918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8" event={"ID":"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9","Type":"ContainerStarted","Data":"fa529a03a2f1aab87286c822736e646c2e74544cf85d8a57bf839be208862f6b"}
Jul 10 02:49:41.664134 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.664006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8" event={"ID":"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9","Type":"ContainerStarted","Data":"1b2e2400552bad7403a443dddd11b5f24813a7de1c51c4a1d54a78645126a704"}
Jul 10 02:49:41.664134 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.664036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8" event={"ID":"cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9","Type":"ContainerStarted","Data":"7efbad55d97ece34f41454347ab10ae057be763559382f8122c0feff29f3d558"}
Jul 10 02:49:41.664134 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.664063    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:41.668167 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.668138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerStarted","Data":"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced"}
Jul 10 02:49:41.668288 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.668211    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerStarted","Data":"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1"}
Jul 10 02:49:41.668288 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.668252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerStarted","Data":"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96"}
Jul 10 02:49:41.668374 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.668296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerStarted","Data":"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82"}
Jul 10 02:49:41.668374 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.668326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerStarted","Data":"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b"}
Jul 10 02:49:41.668374 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.668357    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerStarted","Data":"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99"}
Jul 10 02:49:41.669749 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.669721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch" event={"ID":"80b17993-acec-404d-bc39-37034d43bbaa","Type":"ContainerStarted","Data":"8e3be5967f7d5993f24523f8de18b3f45650ed97b97beef0acbbcd61cd0a1f68"}
Jul 10 02:49:41.670266 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.670108    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:41.676144 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.676113    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch"
Jul 10 02:49:41.686590 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.686520    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8" podStartSLOduration=2.070450101 podStartE2EDuration="6.686505848s" totalImagesPullingTime="4.616055747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:41.685567354 +0000 UTC m=+54.806766364" watchObservedRunningTime="2026-07-10 02:49:41.686505848 +0000 UTC m=+54.807704828"
Jul 10 02:49:41.709761 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.709720    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.428554932 podStartE2EDuration="8.709678464s" totalImagesPullingTime="4.256756576s" totalInitContainerRuntime="24.366956ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:41.70800567 +0000 UTC m=+54.829204681" watchObservedRunningTime="2026-07-10 02:49:41.709678464 +0000 UTC m=+54.830877455"
Jul 10 02:49:41.725054 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:41.724998    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zvnch" podStartSLOduration=2.8365230710000002 podStartE2EDuration="4.72497993s" totalImagesPullingTime="1.888456859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:41.723385389 +0000 UTC m=+54.844584368" watchObservedRunningTime="2026-07-10 02:49:41.72497993 +0000 UTC m=+54.846178914"
Jul 10 02:49:42.135515 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:42.135487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:42.191885 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:42.191845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:42.908152 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:42.908114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:42.957263 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:42.957230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:43.052718 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.052657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:43.153140 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.153104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:43.530282 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.530243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:43.530476 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.530342    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:43.535151 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.535134    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:43.680522 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.680436    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerStarted","Data":"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"}
Jul 10 02:49:43.680522 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.680511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerStarted","Data":"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"}
Jul 10 02:49:43.680746 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.680541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerStarted","Data":"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"}
Jul 10 02:49:43.680746 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.680568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerStarted","Data":"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"}
Jul 10 02:49:43.680746 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.680597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerStarted","Data":"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"}
Jul 10 02:49:43.680746 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.680624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerStarted","Data":"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"}
Jul 10 02:49:43.684447 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.684422    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:49:43.712429 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.712383    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.292700722 podStartE2EDuration="5.71236978s" totalImagesPullingTime="3.394419777s" totalInitContainerRuntime="25.249281ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:43.71098257 +0000 UTC m=+56.832181577" watchObservedRunningTime="2026-07-10 02:49:43.71236978 +0000 UTC m=+56.833568759"
Jul 10 02:49:43.967219 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:43.967190    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:49:45.036480 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:45.036445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:45.139127 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:45.139095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:45.236025 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:45.235992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:45.336467 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:45.336384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:45.822470 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:45.822432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:45.919635 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:45.919598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:47.549861 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.549835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpldh"
Jul 10 02:49:47.619001 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.618975    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:47.619120 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.619031    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:47.623720 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.623699    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:47.680338 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.680309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67ccd95c9b-rggp8"
Jul 10 02:49:47.690961 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.690938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:47.699316 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.699300    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:49:47.752154 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.752125    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75767f5c99-2qt65"]
Jul 10 02:49:47.781429 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.781397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:47.893359 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.893291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:47.987576 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:47.987551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:48.087566 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:48.087540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:48.142591 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:48.142569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:48.247229 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:48.247200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:48.347535 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:48.347508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:49.020305 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:49.020275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:49.121126 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:49.121100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:50.079534 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:50.079500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:50.134341 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:50.134310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:52.969739 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:52.969671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:52.972608 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:52.972585    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 02:49:52.983093 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:52.983070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/128b98af-e789-4aa2-a300-f7bc264afc7e-original-pull-secret\") pod \"global-pull-secret-syncer-mncdm\" (UID: \"128b98af-e789-4aa2-a300-f7bc264afc7e\") " pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:53.070911 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.070877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:53.071032 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.070919    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:53.073652 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.073635    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 02:49:53.073727 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.073654    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 02:49:53.083861 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.083843    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 02:49:53.084008 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.083985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96df90f3-2b21-40e8-ab9a-cab5310d7fb6-metrics-certs\") pod \"network-metrics-daemon-zx4tf\" (UID: \"96df90f3-2b21-40e8-ab9a-cab5310d7fb6\") " pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:53.093976 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.093949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sh9n\" (UniqueName: \"kubernetes.io/projected/aa1ef0bd-941a-48cf-86f8-f6864eefd594-kube-api-access-5sh9n\") pod \"network-check-target-99nw9\" (UID: \"aa1ef0bd-941a-48cf-86f8-f6864eefd594\") " pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:53.252567 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.252496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mncdm"
Jul 10 02:49:53.261902 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.261887    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5msv\""
Jul 10 02:49:53.267933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.267916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9j2r\""
Jul 10 02:49:53.269752 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.269733    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zx4tf"
Jul 10 02:49:53.276912 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.276890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:53.402775 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.401049    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mncdm"]
Jul 10 02:49:53.403741 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:53.403716    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128b98af_e789_4aa2_a300_f7bc264afc7e.slice/crio-57e3415d9663bfc5842b86f82aae1b63195cf6377d301567bfbe4c18a245de60 WatchSource:0}: Error finding container 57e3415d9663bfc5842b86f82aae1b63195cf6377d301567bfbe4c18a245de60: Status 404 returned error can't find the container with id 57e3415d9663bfc5842b86f82aae1b63195cf6377d301567bfbe4c18a245de60
Jul 10 02:49:53.418905 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.418879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zx4tf"]
Jul 10 02:49:53.421421 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:53.421392    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96df90f3_2b21_40e8_ab9a_cab5310d7fb6.slice/crio-27d1c7098714d25f9331d1c4d8872fcc7bd0ff8c92c45f4a135c1833c0f26f34 WatchSource:0}: Error finding container 27d1c7098714d25f9331d1c4d8872fcc7bd0ff8c92c45f4a135c1833c0f26f34: Status 404 returned error can't find the container with id 27d1c7098714d25f9331d1c4d8872fcc7bd0ff8c92c45f4a135c1833c0f26f34
Jul 10 02:49:53.437337 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.437318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99nw9"]
Jul 10 02:49:53.439728 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:49:53.439709    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1ef0bd_941a_48cf_86f8_f6864eefd594.slice/crio-cb01871860f8614f1c295fd0e3a687c95bd0daa7a0bd3d2f56ff6b738d73e1b3 WatchSource:0}: Error finding container cb01871860f8614f1c295fd0e3a687c95bd0daa7a0bd3d2f56ff6b738d73e1b3: Status 404 returned error can't find the container with id cb01871860f8614f1c295fd0e3a687c95bd0daa7a0bd3d2f56ff6b738d73e1b3
Jul 10 02:49:53.717900 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.717872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99nw9" event={"ID":"aa1ef0bd-941a-48cf-86f8-f6864eefd594","Type":"ContainerStarted","Data":"cb01871860f8614f1c295fd0e3a687c95bd0daa7a0bd3d2f56ff6b738d73e1b3"}
Jul 10 02:49:53.719066 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.719028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx4tf" event={"ID":"96df90f3-2b21-40e8-ab9a-cab5310d7fb6","Type":"ContainerStarted","Data":"27d1c7098714d25f9331d1c4d8872fcc7bd0ff8c92c45f4a135c1833c0f26f34"}
Jul 10 02:49:53.720262 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:53.720237    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mncdm" event={"ID":"128b98af-e789-4aa2-a300-f7bc264afc7e","Type":"ContainerStarted","Data":"57e3415d9663bfc5842b86f82aae1b63195cf6377d301567bfbe4c18a245de60"}
Jul 10 02:49:54.729128 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:54.729042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx4tf" event={"ID":"96df90f3-2b21-40e8-ab9a-cab5310d7fb6","Type":"ContainerStarted","Data":"5d5159c76a3d9e97d01f93f0aa6542528195585d8961bb8d08d2f5e51e829728"}
Jul 10 02:49:55.736804 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:55.736731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zx4tf" event={"ID":"96df90f3-2b21-40e8-ab9a-cab5310d7fb6","Type":"ContainerStarted","Data":"794cf73af80323e4e921f4787a9e93cdbc3c4956a84705785f3790f87a73be86"}
Jul 10 02:49:55.753768 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:55.753717    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zx4tf" podStartSLOduration=67.614861037 podStartE2EDuration="1m8.75370275s" totalImagesPullingTime="1.138841713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:55.752386308 +0000 UTC m=+68.873585289" watchObservedRunningTime="2026-07-10 02:49:55.75370275 +0000 UTC m=+68.874901728"
Jul 10 02:49:55.841247 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:55.841195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:55.942430 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:55.942401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:56.004382 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:56.004267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:57.061043 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:57.061008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:59.754431 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:59.754401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99nw9" event={"ID":"aa1ef0bd-941a-48cf-86f8-f6864eefd594","Type":"ContainerStarted","Data":"30372ddd6853894b7bb67e2f50705405edf02116f0dd0b977bd16f8493969046"}
Jul 10 02:49:59.754872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:59.754536    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:49:59.755983 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:59.755961    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mncdm" event={"ID":"128b98af-e789-4aa2-a300-f7bc264afc7e","Type":"ContainerStarted","Data":"8cd138500abb5b3af0d7a1e9e29255aebf523366a7b32f7c7fd5532ecb32f932"}
Jul 10 02:49:59.770591 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:59.770541    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-99nw9" podStartSLOduration=67.440755915 podStartE2EDuration="1m12.770526015s" totalImagesPullingTime="5.3297701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:59.769486289 +0000 UTC m=+72.890685270" watchObservedRunningTime="2026-07-10 02:49:59.770526015 +0000 UTC m=+72.891724996"
Jul 10 02:49:59.785157 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:49:59.785121    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mncdm" podStartSLOduration=67.409009155 podStartE2EDuration="1m12.785111907s" totalImagesPullingTime="5.376102752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:59.784394477 +0000 UTC m=+72.905593470" watchObservedRunningTime="2026-07-10 02:49:59.785111907 +0000 UTC m=+72.906310887"
Jul 10 02:50:04.020306 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:04.020271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:04.077180 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:04.077154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:12.772808 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:12.772631    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75767f5c99-2qt65" podUID="beecd666-527c-47ed-bafd-427385f97608" containerName="console" containerID="cri-o://2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4" gracePeriod=15
Jul 10 02:50:13.045177 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.045150    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:50:13.140097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-service-ca\") pod \"beecd666-527c-47ed-bafd-427385f97608\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") "
Jul 10 02:50:13.140275 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140114    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-oauth-config\") pod \"beecd666-527c-47ed-bafd-427385f97608\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") "
Jul 10 02:50:13.140275 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj42d\" (UniqueName: \"kubernetes.io/projected/beecd666-527c-47ed-bafd-427385f97608-kube-api-access-gj42d\") pod \"beecd666-527c-47ed-bafd-427385f97608\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") "
Jul 10 02:50:13.140275 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140187    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-trusted-ca-bundle\") pod \"beecd666-527c-47ed-bafd-427385f97608\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") "
Jul 10 02:50:13.140275 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140219    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-console-config\") pod \"beecd666-527c-47ed-bafd-427385f97608\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") "
Jul 10 02:50:13.140485 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140373    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-oauth-serving-cert\") pod \"beecd666-527c-47ed-bafd-427385f97608\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") "
Jul 10 02:50:13.140485 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140433    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-service-ca" (OuterVolumeSpecName: "service-ca") pod "beecd666-527c-47ed-bafd-427385f97608" (UID: "beecd666-527c-47ed-bafd-427385f97608"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:13.140485 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-serving-cert\") pod \"beecd666-527c-47ed-bafd-427385f97608\" (UID: \"beecd666-527c-47ed-bafd-427385f97608\") "
Jul 10 02:50:13.140620 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140540    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-console-config" (OuterVolumeSpecName: "console-config") pod "beecd666-527c-47ed-bafd-427385f97608" (UID: "beecd666-527c-47ed-bafd-427385f97608"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:13.140620 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140585    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "beecd666-527c-47ed-bafd-427385f97608" (UID: "beecd666-527c-47ed-bafd-427385f97608"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:13.140796 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140764    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "beecd666-527c-47ed-bafd-427385f97608" (UID: "beecd666-527c-47ed-bafd-427385f97608"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:13.140870 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140776    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-trusted-ca-bundle\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:13.140870 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140820    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-console-config\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:13.140870 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.140832    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-service-ca\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:13.142865 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.142815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "beecd666-527c-47ed-bafd-427385f97608" (UID: "beecd666-527c-47ed-bafd-427385f97608"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:13.142865 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.142679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beecd666-527c-47ed-bafd-427385f97608-kube-api-access-gj42d" (OuterVolumeSpecName: "kube-api-access-gj42d") pod "beecd666-527c-47ed-bafd-427385f97608" (UID: "beecd666-527c-47ed-bafd-427385f97608"). InnerVolumeSpecName "kube-api-access-gj42d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:50:13.142865 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.142849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "beecd666-527c-47ed-bafd-427385f97608" (UID: "beecd666-527c-47ed-bafd-427385f97608"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:13.241583 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.241552    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj42d\" (UniqueName: \"kubernetes.io/projected/beecd666-527c-47ed-bafd-427385f97608-kube-api-access-gj42d\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:13.241583 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.241580    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/beecd666-527c-47ed-bafd-427385f97608-oauth-serving-cert\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:13.241583 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.241590    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-serving-cert\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:13.241840 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.241598    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/beecd666-527c-47ed-bafd-427385f97608-console-oauth-config\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:13.817839 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.817806    2578 generic.go:356] "Generic (PLEG): container finished" podID="beecd666-527c-47ed-bafd-427385f97608" containerID="2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4" exitCode=0
Jul 10 02:50:13.818254 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.817847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75767f5c99-2qt65" event={"ID":"beecd666-527c-47ed-bafd-427385f97608","Type":"ContainerDied","Data":"2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4"}
Jul 10 02:50:13.818254 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.817854    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75767f5c99-2qt65"
Jul 10 02:50:13.818254 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.817887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75767f5c99-2qt65" event={"ID":"beecd666-527c-47ed-bafd-427385f97608","Type":"ContainerDied","Data":"30b20fdffedad04b243b59c1b9fd73332dfcc5fe4a466b4d2c1802b0646d5acc"}
Jul 10 02:50:13.818254 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.817908    2578 scope.go:117] "RemoveContainer" containerID="2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4"
Jul 10 02:50:13.829666 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.829644    2578 scope.go:117] "RemoveContainer" containerID="2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4"
Jul 10 02:50:13.830232 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:13.830143    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4\": container with ID starting with 2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4 not found: ID does not exist" containerID="2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4"
Jul 10 02:50:13.830232 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.830180    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4"} err="failed to get container status \"2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4\": rpc error: code = NotFound desc = could not find container \"2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4\": container with ID starting with 2134a031f512fdaa3f31397929bb57a6356832dbcc9e3b4bbf42304e8d2c3cb4 not found: ID does not exist"
Jul 10 02:50:13.836222 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.836167    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75767f5c99-2qt65"]
Jul 10 02:50:13.841553 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:13.841503    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75767f5c99-2qt65"]
Jul 10 02:50:15.348666 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:15.348628    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beecd666-527c-47ed-bafd-427385f97608" path="/var/lib/kubelet/pods/beecd666-527c-47ed-bafd-427385f97608/volumes"
Jul 10 02:50:30.762511 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:30.762482    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-99nw9"
Jul 10 02:50:38.115017 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:38.114983    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:38.134583 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:38.134560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:38.933161 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:38.933130    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:51.636567 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:51.636533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:52.411603 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.411570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:52.692996 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.692973    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:50:52.693456 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.693230    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="alertmanager" containerID="cri-o://41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99" gracePeriod=120
Jul 10 02:50:52.693456 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.693305    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy-metric" containerID="cri-o://2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1" gracePeriod=120
Jul 10 02:50:52.693456 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.693335    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="prom-label-proxy" containerID="cri-o://3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced" gracePeriod=120
Jul 10 02:50:52.693456 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.693359    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy-web" containerID="cri-o://eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82" gracePeriod=120
Jul 10 02:50:52.693456 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.693415    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy" containerID="cri-o://e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96" gracePeriod=120
Jul 10 02:50:52.693756 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.693464    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="config-reloader" containerID="cri-o://41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b" gracePeriod=120
Jul 10 02:50:52.975204 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.975130    2578 generic.go:356] "Generic (PLEG): container finished" podID="10c21c2f-c337-4234-b028-bfe2291f8881" containerID="3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced" exitCode=0
Jul 10 02:50:52.975204 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.975154    2578 generic.go:356] "Generic (PLEG): container finished" podID="10c21c2f-c337-4234-b028-bfe2291f8881" containerID="e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96" exitCode=0
Jul 10 02:50:52.975204 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.975160    2578 generic.go:356] "Generic (PLEG): container finished" podID="10c21c2f-c337-4234-b028-bfe2291f8881" containerID="41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b" exitCode=0
Jul 10 02:50:52.975204 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.975165    2578 generic.go:356] "Generic (PLEG): container finished" podID="10c21c2f-c337-4234-b028-bfe2291f8881" containerID="41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99" exitCode=0
Jul 10 02:50:52.975204 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.975190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerDied","Data":"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced"}
Jul 10 02:50:52.975448 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.975241    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerDied","Data":"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96"}
Jul 10 02:50:52.975448 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.975267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerDied","Data":"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b"}
Jul 10 02:50:52.975448 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:52.975291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerDied","Data":"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99"}
Jul 10 02:50:53.943990 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.943969    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:53.983619 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.983592    2578 generic.go:356] "Generic (PLEG): container finished" podID="10c21c2f-c337-4234-b028-bfe2291f8881" containerID="2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1" exitCode=0
Jul 10 02:50:53.983619 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.983616    2578 generic.go:356] "Generic (PLEG): container finished" podID="10c21c2f-c337-4234-b028-bfe2291f8881" containerID="eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82" exitCode=0
Jul 10 02:50:53.983810 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.983635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerDied","Data":"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1"}
Jul 10 02:50:53.983810 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.983701    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:53.983810 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.983738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerDied","Data":"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82"}
Jul 10 02:50:53.983810 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.983774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c21c2f-c337-4234-b028-bfe2291f8881","Type":"ContainerDied","Data":"401738b39aa36d8e2c07b5e2617fb5c8b858d007b536446a7a5941c18adefa57"}
Jul 10 02:50:53.983995 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.983819    2578 scope.go:117] "RemoveContainer" containerID="3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced"
Jul 10 02:50:53.992894 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:53.992876    2578 scope.go:117] "RemoveContainer" containerID="2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1"
Jul 10 02:50:54.000904 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.000888    2578 scope.go:117] "RemoveContainer" containerID="e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96"
Jul 10 02:50:54.007894 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.007859    2578 scope.go:117] "RemoveContainer" containerID="eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82"
Jul 10 02:50:54.016885 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.016866    2578 scope.go:117] "RemoveContainer" containerID="41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b"
Jul 10 02:50:54.023543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.023526    2578 scope.go:117] "RemoveContainer" containerID="41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99"
Jul 10 02:50:54.030353 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.030338    2578 scope.go:117] "RemoveContainer" containerID="c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906"
Jul 10 02:50:54.036941 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.036925    2578 scope.go:117] "RemoveContainer" containerID="3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced"
Jul 10 02:50:54.037174 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:54.037156    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced\": container with ID starting with 3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced not found: ID does not exist" containerID="3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced"
Jul 10 02:50:54.037243 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.037184    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced"} err="failed to get container status \"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced\": rpc error: code = NotFound desc = could not find container \"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced\": container with ID starting with 3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced not found: ID does not exist"
Jul 10 02:50:54.037243 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.037202    2578 scope.go:117] "RemoveContainer" containerID="2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1"
Jul 10 02:50:54.037427 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:54.037412    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1\": container with ID starting with 2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1 not found: ID does not exist" containerID="2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1"
Jul 10 02:50:54.037478 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.037431    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1"} err="failed to get container status \"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1\": rpc error: code = NotFound desc = could not find container \"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1\": container with ID starting with 2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1 not found: ID does not exist"
Jul 10 02:50:54.037478 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.037443    2578 scope.go:117] "RemoveContainer" containerID="e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96"
Jul 10 02:50:54.037649 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:54.037634    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96\": container with ID starting with e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96 not found: ID does not exist" containerID="e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96"
Jul 10 02:50:54.037710 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.037656    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96"} err="failed to get container status \"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96\": rpc error: code = NotFound desc = could not find container \"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96\": container with ID starting with e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96 not found: ID does not exist"
Jul 10 02:50:54.037710 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.037671    2578 scope.go:117] "RemoveContainer" containerID="eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82"
Jul 10 02:50:54.037926 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:54.037906    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82\": container with ID starting with eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82 not found: ID does not exist" containerID="eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82"
Jul 10 02:50:54.037987 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.037934    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82"} err="failed to get container status \"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82\": rpc error: code = NotFound desc = could not find container \"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82\": container with ID starting with eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82 not found: ID does not exist"
Jul 10 02:50:54.037987 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.037954    2578 scope.go:117] "RemoveContainer" containerID="41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b"
Jul 10 02:50:54.038201 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:54.038187    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b\": container with ID starting with 41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b not found: ID does not exist" containerID="41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b"
Jul 10 02:50:54.038258 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.038207    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b"} err="failed to get container status \"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b\": rpc error: code = NotFound desc = could not find container \"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b\": container with ID starting with 41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b not found: ID does not exist"
Jul 10 02:50:54.038258 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.038226    2578 scope.go:117] "RemoveContainer" containerID="41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99"
Jul 10 02:50:54.038421 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:54.038405    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99\": container with ID starting with 41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99 not found: ID does not exist" containerID="41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99"
Jul 10 02:50:54.038480 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.038427    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99"} err="failed to get container status \"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99\": rpc error: code = NotFound desc = could not find container \"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99\": container with ID starting with 41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99 not found: ID does not exist"
Jul 10 02:50:54.038480 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.038446    2578 scope.go:117] "RemoveContainer" containerID="c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906"
Jul 10 02:50:54.038638 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:54.038623    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906\": container with ID starting with c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906 not found: ID does not exist" containerID="c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906"
Jul 10 02:50:54.038678 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.038642    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906"} err="failed to get container status \"c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906\": rpc error: code = NotFound desc = could not find container \"c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906\": container with ID starting with c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906 not found: ID does not exist"
Jul 10 02:50:54.038678 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.038655    2578 scope.go:117] "RemoveContainer" containerID="3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced"
Jul 10 02:50:54.038906 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.038888    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced"} err="failed to get container status \"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced\": rpc error: code = NotFound desc = could not find container \"3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced\": container with ID starting with 3e88259a4b3422efc693ad2a7df2f6c89cd8022b66db53c9d08f07c14239cced not found: ID does not exist"
Jul 10 02:50:54.038966 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.038908    2578 scope.go:117] "RemoveContainer" containerID="2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1"
Jul 10 02:50:54.039115 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039097    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1"} err="failed to get container status \"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1\": rpc error: code = NotFound desc = could not find container \"2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1\": container with ID starting with 2d423e9a8bfc3aeadbbbfe0d1f50b93d85896e0ca74053735d7b05d93c2ad0e1 not found: ID does not exist"
Jul 10 02:50:54.039183 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039116    2578 scope.go:117] "RemoveContainer" containerID="e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96"
Jul 10 02:50:54.039351 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039332    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96"} err="failed to get container status \"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96\": rpc error: code = NotFound desc = could not find container \"e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96\": container with ID starting with e53d193d37fc708fd36f019a12f01cd0015281359d585228298a473564345b96 not found: ID does not exist"
Jul 10 02:50:54.039403 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039353    2578 scope.go:117] "RemoveContainer" containerID="eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82"
Jul 10 02:50:54.039563 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039546    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82"} err="failed to get container status \"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82\": rpc error: code = NotFound desc = could not find container \"eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82\": container with ID starting with eb44ff710f4cdbe72240281130a45ea3f3de5cb935fc1e999b628566ab368a82 not found: ID does not exist"
Jul 10 02:50:54.039610 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039565    2578 scope.go:117] "RemoveContainer" containerID="41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b"
Jul 10 02:50:54.039765 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039748    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b"} err="failed to get container status \"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b\": rpc error: code = NotFound desc = could not find container \"41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b\": container with ID starting with 41a088c42f74c15f653fdc1d0f0dbd3bfba8402791060cc211e9b5f3b5dc144b not found: ID does not exist"
Jul 10 02:50:54.039817 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039765    2578 scope.go:117] "RemoveContainer" containerID="41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99"
Jul 10 02:50:54.039952 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039938    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99"} err="failed to get container status \"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99\": rpc error: code = NotFound desc = could not find container \"41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99\": container with ID starting with 41932918dfde0b64ed3520942aed38892f30600f26c9280adde5664c744b4d99 not found: ID does not exist"
Jul 10 02:50:54.039952 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.039952    2578 scope.go:117] "RemoveContainer" containerID="c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906"
Jul 10 02:50:54.040148 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.040129    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906"} err="failed to get container status \"c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906\": rpc error: code = NotFound desc = could not find container \"c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906\": container with ID starting with c507d6d74792e262535d8ae29b34ad8fc8c74c723b27c7a8e953cbfbac6c2906 not found: ID does not exist"
Jul 10 02:50:54.060423 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-metric\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060504 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060439    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-config-out\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060504 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060496    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060608 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-cluster-tls-config\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060608 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060560    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-trusted-ca-bundle\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060608 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-tls-assets\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060786 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060619    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-web-config\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060786 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060647    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxbn7\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-kube-api-access-hxbn7\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060786 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-metrics-client-ca\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060786 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060747    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-config-volume\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.060786 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060780    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.061020 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060845    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-web\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.061020 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060872    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-main-db\") pod \"10c21c2f-c337-4234-b028-bfe2291f8881\" (UID: \"10c21c2f-c337-4234-b028-bfe2291f8881\") "
Jul 10 02:50:54.061020 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.060951    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:54.061413 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.061266    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:50:54.061564 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.061518    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-main-db\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.061564 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.061541    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.061856 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.061801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:54.064672 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.064642    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:54.064766 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.064736    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-config-out" (OuterVolumeSpecName: "config-out") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:50:54.065054 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.065015    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:54.065664 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.065618    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:54.065664 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.065635    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-kube-api-access-hxbn7" (OuterVolumeSpecName: "kube-api-access-hxbn7") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "kube-api-access-hxbn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:50:54.065826 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.065770    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:50:54.065826 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.065766    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:54.065934 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.065919    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-config-volume" (OuterVolumeSpecName: "config-volume") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:54.069335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.069311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:54.074865 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.074843    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-web-config" (OuterVolumeSpecName: "web-config") pod "10c21c2f-c337-4234-b028-bfe2291f8881" (UID: "10c21c2f-c337-4234-b028-bfe2291f8881"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:54.161881 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.161856    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.161881 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.161879    2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-cluster-tls-config\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.161895    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-tls-assets\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.161933    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-web-config\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.161946    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxbn7\" (UniqueName: \"kubernetes.io/projected/10c21c2f-c337-4234-b028-bfe2291f8881-kube-api-access-hxbn7\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.161959    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c21c2f-c337-4234-b028-bfe2291f8881-metrics-client-ca\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.161971    2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-config-volume\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.161984    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-main-tls\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.162003    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.162017    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10c21c2f-c337-4234-b028-bfe2291f8881-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.162031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.162030    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10c21c2f-c337-4234-b028-bfe2291f8881-config-out\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:54.308122 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.308093    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:50:54.312268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.312248    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:50:54.338151 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338128    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:50:54.338392 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338380    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy"
Jul 10 02:50:54.338435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338394    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy"
Jul 10 02:50:54.338435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338404    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beecd666-527c-47ed-bafd-427385f97608" containerName="console"
Jul 10 02:50:54.338435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338409    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="beecd666-527c-47ed-bafd-427385f97608" containerName="console"
Jul 10 02:50:54.338435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338418    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="init-config-reloader"
Jul 10 02:50:54.338435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338424    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="init-config-reloader"
Jul 10 02:50:54.338435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338434    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy-web"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338440    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy-web"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338453    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy-metric"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338458    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy-metric"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338464    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="prom-label-proxy"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338469    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="prom-label-proxy"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338476    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="alertmanager"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338480    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="alertmanager"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338485    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="config-reloader"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338490    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="config-reloader"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338532    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="prom-label-proxy"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338540    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="alertmanager"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338546    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="config-reloader"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338552    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy-metric"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338558    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy-web"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338563    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="beecd666-527c-47ed-bafd-427385f97608" containerName="console"
Jul 10 02:50:54.338604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.338567    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" containerName="kube-rbac-proxy"
Jul 10 02:50:54.341916 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.341902    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.344710 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.344635    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 02:50:54.344817 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.344706    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 02:50:54.344817 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.344727    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 02:50:54.344817 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.344732    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bd7qn\""
Jul 10 02:50:54.344817 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.344799    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 02:50:54.344976 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.344899    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 02:50:54.345037 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.345018    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 02:50:54.345080 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.345065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 02:50:54.345121 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.345107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 02:50:54.350974 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.350956    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 02:50:54.358389 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.358368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:50:54.463817 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.463794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.463922 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.463821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64223656-a076-48ff-adf7-2428cdf597f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.463922 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.463848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.463922 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.463862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wj8h\" (UniqueName: \"kubernetes.io/projected/64223656-a076-48ff-adf7-2428cdf597f8-kube-api-access-8wj8h\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464036 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.463926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464036 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.463980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464036 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.464006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64223656-a076-48ff-adf7-2428cdf597f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464127 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.464061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64223656-a076-48ff-adf7-2428cdf597f8-config-out\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464127 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.464086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464127 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.464103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-web-config\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464211 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.464132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464211 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.464148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64223656-a076-48ff-adf7-2428cdf597f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.464211 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.464163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64223656-a076-48ff-adf7-2428cdf597f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565477 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64223656-a076-48ff-adf7-2428cdf597f8-config-out\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565477 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565477 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-web-config\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565673 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565673 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64223656-a076-48ff-adf7-2428cdf597f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565673 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64223656-a076-48ff-adf7-2428cdf597f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64223656-a076-48ff-adf7-2428cdf597f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64223656-a076-48ff-adf7-2428cdf597f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.565850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wj8h\" (UniqueName: \"kubernetes.io/projected/64223656-a076-48ff-adf7-2428cdf597f8-kube-api-access-8wj8h\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.566097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.566097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.566097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.565954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64223656-a076-48ff-adf7-2428cdf597f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.566842 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.566328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64223656-a076-48ff-adf7-2428cdf597f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.567615 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.567287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64223656-a076-48ff-adf7-2428cdf597f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.568501 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.568470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64223656-a076-48ff-adf7-2428cdf597f8-config-out\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.568909 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.568642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-web-config\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.568909 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.568870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.569049 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.568921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.569049 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.568955    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64223656-a076-48ff-adf7-2428cdf597f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.569049 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.569024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.569218 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.569198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.569811 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.569791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.570647 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.570632    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64223656-a076-48ff-adf7-2428cdf597f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.574530 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.574509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wj8h\" (UniqueName: \"kubernetes.io/projected/64223656-a076-48ff-adf7-2428cdf597f8-kube-api-access-8wj8h\") pod \"alertmanager-main-0\" (UID: \"64223656-a076-48ff-adf7-2428cdf597f8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.651151 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.651124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:50:54.780300 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.780275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:50:54.782534 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:50:54.782511    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64223656_a076_48ff_adf7_2428cdf597f8.slice/crio-6557460c4d78b39fef49dcfffd47ca294a8fa4ecc678881afbcff4626c72d25c WatchSource:0}: Error finding container 6557460c4d78b39fef49dcfffd47ca294a8fa4ecc678881afbcff4626c72d25c: Status 404 returned error can't find the container with id 6557460c4d78b39fef49dcfffd47ca294a8fa4ecc678881afbcff4626c72d25c
Jul 10 02:50:54.990500 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.990467    2578 generic.go:356] "Generic (PLEG): container finished" podID="64223656-a076-48ff-adf7-2428cdf597f8" containerID="2fe22c6c3e1a501116420ad40a403ed6b0b58b46d8ad3c7b5bedd3dab3f0e195" exitCode=0
Jul 10 02:50:54.990960 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.990538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64223656-a076-48ff-adf7-2428cdf597f8","Type":"ContainerDied","Data":"2fe22c6c3e1a501116420ad40a403ed6b0b58b46d8ad3c7b5bedd3dab3f0e195"}
Jul 10 02:50:54.990960 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:54.990612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64223656-a076-48ff-adf7-2428cdf597f8","Type":"ContainerStarted","Data":"6557460c4d78b39fef49dcfffd47ca294a8fa4ecc678881afbcff4626c72d25c"}
Jul 10 02:50:55.347496 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:55.347427    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10c21c2f-c337-4234-b028-bfe2291f8881" path="/var/lib/kubelet/pods/10c21c2f-c337-4234-b028-bfe2291f8881/volumes"
Jul 10 02:50:55.997522 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:55.997491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64223656-a076-48ff-adf7-2428cdf597f8","Type":"ContainerStarted","Data":"a246cc4c1605d9c9dd9c4ff092e5a525ecc2b12b1497a68b7edf08147f6fe936"}
Jul 10 02:50:55.997869 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:55.997551    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64223656-a076-48ff-adf7-2428cdf597f8","Type":"ContainerStarted","Data":"6d1242d31998530f6870717ca15d0c7db36b60ce6ae969491d1dc13953f67762"}
Jul 10 02:50:55.997869 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:55.997580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64223656-a076-48ff-adf7-2428cdf597f8","Type":"ContainerStarted","Data":"e9e7491f51c4eb5764d32dbe532f4bde473e560836e715c6f4c32825cfa44708"}
Jul 10 02:50:55.997869 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:55.997609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64223656-a076-48ff-adf7-2428cdf597f8","Type":"ContainerStarted","Data":"729e2e4fb8393a3127cc5f74664ed4e61473c59c08900c2d8c02036fddddaf61"}
Jul 10 02:50:55.997869 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:55.997632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64223656-a076-48ff-adf7-2428cdf597f8","Type":"ContainerStarted","Data":"ef53f2c6977ed4a7a77cfdae8e6b444fab28ee9557fea26a7dfb1f5764c25921"}
Jul 10 02:50:55.997869 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:55.997654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64223656-a076-48ff-adf7-2428cdf597f8","Type":"ContainerStarted","Data":"91eb28e0309f8a326e047eaec73a0be64eb08192d1f778e895da4015ff8a8ec2"}
Jul 10 02:50:56.023838 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:56.023544    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.006771531 podStartE2EDuration="2.023523587s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.752056ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:50:56.021624172 +0000 UTC m=+129.142823152" watchObservedRunningTime="2026-07-10 02:50:56.023523587 +0000 UTC m=+129.144722566"
Jul 10 02:50:56.994554 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:56.994519    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:50:56.994863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:56.994827    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="prometheus" containerID="cri-o://10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08" gracePeriod=600
Jul 10 02:50:56.995023 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:56.994859    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="thanos-sidecar" containerID="cri-o://a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e" gracePeriod=600
Jul 10 02:50:56.995023 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:56.994890    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy-web" containerID="cri-o://263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27" gracePeriod=600
Jul 10 02:50:56.995023 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:56.994859    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy" containerID="cri-o://79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441" gracePeriod=600
Jul 10 02:50:56.995023 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:56.994912    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="config-reloader" containerID="cri-o://d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca" gracePeriod=600
Jul 10 02:50:56.995242 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:56.994906    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69" gracePeriod=600
Jul 10 02:50:57.236543 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.236519    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:57.391534 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-metrics-client-ca\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.391534 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-thanos-prometheus-http-client-file\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.391534 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-trusted-ca-bundle\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.391534 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391534    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzrq2\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-kube-api-access-zzrq2\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.391864 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391673    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-metrics-client-certs\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.391864 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391735    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-grpc-tls\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.391864 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391788    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.391864 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-tls\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.391864 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391848    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-serving-certs-ca-bundle\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391874    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391904    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-db\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391923    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391942    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-2\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391971    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-web-config\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.391968    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392019    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-kube-rbac-proxy\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392045    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-config-out\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392072    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-tls-assets\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392100    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-config\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392556 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392126    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-0\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392556 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392288    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-1\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392556 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392310    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-kubelet-serving-ca-bundle\") pod \"ac61e721-07fb-4444-8bbc-61bad656c452\" (UID: \"ac61e721-07fb-4444-8bbc-61bad656c452\") "
Jul 10 02:50:57.392731 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392555    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:57.392731 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392567    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-metrics-client-ca\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.392731 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392586    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.392939 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392912    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:57.393015 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.392945    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:57.395075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.394960    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:50:57.395181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.395113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:57.395715 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.395671    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:57.395873 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.395803    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.395873 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.395827    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-kube-api-access-zzrq2" (OuterVolumeSpecName: "kube-api-access-zzrq2") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "kube-api-access-zzrq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:50:57.396453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.396396    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-config-out" (OuterVolumeSpecName: "config-out") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:50:57.396556 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.396489    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:50:57.396655 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.396632    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.396783 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.396762    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.396851 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.396832    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.396931 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.396912    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.397004 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.396983    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.397089 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.397064    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.397590 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.397574    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-config" (OuterVolumeSpecName: "config") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.406788 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.406765    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-web-config" (OuterVolumeSpecName: "web-config") pod "ac61e721-07fb-4444-8bbc-61bad656c452" (UID: "ac61e721-07fb-4444-8bbc-61bad656c452"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:57.493238 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493210    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-db\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493240    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493254    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-web-config\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493267    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-kube-rbac-proxy\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493279    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac61e721-07fb-4444-8bbc-61bad656c452-config-out\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493290    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-tls-assets\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493302    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-config\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493315    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493335 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493327    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493344    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493359    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493375    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzrq2\" (UniqueName: \"kubernetes.io/projected/ac61e721-07fb-4444-8bbc-61bad656c452-kube-api-access-zzrq2\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493388    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-metrics-client-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493401    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-grpc-tls\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493429    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493545    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493564    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac61e721-07fb-4444-8bbc-61bad656c452-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:57.493639 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:57.493574    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac61e721-07fb-4444-8bbc-61bad656c452-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:50:58.016570 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016537    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac61e721-07fb-4444-8bbc-61bad656c452" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69" exitCode=0
Jul 10 02:50:58.016570 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016561    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac61e721-07fb-4444-8bbc-61bad656c452" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441" exitCode=0
Jul 10 02:50:58.016570 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016568    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac61e721-07fb-4444-8bbc-61bad656c452" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27" exitCode=0
Jul 10 02:50:58.016570 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016573    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac61e721-07fb-4444-8bbc-61bad656c452" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e" exitCode=0
Jul 10 02:50:58.016570 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016578    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac61e721-07fb-4444-8bbc-61bad656c452" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca" exitCode=0
Jul 10 02:50:58.016957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016584    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac61e721-07fb-4444-8bbc-61bad656c452" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08" exitCode=0
Jul 10 02:50:58.016957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016621    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerDied","Data":"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"}
Jul 10 02:50:58.016957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016637    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.016957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerDied","Data":"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"}
Jul 10 02:50:58.016957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerDied","Data":"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"}
Jul 10 02:50:58.016957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016821    2578 scope.go:117] "RemoveContainer" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"
Jul 10 02:50:58.016957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016823    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerDied","Data":"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"}
Jul 10 02:50:58.016957 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerDied","Data":"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"}
Jul 10 02:50:58.017389 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.016996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerDied","Data":"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"}
Jul 10 02:50:58.017389 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.017033    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac61e721-07fb-4444-8bbc-61bad656c452","Type":"ContainerDied","Data":"33e03a3f74457cc1e1d6fafd7587b580d9ccea5ca2bda8479ae73f2a25515819"}
Jul 10 02:50:58.026811 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.026791    2578 scope.go:117] "RemoveContainer" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"
Jul 10 02:50:58.034266 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.034251    2578 scope.go:117] "RemoveContainer" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"
Jul 10 02:50:58.041078 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.041040    2578 scope.go:117] "RemoveContainer" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"
Jul 10 02:50:58.042925 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.042902    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:50:58.047484 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.047417    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:50:58.049113 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.049098    2578 scope.go:117] "RemoveContainer" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"
Jul 10 02:50:58.071093 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071067    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:50:58.071506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071488    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy-thanos"
Jul 10 02:50:58.071561 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071511    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy-thanos"
Jul 10 02:50:58.071561 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071527    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy-web"
Jul 10 02:50:58.071561 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071536    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy-web"
Jul 10 02:50:58.071561 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071552    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="thanos-sidecar"
Jul 10 02:50:58.071561 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071560    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="thanos-sidecar"
Jul 10 02:50:58.071736 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071572    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy"
Jul 10 02:50:58.071736 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071595    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy"
Jul 10 02:50:58.071736 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071606    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="config-reloader"
Jul 10 02:50:58.071736 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071614    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="config-reloader"
Jul 10 02:50:58.071736 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071625    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="prometheus"
Jul 10 02:50:58.071736 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071633    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="prometheus"
Jul 10 02:50:58.071736 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071650    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="init-config-reloader"
Jul 10 02:50:58.071736 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071658    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="init-config-reloader"
Jul 10 02:50:58.072075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071754    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="thanos-sidecar"
Jul 10 02:50:58.072075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071764    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy"
Jul 10 02:50:58.072075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071774    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="config-reloader"
Jul 10 02:50:58.072075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071781    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy-web"
Jul 10 02:50:58.072075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071787    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="prometheus"
Jul 10 02:50:58.072075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071792    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" containerName="kube-rbac-proxy-thanos"
Jul 10 02:50:58.072075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.071838    2578 scope.go:117] "RemoveContainer" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"
Jul 10 02:50:58.075175 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.075159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.077817 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.077797    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 02:50:58.077915 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.077860    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 02:50:58.078128 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078105    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5j6pr\""
Jul 10 02:50:58.078213 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078111    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 02:50:58.078213 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078162    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 02:50:58.078213 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078200    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 02:50:58.078359 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078209    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 02:50:58.078515 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078498    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 02:50:58.078646 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078504    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 02:50:58.078773 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078517    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 02:50:58.078773 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078529    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 02:50:58.078893 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 02:50:58.078893 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.078555    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 02:50:58.079054 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.079034    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 02:50:58.079402 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.079383    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8g5rm3efgn426\""
Jul 10 02:50:58.080381 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.080365    2578 scope.go:117] "RemoveContainer" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"
Jul 10 02:50:58.081161 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.081128    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 02:50:58.084285 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.084268    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 02:50:58.088023 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.088008    2578 scope.go:117] "RemoveContainer" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"
Jul 10 02:50:58.088264 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:58.088246    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": container with ID starting with e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69 not found: ID does not exist" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"
Jul 10 02:50:58.088307 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.088271    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"} err="failed to get container status \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": rpc error: code = NotFound desc = could not find container \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": container with ID starting with e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69 not found: ID does not exist"
Jul 10 02:50:58.088307 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.088286    2578 scope.go:117] "RemoveContainer" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"
Jul 10 02:50:58.088496 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:58.088483    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": container with ID starting with 79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441 not found: ID does not exist" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"
Jul 10 02:50:58.088535 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.088500    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"} err="failed to get container status \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": rpc error: code = NotFound desc = could not find container \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": container with ID starting with 79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441 not found: ID does not exist"
Jul 10 02:50:58.088535 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.088513    2578 scope.go:117] "RemoveContainer" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"
Jul 10 02:50:58.088772 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:58.088748    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": container with ID starting with 263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27 not found: ID does not exist" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"
Jul 10 02:50:58.088872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.088779    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"} err="failed to get container status \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": rpc error: code = NotFound desc = could not find container \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": container with ID starting with 263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27 not found: ID does not exist"
Jul 10 02:50:58.088872 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.088806    2578 scope.go:117] "RemoveContainer" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"
Jul 10 02:50:58.089416 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:58.089194    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": container with ID starting with a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e not found: ID does not exist" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"
Jul 10 02:50:58.089416 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.089231    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"} err="failed to get container status \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": rpc error: code = NotFound desc = could not find container \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": container with ID starting with a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e not found: ID does not exist"
Jul 10 02:50:58.089416 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.089252    2578 scope.go:117] "RemoveContainer" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"
Jul 10 02:50:58.089586 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:58.089562    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": container with ID starting with d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca not found: ID does not exist" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"
Jul 10 02:50:58.089628 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.089596    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"} err="failed to get container status \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": rpc error: code = NotFound desc = could not find container \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": container with ID starting with d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca not found: ID does not exist"
Jul 10 02:50:58.089628 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.089619    2578 scope.go:117] "RemoveContainer" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"
Jul 10 02:50:58.089940 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:58.089917    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": container with ID starting with 10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08 not found: ID does not exist" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"
Jul 10 02:50:58.090048 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.089947    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"} err="failed to get container status \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": rpc error: code = NotFound desc = could not find container \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": container with ID starting with 10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08 not found: ID does not exist"
Jul 10 02:50:58.090048 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.089967    2578 scope.go:117] "RemoveContainer" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"
Jul 10 02:50:58.090287 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:50:58.090268    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": container with ID starting with ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db not found: ID does not exist" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"
Jul 10 02:50:58.090374 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.090294    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"} err="failed to get container status \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": rpc error: code = NotFound desc = could not find container \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": container with ID starting with ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db not found: ID does not exist"
Jul 10 02:50:58.090374 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.090315    2578 scope.go:117] "RemoveContainer" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"
Jul 10 02:50:58.090733 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.090707    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"} err="failed to get container status \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": rpc error: code = NotFound desc = could not find container \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": container with ID starting with e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69 not found: ID does not exist"
Jul 10 02:50:58.090818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.090734    2578 scope.go:117] "RemoveContainer" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"
Jul 10 02:50:58.090993 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.090976    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:50:58.091050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.090997    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"} err="failed to get container status \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": rpc error: code = NotFound desc = could not find container \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": container with ID starting with 79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441 not found: ID does not exist"
Jul 10 02:50:58.091050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091015    2578 scope.go:117] "RemoveContainer" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"
Jul 10 02:50:58.091245 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091227    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"} err="failed to get container status \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": rpc error: code = NotFound desc = could not find container \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": container with ID starting with 263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27 not found: ID does not exist"
Jul 10 02:50:58.091299 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091246    2578 scope.go:117] "RemoveContainer" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"
Jul 10 02:50:58.091453 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091436    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"} err="failed to get container status \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": rpc error: code = NotFound desc = could not find container \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": container with ID starting with a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e not found: ID does not exist"
Jul 10 02:50:58.091510 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091452    2578 scope.go:117] "RemoveContainer" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"
Jul 10 02:50:58.091659 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091641    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"} err="failed to get container status \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": rpc error: code = NotFound desc = could not find container \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": container with ID starting with d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca not found: ID does not exist"
Jul 10 02:50:58.091740 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091658    2578 scope.go:117] "RemoveContainer" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"
Jul 10 02:50:58.091886 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091862    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"} err="failed to get container status \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": rpc error: code = NotFound desc = could not find container \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": container with ID starting with 10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08 not found: ID does not exist"
Jul 10 02:50:58.091886 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.091886    2578 scope.go:117] "RemoveContainer" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"
Jul 10 02:50:58.092104 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.092088    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"} err="failed to get container status \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": rpc error: code = NotFound desc = could not find container \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": container with ID starting with ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db not found: ID does not exist"
Jul 10 02:50:58.092158 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.092104    2578 scope.go:117] "RemoveContainer" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"
Jul 10 02:50:58.092324 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.092306    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"} err="failed to get container status \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": rpc error: code = NotFound desc = could not find container \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": container with ID starting with e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69 not found: ID does not exist"
Jul 10 02:50:58.092362 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.092325    2578 scope.go:117] "RemoveContainer" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"
Jul 10 02:50:58.092573 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.092556    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"} err="failed to get container status \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": rpc error: code = NotFound desc = could not find container \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": container with ID starting with 79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441 not found: ID does not exist"
Jul 10 02:50:58.092628 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.092572    2578 scope.go:117] "RemoveContainer" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"
Jul 10 02:50:58.092807 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.092791    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"} err="failed to get container status \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": rpc error: code = NotFound desc = could not find container \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": container with ID starting with 263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27 not found: ID does not exist"
Jul 10 02:50:58.092807 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.092806    2578 scope.go:117] "RemoveContainer" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"
Jul 10 02:50:58.093049 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093024    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"} err="failed to get container status \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": rpc error: code = NotFound desc = could not find container \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": container with ID starting with a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e not found: ID does not exist"
Jul 10 02:50:58.093049 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093047    2578 scope.go:117] "RemoveContainer" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"
Jul 10 02:50:58.093297 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093275    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"} err="failed to get container status \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": rpc error: code = NotFound desc = could not find container \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": container with ID starting with d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca not found: ID does not exist"
Jul 10 02:50:58.093352 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093299    2578 scope.go:117] "RemoveContainer" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"
Jul 10 02:50:58.093518 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093500    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"} err="failed to get container status \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": rpc error: code = NotFound desc = could not find container \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": container with ID starting with 10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08 not found: ID does not exist"
Jul 10 02:50:58.093576 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093518    2578 scope.go:117] "RemoveContainer" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"
Jul 10 02:50:58.093744 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093728    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"} err="failed to get container status \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": rpc error: code = NotFound desc = could not find container \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": container with ID starting with ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db not found: ID does not exist"
Jul 10 02:50:58.093811 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093744    2578 scope.go:117] "RemoveContainer" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"
Jul 10 02:50:58.093955 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093937    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"} err="failed to get container status \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": rpc error: code = NotFound desc = could not find container \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": container with ID starting with e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69 not found: ID does not exist"
Jul 10 02:50:58.093998 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.093956    2578 scope.go:117] "RemoveContainer" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"
Jul 10 02:50:58.094197 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.094173    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"} err="failed to get container status \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": rpc error: code = NotFound desc = could not find container \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": container with ID starting with 79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441 not found: ID does not exist"
Jul 10 02:50:58.094197 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.094196    2578 scope.go:117] "RemoveContainer" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"
Jul 10 02:50:58.094424 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.094408    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"} err="failed to get container status \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": rpc error: code = NotFound desc = could not find container \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": container with ID starting with 263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27 not found: ID does not exist"
Jul 10 02:50:58.094492 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.094426    2578 scope.go:117] "RemoveContainer" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"
Jul 10 02:50:58.094704 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.094669    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"} err="failed to get container status \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": rpc error: code = NotFound desc = could not find container \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": container with ID starting with a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e not found: ID does not exist"
Jul 10 02:50:58.094779 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.094706    2578 scope.go:117] "RemoveContainer" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"
Jul 10 02:50:58.094963 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.094946    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"} err="failed to get container status \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": rpc error: code = NotFound desc = could not find container \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": container with ID starting with d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca not found: ID does not exist"
Jul 10 02:50:58.095005 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.094964    2578 scope.go:117] "RemoveContainer" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"
Jul 10 02:50:58.095182 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.095159    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"} err="failed to get container status \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": rpc error: code = NotFound desc = could not find container \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": container with ID starting with 10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08 not found: ID does not exist"
Jul 10 02:50:58.095219 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.095185    2578 scope.go:117] "RemoveContainer" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"
Jul 10 02:50:58.095394 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.095377    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"} err="failed to get container status \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": rpc error: code = NotFound desc = could not find container \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": container with ID starting with ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db not found: ID does not exist"
Jul 10 02:50:58.095451 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.095395    2578 scope.go:117] "RemoveContainer" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"
Jul 10 02:50:58.095617 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.095601    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"} err="failed to get container status \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": rpc error: code = NotFound desc = could not find container \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": container with ID starting with e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69 not found: ID does not exist"
Jul 10 02:50:58.095653 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.095626    2578 scope.go:117] "RemoveContainer" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"
Jul 10 02:50:58.095867 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.095850    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"} err="failed to get container status \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": rpc error: code = NotFound desc = could not find container \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": container with ID starting with 79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441 not found: ID does not exist"
Jul 10 02:50:58.095925 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.095867    2578 scope.go:117] "RemoveContainer" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"
Jul 10 02:50:58.096054 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096039    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"} err="failed to get container status \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": rpc error: code = NotFound desc = could not find container \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": container with ID starting with 263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27 not found: ID does not exist"
Jul 10 02:50:58.096102 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096054    2578 scope.go:117] "RemoveContainer" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"
Jul 10 02:50:58.096237 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096221    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"} err="failed to get container status \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": rpc error: code = NotFound desc = could not find container \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": container with ID starting with a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e not found: ID does not exist"
Jul 10 02:50:58.096237 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096237    2578 scope.go:117] "RemoveContainer" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"
Jul 10 02:50:58.096436 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096414    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"} err="failed to get container status \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": rpc error: code = NotFound desc = could not find container \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": container with ID starting with d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca not found: ID does not exist"
Jul 10 02:50:58.096474 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096439    2578 scope.go:117] "RemoveContainer" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"
Jul 10 02:50:58.096710 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096673    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"} err="failed to get container status \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": rpc error: code = NotFound desc = could not find container \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": container with ID starting with 10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08 not found: ID does not exist"
Jul 10 02:50:58.096791 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096712    2578 scope.go:117] "RemoveContainer" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"
Jul 10 02:50:58.096962 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096944    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"} err="failed to get container status \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": rpc error: code = NotFound desc = could not find container \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": container with ID starting with ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db not found: ID does not exist"
Jul 10 02:50:58.097007 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.096964    2578 scope.go:117] "RemoveContainer" containerID="e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"
Jul 10 02:50:58.097158 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.097141    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69"} err="failed to get container status \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": rpc error: code = NotFound desc = could not find container \"e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69\": container with ID starting with e419a1e9f9964c69066588b0e279c4cf5f83acd62511f0b406c913b63d304c69 not found: ID does not exist"
Jul 10 02:50:58.097200 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.097158    2578 scope.go:117] "RemoveContainer" containerID="79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"
Jul 10 02:50:58.097349 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.097333    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441"} err="failed to get container status \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": rpc error: code = NotFound desc = could not find container \"79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441\": container with ID starting with 79a39f9859e58c0b784eaf3e132ffe59fd321009bdfefd96e5d5daf19e31e441 not found: ID does not exist"
Jul 10 02:50:58.097399 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.097349    2578 scope.go:117] "RemoveContainer" containerID="263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"
Jul 10 02:50:58.097557 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.097535    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27"} err="failed to get container status \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": rpc error: code = NotFound desc = could not find container \"263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27\": container with ID starting with 263f8561fa9a70e4b177bafa5741ca19fb3a8b3ad26b5912cf7824a80c68ce27 not found: ID does not exist"
Jul 10 02:50:58.097597 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.097561    2578 scope.go:117] "RemoveContainer" containerID="a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"
Jul 10 02:50:58.097838 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.097819    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e"} err="failed to get container status \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": rpc error: code = NotFound desc = could not find container \"a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e\": container with ID starting with a6d3d7dc00988fb4029bdbd6f194f98fdd96a8614e398b1d6b6b7cbb0580671e not found: ID does not exist"
Jul 10 02:50:58.097904 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.097839    2578 scope.go:117] "RemoveContainer" containerID="d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"
Jul 10 02:50:58.098082 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.098060    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca"} err="failed to get container status \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": rpc error: code = NotFound desc = could not find container \"d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca\": container with ID starting with d5fee13ee2d022929aff7363b00f553724cca4be61514943af758930c08c0aca not found: ID does not exist"
Jul 10 02:50:58.098121 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.098084    2578 scope.go:117] "RemoveContainer" containerID="10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"
Jul 10 02:50:58.098333 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.098314    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08"} err="failed to get container status \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": rpc error: code = NotFound desc = could not find container \"10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08\": container with ID starting with 10c4bc4f0525de566d630153896cac7e3f09e5939b0c9baeae53a72c7b1dfc08 not found: ID does not exist"
Jul 10 02:50:58.098376 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.098333    2578 scope.go:117] "RemoveContainer" containerID="ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"
Jul 10 02:50:58.098520 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.098502    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db"} err="failed to get container status \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": rpc error: code = NotFound desc = could not find container \"ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db\": container with ID starting with ee16263f485d576b2a5e03774ece39e7adda35d773d00970e85b81b2d25340db not found: ID does not exist"
Jul 10 02:50:58.198794 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.198933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed083ab3-0866-4292-b748-79bae77a1328-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.198933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.198933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.198933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-config\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.198933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.198933 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.198970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fb8z\" (UniqueName: \"kubernetes.io/projected/ed083ab3-0866-4292-b748-79bae77a1328-kube-api-access-8fb8z\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199518 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199518 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199518 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed083ab3-0866-4292-b748-79bae77a1328-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.199518 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.199255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.300533 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-config\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.300533 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.300533 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fb8z\" (UniqueName: \"kubernetes.io/projected/ed083ab3-0866-4292-b748-79bae77a1328-kube-api-access-8fb8z\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed083ab3-0866-4292-b748-79bae77a1328-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed083ab3-0866-4292-b748-79bae77a1328-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.301097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.300964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.302090 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.301271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.302090 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.301515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.302090 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.301812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.303473 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.303391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-config\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.303842 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.303813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.304466 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.304156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.304466 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.304394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.304466 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.304459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.305919 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.304758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.305919 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.305028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.305919 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.305033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.305919 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.305043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.305919 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.305860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed083ab3-0866-4292-b748-79bae77a1328-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.306228 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.306139    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.306397 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.306369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed083ab3-0866-4292-b748-79bae77a1328-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.306555 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.306534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.306776 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.306748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.307241 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.307221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed083ab3-0866-4292-b748-79bae77a1328-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.307536 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.307517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed083ab3-0866-4292-b748-79bae77a1328-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.313617 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.313595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fb8z\" (UniqueName: \"kubernetes.io/projected/ed083ab3-0866-4292-b748-79bae77a1328-kube-api-access-8fb8z\") pod \"prometheus-k8s-0\" (UID: \"ed083ab3-0866-4292-b748-79bae77a1328\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.385911 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.385889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:50:58.518500 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:58.518399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:50:58.520863 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:50:58.520833    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded083ab3_0866_4292_b748_79bae77a1328.slice/crio-b1bb91df883a2425ff6bf7f0b5cb5e33d3e78c7679d3c177b10a7ee538698778 WatchSource:0}: Error finding container b1bb91df883a2425ff6bf7f0b5cb5e33d3e78c7679d3c177b10a7ee538698778: Status 404 returned error can't find the container with id b1bb91df883a2425ff6bf7f0b5cb5e33d3e78c7679d3c177b10a7ee538698778
Jul 10 02:50:59.022382 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:59.022348    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed083ab3-0866-4292-b748-79bae77a1328" containerID="1b32039fc13e053999b7fa8dc3dbeb4ccf7d86629d96b7f03bebc25304c85daf" exitCode=0
Jul 10 02:50:59.022501 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:59.022408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed083ab3-0866-4292-b748-79bae77a1328","Type":"ContainerDied","Data":"1b32039fc13e053999b7fa8dc3dbeb4ccf7d86629d96b7f03bebc25304c85daf"}
Jul 10 02:50:59.022560 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:59.022497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed083ab3-0866-4292-b748-79bae77a1328","Type":"ContainerStarted","Data":"b1bb91df883a2425ff6bf7f0b5cb5e33d3e78c7679d3c177b10a7ee538698778"}
Jul 10 02:50:59.349966 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:50:59.349940    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac61e721-07fb-4444-8bbc-61bad656c452" path="/var/lib/kubelet/pods/ac61e721-07fb-4444-8bbc-61bad656c452/volumes"
Jul 10 02:51:00.029636 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:00.029602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed083ab3-0866-4292-b748-79bae77a1328","Type":"ContainerStarted","Data":"aaa38499de6981165a05a0b23d9e26a7b57e7d424f6d8977077f6f0f28f455f8"}
Jul 10 02:51:00.029840 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:00.029674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed083ab3-0866-4292-b748-79bae77a1328","Type":"ContainerStarted","Data":"c396e6dca066a0ad051c5dcdc93b97eab21e343b02191be920dafb0a65a08cd1"}
Jul 10 02:51:00.029840 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:00.029732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed083ab3-0866-4292-b748-79bae77a1328","Type":"ContainerStarted","Data":"676dd3116c4c08503a619cb20e9bb4f77e82532da232e01c57bf09c1397d63ac"}
Jul 10 02:51:00.029840 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:00.029774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed083ab3-0866-4292-b748-79bae77a1328","Type":"ContainerStarted","Data":"75a9065f35453ac072370f06d03eb937b1375ae1ab91c23e510398dec2759361"}
Jul 10 02:51:00.029840 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:00.029810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed083ab3-0866-4292-b748-79bae77a1328","Type":"ContainerStarted","Data":"ce9976c3c6f4fcb97973d0fdd3fc2809f6462e9ae6f336d87744ddc4507caa4d"}
Jul 10 02:51:00.030049 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:00.029842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed083ab3-0866-4292-b748-79bae77a1328","Type":"ContainerStarted","Data":"84f876caf7848925130d68c2f896447beb803a32ed9d048685f3913c9b3d1bd6"}
Jul 10 02:51:00.058795 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:00.058730    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.041553796 podStartE2EDuration="2.058709693s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.155897ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:51:00.056006937 +0000 UTC m=+133.177205951" watchObservedRunningTime="2026-07-10 02:51:00.058709693 +0000 UTC m=+133.179908686"
Jul 10 02:51:02.072574 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:02.072542    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:02.167967 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:02.167936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:03.386195 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:03.386171    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:51:13.253024 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:13.252988    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9cd99648c-fqbxj"]
Jul 10 02:51:13.369276 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:13.369215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:13.468950 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:13.468918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:13.523554 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:13.523485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:19.339162 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:19.339130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:31.291628 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:31.291591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:31.345627 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:31.345597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:38.273140 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.273082    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9cd99648c-fqbxj" podUID="469f68aa-d42f-4e71-8c82-baed335edbec" containerName="console" containerID="cri-o://2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146" gracePeriod=15
Jul 10 02:51:38.521583 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.521561    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:51:38.600072 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-console-config\") pod \"469f68aa-d42f-4e71-8c82-baed335edbec\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") "
Jul 10 02:51:38.600072 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600045    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-oauth-config\") pod \"469f68aa-d42f-4e71-8c82-baed335edbec\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") "
Jul 10 02:51:38.600072 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600061    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-service-ca\") pod \"469f68aa-d42f-4e71-8c82-baed335edbec\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") "
Jul 10 02:51:38.600315 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600091    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-oauth-serving-cert\") pod \"469f68aa-d42f-4e71-8c82-baed335edbec\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") "
Jul 10 02:51:38.600315 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600145    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-trusted-ca-bundle\") pod \"469f68aa-d42f-4e71-8c82-baed335edbec\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") "
Jul 10 02:51:38.600315 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600187    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-serving-cert\") pod \"469f68aa-d42f-4e71-8c82-baed335edbec\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") "
Jul 10 02:51:38.600315 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600227    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47bx6\" (UniqueName: \"kubernetes.io/projected/469f68aa-d42f-4e71-8c82-baed335edbec-kube-api-access-47bx6\") pod \"469f68aa-d42f-4e71-8c82-baed335edbec\" (UID: \"469f68aa-d42f-4e71-8c82-baed335edbec\") "
Jul 10 02:51:38.600506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600480    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-console-config" (OuterVolumeSpecName: "console-config") pod "469f68aa-d42f-4e71-8c82-baed335edbec" (UID: "469f68aa-d42f-4e71-8c82-baed335edbec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:51:38.600563 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-service-ca" (OuterVolumeSpecName: "service-ca") pod "469f68aa-d42f-4e71-8c82-baed335edbec" (UID: "469f68aa-d42f-4e71-8c82-baed335edbec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:51:38.600607 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600579    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "469f68aa-d42f-4e71-8c82-baed335edbec" (UID: "469f68aa-d42f-4e71-8c82-baed335edbec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:51:38.600607 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.600587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "469f68aa-d42f-4e71-8c82-baed335edbec" (UID: "469f68aa-d42f-4e71-8c82-baed335edbec"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:51:38.602429 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.602400    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/469f68aa-d42f-4e71-8c82-baed335edbec-kube-api-access-47bx6" (OuterVolumeSpecName: "kube-api-access-47bx6") pod "469f68aa-d42f-4e71-8c82-baed335edbec" (UID: "469f68aa-d42f-4e71-8c82-baed335edbec"). InnerVolumeSpecName "kube-api-access-47bx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:51:38.602429 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.602416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "469f68aa-d42f-4e71-8c82-baed335edbec" (UID: "469f68aa-d42f-4e71-8c82-baed335edbec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:51:38.602564 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.602473    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "469f68aa-d42f-4e71-8c82-baed335edbec" (UID: "469f68aa-d42f-4e71-8c82-baed335edbec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:51:38.700990 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.700955    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-trusted-ca-bundle\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:51:38.700990 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.700987    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-serving-cert\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:51:38.700990 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.700997    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47bx6\" (UniqueName: \"kubernetes.io/projected/469f68aa-d42f-4e71-8c82-baed335edbec-kube-api-access-47bx6\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:51:38.701150 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.701007    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-console-config\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:51:38.701150 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.701016    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/469f68aa-d42f-4e71-8c82-baed335edbec-console-oauth-config\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:51:38.701150 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.701024    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-service-ca\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:51:38.701150 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:38.701032    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/469f68aa-d42f-4e71-8c82-baed335edbec-oauth-serving-cert\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:51:39.176700 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.176652    2578 generic.go:356] "Generic (PLEG): container finished" podID="469f68aa-d42f-4e71-8c82-baed335edbec" containerID="2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146" exitCode=0
Jul 10 02:51:39.176859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.176720    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cd99648c-fqbxj"
Jul 10 02:51:39.176859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.176723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cd99648c-fqbxj" event={"ID":"469f68aa-d42f-4e71-8c82-baed335edbec","Type":"ContainerDied","Data":"2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146"}
Jul 10 02:51:39.176859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.176805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cd99648c-fqbxj" event={"ID":"469f68aa-d42f-4e71-8c82-baed335edbec","Type":"ContainerDied","Data":"45e32cbf0088f1034914e84f652889bb63cce019ef6d5ddfe16331af4f90b8ff"}
Jul 10 02:51:39.176859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.176827    2578 scope.go:117] "RemoveContainer" containerID="2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146"
Jul 10 02:51:39.185742 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.185726    2578 scope.go:117] "RemoveContainer" containerID="2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146"
Jul 10 02:51:39.186003 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:51:39.185986    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146\": container with ID starting with 2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146 not found: ID does not exist" containerID="2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146"
Jul 10 02:51:39.186050 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.186011    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146"} err="failed to get container status \"2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146\": rpc error: code = NotFound desc = could not find container \"2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146\": container with ID starting with 2e7978a409551f01efbbf04f911c9e7ddb8193743d002b1b5adc694bbc3b9146 not found: ID does not exist"
Jul 10 02:51:39.196676 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.196651    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9cd99648c-fqbxj"]
Jul 10 02:51:39.200331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.200310    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9cd99648c-fqbxj"]
Jul 10 02:51:39.346496 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:39.346467    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="469f68aa-d42f-4e71-8c82-baed335edbec" path="/var/lib/kubelet/pods/469f68aa-d42f-4e71-8c82-baed335edbec/volumes"
Jul 10 02:51:58.386744 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:58.386711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:51:58.402185 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:58.402154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:51:59.265119 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:51:59.265095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:52:06.837192 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:06.837161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:06.887864 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:06.887841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:12.159478 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:12.159444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:18.738668 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:18.738633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:18.843053 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:18.843008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:22.602513 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:22.602472    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:22.703799 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:22.703771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:22.804793 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:22.804767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:34.028890 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:34.028856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:34.128955 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:34.128920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:34.181648 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:52:34.181582    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:16.346122 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:16.346007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:17.599087 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:17.599044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:18.250894 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:18.250858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:42.996203 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:42.996168    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:43.798738 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:43.798708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:46.618733 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:46.618677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:46.716107 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:46.716083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:47.229437 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:47.229414    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:53:47.229670 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:47.229584    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:53:47.231904 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:47.231885    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 02:53:48.637410 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:48.637377    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:48.744481 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:48.744440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:49.185532 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:49.185500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:49.333842 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:49.333811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:50.884193 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:50.884162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:51.010246 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:51.010213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:53.609248 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:53.609192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:53.660464 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:53.660427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:55.369701 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.369658    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-plwvx"]
Jul 10 02:53:55.370079 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.369943    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469f68aa-d42f-4e71-8c82-baed335edbec" containerName="console"
Jul 10 02:53:55.370079 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.369954    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="469f68aa-d42f-4e71-8c82-baed335edbec" containerName="console"
Jul 10 02:53:55.370079 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.369997    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="469f68aa-d42f-4e71-8c82-baed335edbec" containerName="console"
Jul 10 02:53:55.372512 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.372496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:55.375209 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.375183    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wrw5w\""
Jul 10 02:53:55.375327 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.375183    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 02:53:55.376200 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.376186    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 02:53:55.382910 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.381344    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-plwvx"]
Jul 10 02:53:55.491485 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.491461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59vg\" (UniqueName: \"kubernetes.io/projected/1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb-kube-api-access-b59vg\") pod \"cert-manager-webhook-6486ffd997-plwvx\" (UID: \"1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:55.491607 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.491492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-plwvx\" (UID: \"1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:55.592142 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.592112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b59vg\" (UniqueName: \"kubernetes.io/projected/1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb-kube-api-access-b59vg\") pod \"cert-manager-webhook-6486ffd997-plwvx\" (UID: \"1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:55.592258 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.592147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-plwvx\" (UID: \"1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:55.600122 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.600097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-plwvx\" (UID: \"1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:55.600284 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.600265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59vg\" (UniqueName: \"kubernetes.io/projected/1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb-kube-api-access-b59vg\") pod \"cert-manager-webhook-6486ffd997-plwvx\" (UID: \"1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:55.691698 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.691658    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:55.813667 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.813642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-plwvx"]
Jul 10 02:53:55.816091 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:53:55.816063    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f0de41f_bdcb_4cb8_bdb7_b8134d4369cb.slice/crio-23fe91cbd3fb61e91a25ccda66c670a571b23e409aa63b69011a366dddd6c8dd WatchSource:0}: Error finding container 23fe91cbd3fb61e91a25ccda66c670a571b23e409aa63b69011a366dddd6c8dd: Status 404 returned error can't find the container with id 23fe91cbd3fb61e91a25ccda66c670a571b23e409aa63b69011a366dddd6c8dd
Jul 10 02:53:55.817840 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:55.817826    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:53:56.652181 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:56.652124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx" event={"ID":"1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb","Type":"ContainerStarted","Data":"23fe91cbd3fb61e91a25ccda66c670a571b23e409aa63b69011a366dddd6c8dd"}
Jul 10 02:53:59.128359 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:59.128314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:59.225856 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:59.225828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:59.278587 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:59.278561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:59.665540 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:59.665458    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx" event={"ID":"1f0de41f-bdcb-4cb8-bdb7-b8134d4369cb","Type":"ContainerStarted","Data":"044c9a7b9bdb3b102b0111d7b40824c8aa46c233826c11b8a6b0bb3620680443"}
Jul 10 02:53:59.665540 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:59.665514    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:53:59.682000 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:53:59.681954    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx" podStartSLOduration=1.616354103 podStartE2EDuration="4.681937096s" totalImagesPullingTime="3.065582993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:53:59.680480532 +0000 UTC m=+312.801679511" watchObservedRunningTime="2026-07-10 02:53:59.681937096 +0000 UTC m=+312.803136078"
Jul 10 02:54:05.210380 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:05.210345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:05.311899 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:05.311868    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:05.671173 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:05.671092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-plwvx"
Jul 10 02:54:09.196808 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.196771    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4k722"]
Jul 10 02:54:09.199981 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.199964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4k722"
Jul 10 02:54:09.203387 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.202816    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ftcxm\""
Jul 10 02:54:09.209924 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.209898    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4k722"]
Jul 10 02:54:09.398609 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.398571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af7cddc3-87aa-4394-abc0-89345425a10d-bound-sa-token\") pod \"cert-manager-55b4d954d5-4k722\" (UID: \"af7cddc3-87aa-4394-abc0-89345425a10d\") " pod="cert-manager/cert-manager-55b4d954d5-4k722"
Jul 10 02:54:09.398785 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.398624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzcx\" (UniqueName: \"kubernetes.io/projected/af7cddc3-87aa-4394-abc0-89345425a10d-kube-api-access-vnzcx\") pod \"cert-manager-55b4d954d5-4k722\" (UID: \"af7cddc3-87aa-4394-abc0-89345425a10d\") " pod="cert-manager/cert-manager-55b4d954d5-4k722"
Jul 10 02:54:09.500089 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.500007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af7cddc3-87aa-4394-abc0-89345425a10d-bound-sa-token\") pod \"cert-manager-55b4d954d5-4k722\" (UID: \"af7cddc3-87aa-4394-abc0-89345425a10d\") " pod="cert-manager/cert-manager-55b4d954d5-4k722"
Jul 10 02:54:09.500089 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.500062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzcx\" (UniqueName: \"kubernetes.io/projected/af7cddc3-87aa-4394-abc0-89345425a10d-kube-api-access-vnzcx\") pod \"cert-manager-55b4d954d5-4k722\" (UID: \"af7cddc3-87aa-4394-abc0-89345425a10d\") " pod="cert-manager/cert-manager-55b4d954d5-4k722"
Jul 10 02:54:09.508841 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.508814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af7cddc3-87aa-4394-abc0-89345425a10d-bound-sa-token\") pod \"cert-manager-55b4d954d5-4k722\" (UID: \"af7cddc3-87aa-4394-abc0-89345425a10d\") " pod="cert-manager/cert-manager-55b4d954d5-4k722"
Jul 10 02:54:09.509053 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.509035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzcx\" (UniqueName: \"kubernetes.io/projected/af7cddc3-87aa-4394-abc0-89345425a10d-kube-api-access-vnzcx\") pod \"cert-manager-55b4d954d5-4k722\" (UID: \"af7cddc3-87aa-4394-abc0-89345425a10d\") " pod="cert-manager/cert-manager-55b4d954d5-4k722"
Jul 10 02:54:09.511870 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.511852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4k722"
Jul 10 02:54:09.633621 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.633593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4k722"]
Jul 10 02:54:09.636386 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:54:09.636353    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf7cddc3_87aa_4394_abc0_89345425a10d.slice/crio-a0a2154091b63e96f184a2d472094b3a7222ed14eb6deba52216560e25c051aa WatchSource:0}: Error finding container a0a2154091b63e96f184a2d472094b3a7222ed14eb6deba52216560e25c051aa: Status 404 returned error can't find the container with id a0a2154091b63e96f184a2d472094b3a7222ed14eb6deba52216560e25c051aa
Jul 10 02:54:09.702922 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.702887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4k722" event={"ID":"af7cddc3-87aa-4394-abc0-89345425a10d","Type":"ContainerStarted","Data":"175dcc8f9056b1e919f3e150aa3703f05a71ab2f6378091692b495c37b4fdd3b"}
Jul 10 02:54:09.703024 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.702933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4k722" event={"ID":"af7cddc3-87aa-4394-abc0-89345425a10d","Type":"ContainerStarted","Data":"a0a2154091b63e96f184a2d472094b3a7222ed14eb6deba52216560e25c051aa"}
Jul 10 02:54:09.719811 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:09.719762    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4k722" podStartSLOduration=0.719742122 podStartE2EDuration="719.742122ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:54:09.718614813 +0000 UTC m=+322.839813793" watchObservedRunningTime="2026-07-10 02:54:09.719742122 +0000 UTC m=+322.840941104"
Jul 10 02:54:10.534870 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:10.534837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:10.635429 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:10.635405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:13.071056 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:13.071019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:26.832251 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:26.832211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:26.933989 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:26.933958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:27.439668 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.439642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:27.637526 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.637502    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:27.734523 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.734494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:27.788967 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.788938    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"]
Jul 10 02:54:27.793151 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.793134    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.799227 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.799204    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sgqkj\""
Jul 10 02:54:27.799314 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.799247    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 02:54:27.799814 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.799794    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 02:54:27.800396 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.799976    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 02:54:27.800396 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.800350    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 02:54:27.813482 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.813458    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"]
Jul 10 02:54:27.836610 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.836586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdfcc114-979c-49b1-b611-0d5289ae9f6d-manifests\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.836900 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.836623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdfcc114-979c-49b1-b611-0d5289ae9f6d-tmp\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.836900 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.836650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5vzw\" (UniqueName: \"kubernetes.io/projected/fdfcc114-979c-49b1-b611-0d5289ae9f6d-kube-api-access-v5vzw\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.836900 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.836733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdfcc114-979c-49b1-b611-0d5289ae9f6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.836900 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.836754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdfcc114-979c-49b1-b611-0d5289ae9f6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.937286 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.937262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdfcc114-979c-49b1-b611-0d5289ae9f6d-tmp\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.937463 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.937298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5vzw\" (UniqueName: \"kubernetes.io/projected/fdfcc114-979c-49b1-b611-0d5289ae9f6d-kube-api-access-v5vzw\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.937463 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.937320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdfcc114-979c-49b1-b611-0d5289ae9f6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.937463 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.937453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdfcc114-979c-49b1-b611-0d5289ae9f6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.937634 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.937521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdfcc114-979c-49b1-b611-0d5289ae9f6d-manifests\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.937895 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.937872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdfcc114-979c-49b1-b611-0d5289ae9f6d-manifests\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.939828 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.939803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdfcc114-979c-49b1-b611-0d5289ae9f6d-tmp\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.939903 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.939889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdfcc114-979c-49b1-b611-0d5289ae9f6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.939960 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.939944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdfcc114-979c-49b1-b611-0d5289ae9f6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.947745 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.947715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5vzw\" (UniqueName: \"kubernetes.io/projected/fdfcc114-979c-49b1-b611-0d5289ae9f6d-kube-api-access-v5vzw\") pod \"opendatahub-operator-controller-manager-84dd56b898-fx474\" (UID: \"fdfcc114-979c-49b1-b611-0d5289ae9f6d\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:27.985851 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:27.985796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:28.086432 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.086398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:28.103355 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.103329    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:28.186899 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.186865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:28.242649 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.242624    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"]
Jul 10 02:54:28.245097 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:54:28.245074    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfcc114_979c_49b1_b611_0d5289ae9f6d.slice/crio-7a8d97d5f28df2073d5c1b0793500dfcfefc1529d20042e9349e0a9388a2ac09 WatchSource:0}: Error finding container 7a8d97d5f28df2073d5c1b0793500dfcfefc1529d20042e9349e0a9388a2ac09: Status 404 returned error can't find the container with id 7a8d97d5f28df2073d5c1b0793500dfcfefc1529d20042e9349e0a9388a2ac09
Jul 10 02:54:28.253296 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.253274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:28.309618 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.309588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:28.412084 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.412060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:28.514578 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.514514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:28.773404 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:28.773326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474" event={"ID":"fdfcc114-979c-49b1-b611-0d5289ae9f6d","Type":"ContainerStarted","Data":"7a8d97d5f28df2073d5c1b0793500dfcfefc1529d20042e9349e0a9388a2ac09"}
Jul 10 02:54:31.788026 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:31.787992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474" event={"ID":"fdfcc114-979c-49b1-b611-0d5289ae9f6d","Type":"ContainerStarted","Data":"d1b4fa94c0bacc07bd1edfc6c52373ceea66c299f75e2cb98527672e53d943bf"}
Jul 10 02:54:32.793164 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:32.793127    2578 generic.go:356] "Generic (PLEG): container finished" podID="fdfcc114-979c-49b1-b611-0d5289ae9f6d" containerID="d1b4fa94c0bacc07bd1edfc6c52373ceea66c299f75e2cb98527672e53d943bf" exitCode=0
Jul 10 02:54:32.793568 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:32.793173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474" event={"ID":"fdfcc114-979c-49b1-b611-0d5289ae9f6d","Type":"ContainerDied","Data":"d1b4fa94c0bacc07bd1edfc6c52373ceea66c299f75e2cb98527672e53d943bf"}
Jul 10 02:54:33.799160 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:33.799126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474" event={"ID":"fdfcc114-979c-49b1-b611-0d5289ae9f6d","Type":"ContainerStarted","Data":"26f77e9c58df26f0d95f85725cc4c698d06592072b003da01c6561bbf82ceffd"}
Jul 10 02:54:33.799526 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:33.799205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:33.823496 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:33.823436    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474" podStartSLOduration=2.475749558 podStartE2EDuration="6.823413527s" totalImagesPullingTime="3.341662679s" totalInitContainerRuntime="1.00600129s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:54:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:54:33.821009629 +0000 UTC m=+346.942208602" watchObservedRunningTime="2026-07-10 02:54:33.823413527 +0000 UTC m=+346.944612530"
Jul 10 02:54:34.614281 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:34.614245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:44.805381 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:44.805295    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84dd56b898-fx474"
Jul 10 02:54:45.568317 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.568283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:45.661850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.661820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:45.701727 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.701701    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"]
Jul 10 02:54:45.704321 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.704304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.710124 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.710098    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 02:54:45.710231 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.710101    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 02:54:45.711213 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.711195    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:54:45.711448 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.711430    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 02:54:45.711523 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.711451    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x5krs\""
Jul 10 02:54:45.711523 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.711455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 02:54:45.731534 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.731510    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"]
Jul 10 02:54:45.780574 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.780546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-manager-config\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.780665 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.780603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-cert\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.780733 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.780670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-metrics-cert\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.780733 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.780724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsshk\" (UniqueName: \"kubernetes.io/projected/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-kube-api-access-qsshk\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.881480 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.881407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-metrics-cert\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.881480 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.881443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsshk\" (UniqueName: \"kubernetes.io/projected/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-kube-api-access-qsshk\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.881970 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.881499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-manager-config\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.881970 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.881548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-cert\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.882267 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.882243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-manager-config\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.884108 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.884084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-cert\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.884226 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.884213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-metrics-cert\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:45.889924 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:45.889902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsshk\" (UniqueName: \"kubernetes.io/projected/d72b3e0f-cfd5-4c67-b747-070b4fa837c1-kube-api-access-qsshk\") pod \"lws-controller-manager-646f759ddf-994gj\" (UID: \"d72b3e0f-cfd5-4c67-b747-070b4fa837c1\") " pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:46.013215 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:46.013187    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:46.151559 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:46.151532    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"]
Jul 10 02:54:46.154105 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:54:46.154075    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72b3e0f_cfd5_4c67_b747_070b4fa837c1.slice/crio-a240489ae43c843da2f8b2a56f985d9ce3e65a22fe2da5d499128daebaef51c4 WatchSource:0}: Error finding container a240489ae43c843da2f8b2a56f985d9ce3e65a22fe2da5d499128daebaef51c4: Status 404 returned error can't find the container with id a240489ae43c843da2f8b2a56f985d9ce3e65a22fe2da5d499128daebaef51c4
Jul 10 02:54:46.798021 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:46.797983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:46.848589 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:46.848555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj" event={"ID":"d72b3e0f-cfd5-4c67-b747-070b4fa837c1","Type":"ContainerStarted","Data":"a240489ae43c843da2f8b2a56f985d9ce3e65a22fe2da5d499128daebaef51c4"}
Jul 10 02:54:46.939560 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:46.939532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:47.575994 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.575961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:47.652102 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.652061    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"]
Jul 10 02:54:47.657765 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.657743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.664458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.664408    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 02:54:47.664458 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.664428    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 02:54:47.665070 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.665049    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cmc46\""
Jul 10 02:54:47.665167 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.665097    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 02:54:47.665728 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.665287    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 02:54:47.683753 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.683725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"]
Jul 10 02:54:47.759039 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.759010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:47.796310 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.796277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2775ad-a5e1-47d4-a126-63fb964d08ac-tls-certs\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.796481 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.796325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2775ad-a5e1-47d4-a126-63fb964d08ac-tmp\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.796481 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.796417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6djhq\" (UniqueName: \"kubernetes.io/projected/ae2775ad-a5e1-47d4-a126-63fb964d08ac-kube-api-access-6djhq\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.897318 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.897246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6djhq\" (UniqueName: \"kubernetes.io/projected/ae2775ad-a5e1-47d4-a126-63fb964d08ac-kube-api-access-6djhq\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.897318 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.897315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2775ad-a5e1-47d4-a126-63fb964d08ac-tls-certs\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.897488 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.897337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2775ad-a5e1-47d4-a126-63fb964d08ac-tmp\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.899753 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.899730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2775ad-a5e1-47d4-a126-63fb964d08ac-tmp\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.899869 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.899815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2775ad-a5e1-47d4-a126-63fb964d08ac-tls-certs\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.911407 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.911371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6djhq\" (UniqueName: \"kubernetes.io/projected/ae2775ad-a5e1-47d4-a126-63fb964d08ac-kube-api-access-6djhq\") pod \"kube-auth-proxy-864dd46fbc-5r4zh\" (UID: \"ae2775ad-a5e1-47d4-a126-63fb964d08ac\") " pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:47.969796 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:47.969752    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"
Jul 10 02:54:48.008402 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:48.008363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:48.074889 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:48.074831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:48.119894 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:48.119871    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh"]
Jul 10 02:54:48.123225 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:54:48.123198    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2775ad_a5e1_47d4_a126_63fb964d08ac.slice/crio-b1aad708b2a1859cf8823ce14b39003aad56a9837e5503e9680b20a4abb1f04f WatchSource:0}: Error finding container b1aad708b2a1859cf8823ce14b39003aad56a9837e5503e9680b20a4abb1f04f: Status 404 returned error can't find the container with id b1aad708b2a1859cf8823ce14b39003aad56a9837e5503e9680b20a4abb1f04f
Jul 10 02:54:48.140578 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:48.140555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:48.245398 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:48.245347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:48.861078 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:48.861019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh" event={"ID":"ae2775ad-a5e1-47d4-a126-63fb964d08ac","Type":"ContainerStarted","Data":"b1aad708b2a1859cf8823ce14b39003aad56a9837e5503e9680b20a4abb1f04f"}
Jul 10 02:54:48.901079 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:48.901049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:49.105027 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:49.104982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:49.179289 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:49.179201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:50.109268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:50.109227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:52.883700 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:52.883646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj" event={"ID":"d72b3e0f-cfd5-4c67-b747-070b4fa837c1","Type":"ContainerStarted","Data":"c10679ae7a13bdd94173b9840fc7aa6e7c90003b44ea542c893c643dfb23a422"}
Jul 10 02:54:52.884136 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:52.883736    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:54:52.885242 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:52.885222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh" event={"ID":"ae2775ad-a5e1-47d4-a126-63fb964d08ac","Type":"ContainerStarted","Data":"8ef338af503bdfc4567892124a1b47cd84ca514c42c8788e950c5b03c10c6a87"}
Jul 10 02:54:52.899852 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:52.899811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj" podStartSLOduration=2.004344646 podStartE2EDuration="7.899796777s" totalImagesPullingTime="5.895452131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:54:52.897630734 +0000 UTC m=+366.018829714" watchObservedRunningTime="2026-07-10 02:54:52.899796777 +0000 UTC m=+366.020995756"
Jul 10 02:54:52.913561 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:52.913523    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-864dd46fbc-5r4zh" podStartSLOduration=2.040572522 podStartE2EDuration="5.913510528s" totalImagesPullingTime="3.872938006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:54:52.912767696 +0000 UTC m=+366.033966678" watchObservedRunningTime="2026-07-10 02:54:52.913510528 +0000 UTC m=+366.034709507"
Jul 10 02:54:54.417631 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:54.417580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:54.516089 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:54.516042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:55.155361 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:55.155320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:55.269426 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:55.269395    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:55.361007 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:55.360976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:57.979302 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:57.979273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:58.059845 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.059809    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"]
Jul 10 02:54:58.063270 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.063247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:58.065912 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.065892    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cgtpx\""
Jul 10 02:54:58.066331 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.066316    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 10 02:54:58.074754 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.074727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:58.075057 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.075040    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"]
Jul 10 02:54:58.180519 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.180492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjn9l\" (UniqueName: \"kubernetes.io/projected/a69016da-eee2-4bfe-8467-4c379b413a9a-kube-api-access-gjn9l\") pod \"llmisvc-controller-manager-777c6bd7d5-9shpp\" (UID: \"a69016da-eee2-4bfe-8467-4c379b413a9a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:58.180667 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.180541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a69016da-eee2-4bfe-8467-4c379b413a9a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9shpp\" (UID: \"a69016da-eee2-4bfe-8467-4c379b413a9a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:58.281613 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.281541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjn9l\" (UniqueName: \"kubernetes.io/projected/a69016da-eee2-4bfe-8467-4c379b413a9a-kube-api-access-gjn9l\") pod \"llmisvc-controller-manager-777c6bd7d5-9shpp\" (UID: \"a69016da-eee2-4bfe-8467-4c379b413a9a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:58.281613 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.281586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a69016da-eee2-4bfe-8467-4c379b413a9a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9shpp\" (UID: \"a69016da-eee2-4bfe-8467-4c379b413a9a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:58.281804 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:54:58.281736    2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 10 02:54:58.281804 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:54:58.281800    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69016da-eee2-4bfe-8467-4c379b413a9a-cert podName:a69016da-eee2-4bfe-8467-4c379b413a9a nodeName:}" failed. No retries permitted until 2026-07-10 02:54:58.781781054 +0000 UTC m=+371.902980012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a69016da-eee2-4bfe-8467-4c379b413a9a-cert") pod "llmisvc-controller-manager-777c6bd7d5-9shpp" (UID: "a69016da-eee2-4bfe-8467-4c379b413a9a") : secret "llmisvc-webhook-server-cert" not found
Jul 10 02:54:58.299531 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.299504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjn9l\" (UniqueName: \"kubernetes.io/projected/a69016da-eee2-4bfe-8467-4c379b413a9a-kube-api-access-gjn9l\") pod \"llmisvc-controller-manager-777c6bd7d5-9shpp\" (UID: \"a69016da-eee2-4bfe-8467-4c379b413a9a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:58.335935 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.335908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:58.491203 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.491173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:58.785506 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.785466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a69016da-eee2-4bfe-8467-4c379b413a9a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9shpp\" (UID: \"a69016da-eee2-4bfe-8467-4c379b413a9a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:58.788030 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.788010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a69016da-eee2-4bfe-8467-4c379b413a9a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9shpp\" (UID: \"a69016da-eee2-4bfe-8467-4c379b413a9a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:58.973230 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:58.973198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:54:59.100884 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:59.100852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"]
Jul 10 02:54:59.103818 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:54:59.103787    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda69016da_eee2_4bfe_8467_4c379b413a9a.slice/crio-ab432250502e4dfbce342713599ec4a36d0c2eaf1e0dc6561286f86dbb3aabad WatchSource:0}: Error finding container ab432250502e4dfbce342713599ec4a36d0c2eaf1e0dc6561286f86dbb3aabad: Status 404 returned error can't find the container with id ab432250502e4dfbce342713599ec4a36d0c2eaf1e0dc6561286f86dbb3aabad
Jul 10 02:54:59.309020 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:59.308919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:59.406395 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:59.406359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:59.506174 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:59.506139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:59.916052 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:54:59.916008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp" event={"ID":"a69016da-eee2-4bfe-8467-4c379b413a9a","Type":"ContainerStarted","Data":"ab432250502e4dfbce342713599ec4a36d0c2eaf1e0dc6561286f86dbb3aabad"}
Jul 10 02:55:02.932187 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:02.932151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp" event={"ID":"a69016da-eee2-4bfe-8467-4c379b413a9a","Type":"ContainerStarted","Data":"eabc0262810056a992ae66171923b92ec8fe079dd551a4932809939b2ae1f6bc"}
Jul 10 02:55:02.932630 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:02.932279    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:55:02.948722 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:02.948656    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp" podStartSLOduration=2.019516833 podStartE2EDuration="4.948644527s" totalImagesPullingTime="2.929127694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:55:02.948281005 +0000 UTC m=+376.069479983" watchObservedRunningTime="2026-07-10 02:55:02.948644527 +0000 UTC m=+376.069843506"
Jul 10 02:55:03.891132 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:03.891100    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-646f759ddf-994gj"
Jul 10 02:55:10.344861 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:10.344812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:10.397619 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:10.397590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:12.198979 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:12.198951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:12.299593 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:12.299567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:23.715204 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:23.715162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:23.763871 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:23.763840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:33.938579 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:33.938546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9shpp"
Jul 10 02:55:48.252459 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:48.252430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:48.359031 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:48.359004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:48.458092 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:48.458058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:49.181766 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:49.181736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:49.411694 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:49.411664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:58.523467 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:55:58.523431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:12.884663 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.884578    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74fb58d66c-m47cq"]
Jul 10 02:56:12.888128 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.888107    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:12.892163 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.892010    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 02:56:12.892163 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.892024    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fc9d5\""
Jul 10 02:56:12.892163 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.892010    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 02:56:12.892163 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.892033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 02:56:12.892163 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.892041    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 02:56:12.892501 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.892281    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 02:56:12.892721 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.892704    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 02:56:12.892817 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.892787    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 02:56:12.896381 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.896363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 02:56:12.900496 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.900478    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fb58d66c-m47cq"]
Jul 10 02:56:12.935663 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:12.935638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:13.065520 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.065494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-serving-cert\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.065621 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.065528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbkmg\" (UniqueName: \"kubernetes.io/projected/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-kube-api-access-gbkmg\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.065621 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.065562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-trusted-ca-bundle\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.065708 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.065651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-config\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.065708 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.065699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-service-ca\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.065779 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.065741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-oauth-config\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.065779 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.065769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-oauth-serving-cert\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.166447 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.166379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbkmg\" (UniqueName: \"kubernetes.io/projected/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-kube-api-access-gbkmg\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.166447 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.166427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-trusted-ca-bundle\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.166613 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.166595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-config\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.166650 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.166627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-service-ca\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.166650 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.166645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-oauth-config\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.166756 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.166663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-oauth-serving-cert\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.166756 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.166723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-serving-cert\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.167299 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.167278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-service-ca\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.167555 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.167332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-trusted-ca-bundle\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.167555 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.167358    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-config\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.167555 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.167425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-oauth-serving-cert\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.169286 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.169263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-oauth-config\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.169367 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.169348    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-console-serving-cert\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.174845 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.174822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbkmg\" (UniqueName: \"kubernetes.io/projected/7ab721ad-afc7-4173-a24e-dfd2df7bbadf-kube-api-access-gbkmg\") pod \"console-74fb58d66c-m47cq\" (UID: \"7ab721ad-afc7-4173-a24e-dfd2df7bbadf\") " pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.197893 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.197872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:13.323863 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:13.323834    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fb58d66c-m47cq"]
Jul 10 02:56:13.326328 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:56:13.326302    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab721ad_afc7_4173_a24e_dfd2df7bbadf.slice/crio-81930de59ce774041b966ea5fbd5a8d8706a7b6241ef1a910f0170c01cb07013 WatchSource:0}: Error finding container 81930de59ce774041b966ea5fbd5a8d8706a7b6241ef1a910f0170c01cb07013: Status 404 returned error can't find the container with id 81930de59ce774041b966ea5fbd5a8d8706a7b6241ef1a910f0170c01cb07013
Jul 10 02:56:14.229060 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:14.229026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fb58d66c-m47cq" event={"ID":"7ab721ad-afc7-4173-a24e-dfd2df7bbadf","Type":"ContainerStarted","Data":"e41f78d606e4f32ae9cee3ae9e0d6e8c5348b9f17012a460f7f0cfb5c7e64747"}
Jul 10 02:56:14.229419 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:14.229079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fb58d66c-m47cq" event={"ID":"7ab721ad-afc7-4173-a24e-dfd2df7bbadf","Type":"ContainerStarted","Data":"81930de59ce774041b966ea5fbd5a8d8706a7b6241ef1a910f0170c01cb07013"}
Jul 10 02:56:14.247312 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:14.247265    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74fb58d66c-m47cq" podStartSLOduration=2.247250352 podStartE2EDuration="2.247250352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:56:14.245528692 +0000 UTC m=+447.366727686" watchObservedRunningTime="2026-07-10 02:56:14.247250352 +0000 UTC m=+447.368449331"
Jul 10 02:56:16.523990 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:16.523959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:20.854003 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:20.853974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:21.719667 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:21.719637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:22.124554 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:22.124483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:23.198592 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:23.198559    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:23.198989 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:23.198619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:23.203388 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:23.203364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:23.276420 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:23.276395    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74fb58d66c-m47cq"
Jul 10 02:56:23.484600 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:23.484523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:23.622265 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:23.622235    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:23.728275 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:23.728245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:24.921711 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:24.921664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:26.693948 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:26.693922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:27.359083 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:27.359049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:29.389851 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:29.389813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:30.956591 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:30.956562    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:31.424850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:31.424770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:31.589651 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:31.589619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:31.687102 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:31.687028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:41.748021 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:41.747974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:41.850279 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:41.850250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:44.748820 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:44.748783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:44.851455 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:44.851425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:47.190268 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:47.190231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:47.245726 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:47.245653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:53.147001 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:53.146962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:53.201036 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:56:53.201010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:02.152854 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:02.152820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:02.253339 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:02.253297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:05.147369 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:05.147341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:05.250105 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:05.250070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:07.580272 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:07.580239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:07.629436 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:07.629368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:08.269443 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:08.269417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:10.488943 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:10.488906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:11.897993 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:11.897961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:16.038858 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:16.038816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:16.583542 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:16.583504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:22.167628 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.167594    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:22.274914 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.274877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:22.329377 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.329344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:22.516595 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.516562    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:57:22.519749 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.519732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:22.522415 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.522394    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 02:57:22.522530 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.522398    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 02:57:22.522530 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.522469    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 02:57:22.523179 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.523163    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v4sst\""
Jul 10 02:57:22.527812 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.527786    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:57:22.557978 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.557955    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:57:22.613765 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.613734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swfns\" (UniqueName: \"kubernetes.io/projected/008450ee-98aa-4949-acd9-0828494fc171-kube-api-access-swfns\") pod \"limitador-limitador-54d6d988d5-t2cm9\" (UID: \"008450ee-98aa-4949-acd9-0828494fc171\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:22.613858 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.613774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/008450ee-98aa-4949-acd9-0828494fc171-config-file\") pod \"limitador-limitador-54d6d988d5-t2cm9\" (UID: \"008450ee-98aa-4949-acd9-0828494fc171\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:22.715006 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.714980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swfns\" (UniqueName: \"kubernetes.io/projected/008450ee-98aa-4949-acd9-0828494fc171-kube-api-access-swfns\") pod \"limitador-limitador-54d6d988d5-t2cm9\" (UID: \"008450ee-98aa-4949-acd9-0828494fc171\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:22.715165 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.715014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/008450ee-98aa-4949-acd9-0828494fc171-config-file\") pod \"limitador-limitador-54d6d988d5-t2cm9\" (UID: \"008450ee-98aa-4949-acd9-0828494fc171\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:22.715629 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.715611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/008450ee-98aa-4949-acd9-0828494fc171-config-file\") pod \"limitador-limitador-54d6d988d5-t2cm9\" (UID: \"008450ee-98aa-4949-acd9-0828494fc171\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:22.724672 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.724645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swfns\" (UniqueName: \"kubernetes.io/projected/008450ee-98aa-4949-acd9-0828494fc171-kube-api-access-swfns\") pod \"limitador-limitador-54d6d988d5-t2cm9\" (UID: \"008450ee-98aa-4949-acd9-0828494fc171\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:22.831389 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.831309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:22.956118 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.956088    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-g7mp4"]
Jul 10 02:57:22.960055 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.960022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g7mp4"
Jul 10 02:57:22.961854 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.961832    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:57:22.962465 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.962448    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mhdwd\""
Jul 10 02:57:22.964921 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:57:22.964899    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008450ee_98aa_4949_acd9_0828494fc171.slice/crio-373c4a7a501052c58e0bea44b9b6ed8f4d4fca62402e7f22f98812e39c98b8b6 WatchSource:0}: Error finding container 373c4a7a501052c58e0bea44b9b6ed8f4d4fca62402e7f22f98812e39c98b8b6: Status 404 returned error can't find the container with id 373c4a7a501052c58e0bea44b9b6ed8f4d4fca62402e7f22f98812e39c98b8b6
Jul 10 02:57:22.967880 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.967858    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7mp4"]
Jul 10 02:57:22.991302 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:22.991280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:23.016992 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:23.016964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq9mp\" (UniqueName: \"kubernetes.io/projected/b51918e7-840f-4c96-953b-1f19dfe5681d-kube-api-access-nq9mp\") pod \"authorino-58cd955675-g7mp4\" (UID: \"b51918e7-840f-4c96-953b-1f19dfe5681d\") " pod="kuadrant-system/authorino-58cd955675-g7mp4"
Jul 10 02:57:23.093554 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:23.093495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:23.117643 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:23.117617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq9mp\" (UniqueName: \"kubernetes.io/projected/b51918e7-840f-4c96-953b-1f19dfe5681d-kube-api-access-nq9mp\") pod \"authorino-58cd955675-g7mp4\" (UID: \"b51918e7-840f-4c96-953b-1f19dfe5681d\") " pod="kuadrant-system/authorino-58cd955675-g7mp4"
Jul 10 02:57:23.125824 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:23.125805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq9mp\" (UniqueName: \"kubernetes.io/projected/b51918e7-840f-4c96-953b-1f19dfe5681d-kube-api-access-nq9mp\") pod \"authorino-58cd955675-g7mp4\" (UID: \"b51918e7-840f-4c96-953b-1f19dfe5681d\") " pod="kuadrant-system/authorino-58cd955675-g7mp4"
Jul 10 02:57:23.278833 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:23.278807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g7mp4"
Jul 10 02:57:23.407589 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:23.407561    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7mp4"]
Jul 10 02:57:23.410856 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:57:23.410826    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb51918e7_840f_4c96_953b_1f19dfe5681d.slice/crio-8d87fab4b2440a4710e8e73c5111b36cf30ba6dc0264565c3ae44999f13f7893 WatchSource:0}: Error finding container 8d87fab4b2440a4710e8e73c5111b36cf30ba6dc0264565c3ae44999f13f7893: Status 404 returned error can't find the container with id 8d87fab4b2440a4710e8e73c5111b36cf30ba6dc0264565c3ae44999f13f7893
Jul 10 02:57:23.539946 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:23.539876    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g7mp4" event={"ID":"b51918e7-840f-4c96-953b-1f19dfe5681d","Type":"ContainerStarted","Data":"8d87fab4b2440a4710e8e73c5111b36cf30ba6dc0264565c3ae44999f13f7893"}
Jul 10 02:57:23.542473 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:23.542411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9" event={"ID":"008450ee-98aa-4949-acd9-0828494fc171","Type":"ContainerStarted","Data":"373c4a7a501052c58e0bea44b9b6ed8f4d4fca62402e7f22f98812e39c98b8b6"}
Jul 10 02:57:27.564807 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:27.564671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g7mp4" event={"ID":"b51918e7-840f-4c96-953b-1f19dfe5681d","Type":"ContainerStarted","Data":"0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e"}
Jul 10 02:57:27.566246 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:27.566224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9" event={"ID":"008450ee-98aa-4949-acd9-0828494fc171","Type":"ContainerStarted","Data":"8e42b848aa6dc8f7361de6e935239bb52d6c36cdb8681ba5f721ffc873329a44"}
Jul 10 02:57:27.566345 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:27.566303    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:27.579561 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:27.579508    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-g7mp4" podStartSLOduration=1.722157902 podStartE2EDuration="5.579496693s" totalImagesPullingTime="3.857338791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:57:27.578364259 +0000 UTC m=+520.699563252" watchObservedRunningTime="2026-07-10 02:57:27.579496693 +0000 UTC m=+520.700695672"
Jul 10 02:57:27.594175 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:27.594120    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9" podStartSLOduration=1.3375781070000001 podStartE2EDuration="5.594107336s" totalImagesPullingTime="4.256529229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:57:27.593620927 +0000 UTC m=+520.714819908" watchObservedRunningTime="2026-07-10 02:57:27.594107336 +0000 UTC m=+520.715306315"
Jul 10 02:57:28.185557 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:28.185524    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7mp4"]
Jul 10 02:57:29.575668 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:29.575612    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-g7mp4" podUID="b51918e7-840f-4c96-953b-1f19dfe5681d" containerName="authorino" containerID="cri-o://0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e" gracePeriod=30
Jul 10 02:57:29.821577 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:29.821551    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g7mp4"
Jul 10 02:57:29.875091 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:29.875022    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq9mp\" (UniqueName: \"kubernetes.io/projected/b51918e7-840f-4c96-953b-1f19dfe5681d-kube-api-access-nq9mp\") pod \"b51918e7-840f-4c96-953b-1f19dfe5681d\" (UID: \"b51918e7-840f-4c96-953b-1f19dfe5681d\") "
Jul 10 02:57:29.877241 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:29.877213    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51918e7-840f-4c96-953b-1f19dfe5681d-kube-api-access-nq9mp" (OuterVolumeSpecName: "kube-api-access-nq9mp") pod "b51918e7-840f-4c96-953b-1f19dfe5681d" (UID: "b51918e7-840f-4c96-953b-1f19dfe5681d"). InnerVolumeSpecName "kube-api-access-nq9mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:57:29.975909 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:29.975879    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq9mp\" (UniqueName: \"kubernetes.io/projected/b51918e7-840f-4c96-953b-1f19dfe5681d-kube-api-access-nq9mp\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:57:30.580754 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.580725    2578 generic.go:356] "Generic (PLEG): container finished" podID="b51918e7-840f-4c96-953b-1f19dfe5681d" containerID="0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e" exitCode=0
Jul 10 02:57:30.581143 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.580763    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g7mp4"
Jul 10 02:57:30.581143 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.580810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g7mp4" event={"ID":"b51918e7-840f-4c96-953b-1f19dfe5681d","Type":"ContainerDied","Data":"0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e"}
Jul 10 02:57:30.581143 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.580847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g7mp4" event={"ID":"b51918e7-840f-4c96-953b-1f19dfe5681d","Type":"ContainerDied","Data":"8d87fab4b2440a4710e8e73c5111b36cf30ba6dc0264565c3ae44999f13f7893"}
Jul 10 02:57:30.581143 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.580862    2578 scope.go:117] "RemoveContainer" containerID="0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e"
Jul 10 02:57:30.589581 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.589565    2578 scope.go:117] "RemoveContainer" containerID="0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e"
Jul 10 02:57:30.589854 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:57:30.589833    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e\": container with ID starting with 0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e not found: ID does not exist" containerID="0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e"
Jul 10 02:57:30.589932 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.589865    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e"} err="failed to get container status \"0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e\": rpc error: code = NotFound desc = could not find container \"0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e\": container with ID starting with 0a62d9894ce5901d7770bded3cc42a13f58ea3dc265ca66e7232a46d6acecd8e not found: ID does not exist"
Jul 10 02:57:30.601237 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.601215    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7mp4"]
Jul 10 02:57:30.606724 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:30.606704    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7mp4"]
Jul 10 02:57:31.347517 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:31.347479    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b51918e7-840f-4c96-953b-1f19dfe5681d" path="/var/lib/kubelet/pods/b51918e7-840f-4c96-953b-1f19dfe5681d/volumes"
Jul 10 02:57:38.572829 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:38.572761    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"
Jul 10 02:57:43.385948 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:43.385910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:43.484514 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:43.484480    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:43.879394 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:43.879356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:48.289279 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:48.289250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:48.388986 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:48.388953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:56.606604 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.606569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:56.847542 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.847509    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tw69"]
Jul 10 02:57:56.847850 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.847839    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b51918e7-840f-4c96-953b-1f19dfe5681d" containerName="authorino"
Jul 10 02:57:56.847936 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.847852    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51918e7-840f-4c96-953b-1f19dfe5681d" containerName="authorino"
Jul 10 02:57:56.847936 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.847919    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b51918e7-840f-4c96-953b-1f19dfe5681d" containerName="authorino"
Jul 10 02:57:56.852010 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.851994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7tw69"
Jul 10 02:57:56.854456 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.854437    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mhdwd\""
Jul 10 02:57:56.857174 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.857124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tw69"]
Jul 10 02:57:56.979541 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.979510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:56.988738 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:56.988712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9ld\" (UniqueName: \"kubernetes.io/projected/97cbcc4e-71c9-4e6d-8dbf-e14afef64914-kube-api-access-7p9ld\") pod \"authorino-5d4b67c446-7tw69\" (UID: \"97cbcc4e-71c9-4e6d-8dbf-e14afef64914\") " pod="kuadrant-system/authorino-5d4b67c446-7tw69"
Jul 10 02:57:57.078337 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.078304    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tw69"]
Jul 10 02:57:57.078568 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:57:57.078548    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7p9ld], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-7tw69" podUID="97cbcc4e-71c9-4e6d-8dbf-e14afef64914"
Jul 10 02:57:57.090005 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.089974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9ld\" (UniqueName: \"kubernetes.io/projected/97cbcc4e-71c9-4e6d-8dbf-e14afef64914-kube-api-access-7p9ld\") pod \"authorino-5d4b67c446-7tw69\" (UID: \"97cbcc4e-71c9-4e6d-8dbf-e14afef64914\") " pod="kuadrant-system/authorino-5d4b67c446-7tw69"
Jul 10 02:57:57.100568 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.100536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9ld\" (UniqueName: \"kubernetes.io/projected/97cbcc4e-71c9-4e6d-8dbf-e14afef64914-kube-api-access-7p9ld\") pod \"authorino-5d4b67c446-7tw69\" (UID: \"97cbcc4e-71c9-4e6d-8dbf-e14afef64914\") " pod="kuadrant-system/authorino-5d4b67c446-7tw69"
Jul 10 02:57:57.104173 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.104154    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78b5cdd84f-bl4j6"]
Jul 10 02:57:57.107598 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.107551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78b5cdd84f-bl4j6"
Jul 10 02:57:57.114466 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.114443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78b5cdd84f-bl4j6"]
Jul 10 02:57:57.190764 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.190729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qv4v\" (UniqueName: \"kubernetes.io/projected/9205b4f7-8f60-40fc-994d-0d71dd008030-kube-api-access-5qv4v\") pod \"authorino-78b5cdd84f-bl4j6\" (UID: \"9205b4f7-8f60-40fc-994d-0d71dd008030\") " pod="kuadrant-system/authorino-78b5cdd84f-bl4j6"
Jul 10 02:57:57.281943 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.281908    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78b5cdd84f-bl4j6"]
Jul 10 02:57:57.282172 ip-10-0-134-61 kubenswrapper[2578]: E0710 02:57:57.282156    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5qv4v], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-78b5cdd84f-bl4j6" podUID="9205b4f7-8f60-40fc-994d-0d71dd008030"
Jul 10 02:57:57.291542 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.291516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qv4v\" (UniqueName: \"kubernetes.io/projected/9205b4f7-8f60-40fc-994d-0d71dd008030-kube-api-access-5qv4v\") pod \"authorino-78b5cdd84f-bl4j6\" (UID: \"9205b4f7-8f60-40fc-994d-0d71dd008030\") " pod="kuadrant-system/authorino-78b5cdd84f-bl4j6"
Jul 10 02:57:57.300922 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.300902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qv4v\" (UniqueName: \"kubernetes.io/projected/9205b4f7-8f60-40fc-994d-0d71dd008030-kube-api-access-5qv4v\") pod \"authorino-78b5cdd84f-bl4j6\" (UID: \"9205b4f7-8f60-40fc-994d-0d71dd008030\") " pod="kuadrant-system/authorino-78b5cdd84f-bl4j6"
Jul 10 02:57:57.695334 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.695300    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7tw69"
Jul 10 02:57:57.695759 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.695299    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78b5cdd84f-bl4j6"
Jul 10 02:57:57.702136 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.702119    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7tw69"
Jul 10 02:57:57.705125 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.705109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78b5cdd84f-bl4j6"
Jul 10 02:57:57.794902 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.794875    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p9ld\" (UniqueName: \"kubernetes.io/projected/97cbcc4e-71c9-4e6d-8dbf-e14afef64914-kube-api-access-7p9ld\") pod \"97cbcc4e-71c9-4e6d-8dbf-e14afef64914\" (UID: \"97cbcc4e-71c9-4e6d-8dbf-e14afef64914\") "
Jul 10 02:57:57.795026 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.794961    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qv4v\" (UniqueName: \"kubernetes.io/projected/9205b4f7-8f60-40fc-994d-0d71dd008030-kube-api-access-5qv4v\") pod \"9205b4f7-8f60-40fc-994d-0d71dd008030\" (UID: \"9205b4f7-8f60-40fc-994d-0d71dd008030\") "
Jul 10 02:57:57.797009 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.796979    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97cbcc4e-71c9-4e6d-8dbf-e14afef64914-kube-api-access-7p9ld" (OuterVolumeSpecName: "kube-api-access-7p9ld") pod "97cbcc4e-71c9-4e6d-8dbf-e14afef64914" (UID: "97cbcc4e-71c9-4e6d-8dbf-e14afef64914"). InnerVolumeSpecName "kube-api-access-7p9ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:57:57.797101 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.797046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9205b4f7-8f60-40fc-994d-0d71dd008030-kube-api-access-5qv4v" (OuterVolumeSpecName: "kube-api-access-5qv4v") pod "9205b4f7-8f60-40fc-994d-0d71dd008030" (UID: "9205b4f7-8f60-40fc-994d-0d71dd008030"). InnerVolumeSpecName "kube-api-access-5qv4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:57:57.896289 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.896253    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qv4v\" (UniqueName: \"kubernetes.io/projected/9205b4f7-8f60-40fc-994d-0d71dd008030-kube-api-access-5qv4v\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:57:57.896289 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:57.896282    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p9ld\" (UniqueName: \"kubernetes.io/projected/97cbcc4e-71c9-4e6d-8dbf-e14afef64914-kube-api-access-7p9ld\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 02:57:58.699705 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:58.699648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78b5cdd84f-bl4j6"
Jul 10 02:57:58.699705 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:58.699652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7tw69"
Jul 10 02:57:58.732316 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:58.732288    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tw69"]
Jul 10 02:57:58.735818 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:58.735799    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tw69"]
Jul 10 02:57:58.754638 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:58.754614    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78b5cdd84f-bl4j6"]
Jul 10 02:57:58.758075 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:58.758050    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78b5cdd84f-bl4j6"]
Jul 10 02:57:59.348280 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:59.348238    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9205b4f7-8f60-40fc-994d-0d71dd008030" path="/var/lib/kubelet/pods/9205b4f7-8f60-40fc-994d-0d71dd008030/volumes"
Jul 10 02:57:59.348535 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:57:59.348517    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97cbcc4e-71c9-4e6d-8dbf-e14afef64914" path="/var/lib/kubelet/pods/97cbcc4e-71c9-4e6d-8dbf-e14afef64914/volumes"
Jul 10 02:58:02.714369 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:02.714332    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:02.813478 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:02.813447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:02.890581 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:02.890551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:03.258628 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:03.258601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:03.309348 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:03.309322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:03.678992 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:03.678907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:06.835852 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:06.835817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:06.922396 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:06.922356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:41.865212 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:41.865180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:43.173435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:43.173405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:43.216088 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:43.216054    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:58:47.261658 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:47.261628    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:58:47.262992 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:47.262974    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 02:58:52.605097 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:52.605069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:52.705190 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:58:52.705158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:10.677132 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:10.677054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:11.062246 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:11.062214    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:59:14.538281 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:14.538227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:15.250574 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:15.250533    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:59:18.066114 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.066081    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"]
Jul 10 02:59:18.070306 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.070286    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.072880 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.072856    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 02:59:18.074129 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.074107    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 02:59:18.074129 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.074128    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 02:59:18.074309 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.074216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4m722\""
Jul 10 02:59:18.083191 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.083159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"]
Jul 10 02:59:18.106921 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.106891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:18.154762 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.154734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.154859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.154768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.154859 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.154814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.154943 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.154869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q9sm\" (UniqueName: \"kubernetes.io/projected/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-kube-api-access-6q9sm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.154943 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.154908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.155007 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.154945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.255939 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.255912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.256029 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.255941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.256029 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.255965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.256029 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.255983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q9sm\" (UniqueName: \"kubernetes.io/projected/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-kube-api-access-6q9sm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.256178 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.256115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.256231 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.256183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.256319 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.256291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.256435 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.256337    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.256487 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.256470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.258265 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.258237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.258582 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.258559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.264410 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.264388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q9sm\" (UniqueName: \"kubernetes.io/projected/c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07-kube-api-access-6q9sm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ggwkj\" (UID: \"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.384261 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.384212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:18.515215 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.515191    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"]
Jul 10 02:59:18.517213 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:59:18.517187    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ef9eee_5202_4eab_b5e9_4bfba3ee2f07.slice/crio-303ee9a2027de02d5736315a65570b23cc560ccfc305971bcecbd6ac9d6bc192 WatchSource:0}: Error finding container 303ee9a2027de02d5736315a65570b23cc560ccfc305971bcecbd6ac9d6bc192: Status 404 returned error can't find the container with id 303ee9a2027de02d5736315a65570b23cc560ccfc305971bcecbd6ac9d6bc192
Jul 10 02:59:18.518481 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:18.518463    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:59:19.052177 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:19.052131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj" event={"ID":"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07","Type":"ContainerStarted","Data":"303ee9a2027de02d5736315a65570b23cc560ccfc305971bcecbd6ac9d6bc192"}
Jul 10 02:59:19.256709 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:19.256661    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:59:20.058212 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:20.058174    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj" event={"ID":"c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07","Type":"ContainerStarted","Data":"b2fcbefd06eba3a06e4d2bf31c8b752b6e4bf8b2395730379841c9e0896f247a"}
Jul 10 02:59:20.076141 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:20.076094    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj" podStartSLOduration=1.066552038 podStartE2EDuration="2.076078958s" totalImagesPullingTime="1.00952692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:59:20.074557729 +0000 UTC m=+633.195756712" watchObservedRunningTime="2026-07-10 02:59:20.076078958 +0000 UTC m=+633.197278054"
Jul 10 02:59:24.885569 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:24.885530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:26.152533 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:26.152499    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:59:28.384835 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:28.384801    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:28.385186 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:28.384860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:28.397201 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:28.397176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:29.109665 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:29.109638    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ggwkj"
Jul 10 02:59:31.489415 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:31.489373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:33.353956 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:33.353929    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:59:35.548901 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.548871    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"]
Jul 10 02:59:35.555503 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.555485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.558839 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.558813    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 10 02:59:35.559804 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.559786    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"]
Jul 10 02:59:35.594114 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.594084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.594215 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.594129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.594215 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.594194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.594295 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.594249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.594295 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.594290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.594372 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.594357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88fz8\" (UniqueName: \"kubernetes.io/projected/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-kube-api-access-88fz8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.694723 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.694676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.694838 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.694739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.694838 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.694758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.694838 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.694786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.694838 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.694810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.695103 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.694845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88fz8\" (UniqueName: \"kubernetes.io/projected/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-kube-api-access-88fz8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.695103 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.695062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.695210 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.695139    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.695257 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.695223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.697066 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.697045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.697339 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.697320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.703242 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.703218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88fz8\" (UniqueName: \"kubernetes.io/projected/605cee0c-7ed6-43a0-8d99-08b7dbab5a5a-kube-api-access-88fz8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2\" (UID: \"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.749844 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.749810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:35.866165 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.866084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:35.996317 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:35.996288    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"]
Jul 10 02:59:35.999381 ip-10-0-134-61 kubenswrapper[2578]: W0710 02:59:35.999350    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod605cee0c_7ed6_43a0_8d99_08b7dbab5a5a.slice/crio-0b112cd07f071d197461fcdb5ceca325c8b66646eb56186228fecbdd55a07f70 WatchSource:0}: Error finding container 0b112cd07f071d197461fcdb5ceca325c8b66646eb56186228fecbdd55a07f70: Status 404 returned error can't find the container with id 0b112cd07f071d197461fcdb5ceca325c8b66646eb56186228fecbdd55a07f70
Jul 10 02:59:36.129123 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:36.129017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2" event={"ID":"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a","Type":"ContainerStarted","Data":"0b112cd07f071d197461fcdb5ceca325c8b66646eb56186228fecbdd55a07f70"}
Jul 10 02:59:37.135011 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:37.134973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2" event={"ID":"605cee0c-7ed6-43a0-8d99-08b7dbab5a5a","Type":"ContainerStarted","Data":"efdd116f98c094767d8aac9b578ae9b035ba542f2e76d75705bfc4b6c4bd675c"}
Jul 10 02:59:37.154076 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:37.154034    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2" podStartSLOduration=1.9879505549999998 podStartE2EDuration="2.154019576s" totalImagesPullingTime="166.069021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:59:37.153420022 +0000 UTC m=+650.274619002" watchObservedRunningTime="2026-07-10 02:59:37.154019576 +0000 UTC m=+650.275218556"
Jul 10 02:59:42.069047 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:42.069012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 02:59:45.867290 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:45.867248    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:45.867799 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:45.867308    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:45.880142 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:45.880121    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 02:59:46.185404 ip-10-0-134-61 kubenswrapper[2578]: I0710 02:59:46.185334    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2"
Jul 10 03:00:00.143766 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:00.143729    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"]
Jul 10 03:00:00.147327 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:00.147309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"
Jul 10 03:00:00.150080 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:00.150062    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cns2h\""
Jul 10 03:00:00.153800 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:00.153778    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"]
Jul 10 03:00:00.158021 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:00.158000    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"
Jul 10 03:00:00.285414 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:00.285389    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"]
Jul 10 03:00:00.287972 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:00:00.287944    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371dc32e_056f_4709_9445_b1f39b615347.slice/crio-c690d9f8dff37e018f02b83df2dc8497c64993493e971dc77c8a6989f2051439 WatchSource:0}: Error finding container c690d9f8dff37e018f02b83df2dc8497c64993493e971dc77c8a6989f2051439: Status 404 returned error can't find the container with id c690d9f8dff37e018f02b83df2dc8497c64993493e971dc77c8a6989f2051439
Jul 10 03:00:01.242620 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:01.242588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp" event={"ID":"371dc32e-056f-4709-9445-b1f39b615347","Type":"ContainerStarted","Data":"c690d9f8dff37e018f02b83df2dc8497c64993493e971dc77c8a6989f2051439"}
Jul 10 03:00:03.253870 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:03.253841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp" event={"ID":"371dc32e-056f-4709-9445-b1f39b615347","Type":"ContainerStarted","Data":"1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd"}
Jul 10 03:00:03.268539 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:03.268490    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp" podStartSLOduration=0.512537134 podStartE2EDuration="3.268472776s" totalImagesPullingTime="2.755935642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:00:03.26763606 +0000 UTC m=+676.388835050" watchObservedRunningTime="2026-07-10 03:00:03.268472776 +0000 UTC m=+676.389671756"
Jul 10 03:00:16.897179 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:16.897147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:26.992172 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:26.992137    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dd78c5544-vt286"]
Jul 10 03:00:26.995541 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:26.995523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd78c5544-vt286"
Jul 10 03:00:26.998965 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:26.998937    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mhdwd\""
Jul 10 03:00:26.999080 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:26.998999    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 03:00:27.003993 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.003970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd78c5544-vt286"]
Jul 10 03:00:27.146675 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.146629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5-tls-cert\") pod \"authorino-5dd78c5544-vt286\" (UID: \"f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5\") " pod="kuadrant-system/authorino-5dd78c5544-vt286"
Jul 10 03:00:27.146675 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.146675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ctkr\" (UniqueName: \"kubernetes.io/projected/f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5-kube-api-access-5ctkr\") pod \"authorino-5dd78c5544-vt286\" (UID: \"f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5\") " pod="kuadrant-system/authorino-5dd78c5544-vt286"
Jul 10 03:00:27.247306 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.247235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5-tls-cert\") pod \"authorino-5dd78c5544-vt286\" (UID: \"f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5\") " pod="kuadrant-system/authorino-5dd78c5544-vt286"
Jul 10 03:00:27.247306 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.247268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ctkr\" (UniqueName: \"kubernetes.io/projected/f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5-kube-api-access-5ctkr\") pod \"authorino-5dd78c5544-vt286\" (UID: \"f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5\") " pod="kuadrant-system/authorino-5dd78c5544-vt286"
Jul 10 03:00:27.249741 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.249714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5-tls-cert\") pod \"authorino-5dd78c5544-vt286\" (UID: \"f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5\") " pod="kuadrant-system/authorino-5dd78c5544-vt286"
Jul 10 03:00:27.255334 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.255313    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ctkr\" (UniqueName: \"kubernetes.io/projected/f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5-kube-api-access-5ctkr\") pod \"authorino-5dd78c5544-vt286\" (UID: \"f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5\") " pod="kuadrant-system/authorino-5dd78c5544-vt286"
Jul 10 03:00:27.305296 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.305273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd78c5544-vt286"
Jul 10 03:00:27.387438 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.387411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:27.445925 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.445903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd78c5544-vt286"]
Jul 10 03:00:27.448393 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:00:27.448365    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf62ffc5e_f2cb_4ec8_9719_3d4b9ffce2a5.slice/crio-fcefd0e42324aeb673c313da19d5aae3801a43f07c1cbd92395daff5f51f0519 WatchSource:0}: Error finding container fcefd0e42324aeb673c313da19d5aae3801a43f07c1cbd92395daff5f51f0519: Status 404 returned error can't find the container with id fcefd0e42324aeb673c313da19d5aae3801a43f07c1cbd92395daff5f51f0519
Jul 10 03:00:27.452671 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:27.452631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:28.372858 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:28.372822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd78c5544-vt286" event={"ID":"f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5","Type":"ContainerStarted","Data":"f0c62fe1bf5e708dd357c5efca206cb5d94147241b8c81199ae2bd217518c0d5"}
Jul 10 03:00:28.373168 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:28.372860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd78c5544-vt286" event={"ID":"f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5","Type":"ContainerStarted","Data":"fcefd0e42324aeb673c313da19d5aae3801a43f07c1cbd92395daff5f51f0519"}
Jul 10 03:00:28.388190 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:28.388140    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dd78c5544-vt286" podStartSLOduration=1.57611056 podStartE2EDuration="2.388122321s" totalImagesPullingTime="812.011761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:00:28.387391249 +0000 UTC m=+701.508590252" watchObservedRunningTime="2026-07-10 03:00:28.388122321 +0000 UTC m=+701.509321300"
Jul 10 03:00:28.510629 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:28.510549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:28.619284 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:28.619241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:42.642985 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:42.642909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:56.548017 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:00:56.547979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:01:00.017831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:00.017795    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"]
Jul 10 03:01:00.018217 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:00.017993    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp" podUID="371dc32e-056f-4709-9445-b1f39b615347" containerName="cleanup" containerID="cri-o://1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd" gracePeriod=30
Jul 10 03:01:06.147203 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:06.147168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:01:17.550088 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:17.550055    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:01:26.459032 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:26.458994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:01:30.214802 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.214780    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"
Jul 10 03:01:30.657298 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.657257    2578 generic.go:356] "Generic (PLEG): container finished" podID="371dc32e-056f-4709-9445-b1f39b615347" containerID="1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd" exitCode=137
Jul 10 03:01:30.657298 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.657301    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"
Jul 10 03:01:30.657508 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.657344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp" event={"ID":"371dc32e-056f-4709-9445-b1f39b615347","Type":"ContainerDied","Data":"1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd"}
Jul 10 03:01:30.657508 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.657400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp" event={"ID":"371dc32e-056f-4709-9445-b1f39b615347","Type":"ContainerDied","Data":"c690d9f8dff37e018f02b83df2dc8497c64993493e971dc77c8a6989f2051439"}
Jul 10 03:01:30.657508 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.657422    2578 scope.go:117] "RemoveContainer" containerID="1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd"
Jul 10 03:01:30.666050 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.666032    2578 scope.go:117] "RemoveContainer" containerID="1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd"
Jul 10 03:01:30.666280 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:01:30.666264    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd\": container with ID starting with 1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd not found: ID does not exist" containerID="1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd"
Jul 10 03:01:30.666325 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.666288    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd"} err="failed to get container status \"1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd\": rpc error: code = NotFound desc = could not find container \"1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd\": container with ID starting with 1d664bff6ae8c3cc2f540ef3e2bfce19bae08383368e49e17d30736f4b6d6dbd not found: ID does not exist"
Jul 10 03:01:30.677765 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.677742    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"]
Jul 10 03:01:30.681906 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:30.681887    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727540-zjvdp"]
Jul 10 03:01:31.347743 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:31.347710    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="371dc32e-056f-4709-9445-b1f39b615347" path="/var/lib/kubelet/pods/371dc32e-056f-4709-9445-b1f39b615347/volumes"
Jul 10 03:01:37.950437 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:37.950399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:01:39.217155 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:39.217122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:41.178283 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:01:41.178242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:08.683777 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:08.683671    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:02:23.151911 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:23.151876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:02:28.184659 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:28.184616    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:28.280255 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:28.280226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:28.398912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:28.398869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:34.363918 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:34.363882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:34.467018 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:34.466971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:34.599543 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:34.599506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:34.745629 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:34.745591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:40.473915 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:40.473874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:40.549167 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:40.549132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:02:57.151096 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:02:57.151062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:03:06.849025 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:06.848988    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:03:07.024173 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:07.024134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:03:07.081503 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:07.081478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:03:15.851794 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:15.851758    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:03:24.542179 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:24.542142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:03:30.789319 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:30.789284    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:03:30.887440 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:30.887400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:03:34.657640 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:34.657603    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:03:44.943280 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:44.943198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:03:47.297746 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:47.297717    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:03:47.300918 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:47.300897    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:03:56.160574 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:03:56.160539    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:04:05.352870 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:04:05.352829    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:04:28.249697 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:04:28.249650    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:04:31.544351 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:04:31.544306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:04:33.472354 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:04:33.472311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:04:40.052792 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:04:40.052749    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:05:03.248663 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:05:03.248630    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:05:13.046043 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:05:13.045954    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:05:29.053501 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:05:29.053463    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:05:39.653645 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:05:39.653613    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:05:43.445657 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:05:43.445624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:05:49.361583 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:05:49.361543    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:05:58.652774 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:05:58.652733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:06:06.521045 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:06:06.520998    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:06:07.490019 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:06:07.489986    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:07:55.951798 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:07:55.951755    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:08:04.849997 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:08:04.849957    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:08:18.154602 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:08:18.154499    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:08:28.852822 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:08:28.852783    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:08:39.451113 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:08:39.451079    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:08:47.326320 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:08:47.326292    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:08:47.331126 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:08:47.331106    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:08:50.253416 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:08:50.253379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:09:00.361434 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:09:00.361398    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:09:10.854916 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:09:10.854875    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:09:21.448386 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:09:21.448345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:09:31.357295 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:09:31.357260    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:09:42.054569 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:09:42.054490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:10:08.145783 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:10:08.145740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:10:15.545247 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:10:15.545213    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:10:25.547905 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:10:25.547872    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:10:34.453551 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:10:34.453517    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:10:41.545977 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:10:41.545937    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:10:57.252372 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:10:57.252339    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:11:07.651822 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:11:07.651789    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:11:17.348402 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:11:17.348323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:11:26.348439 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:11:26.348402    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:11:37.254975 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:11:37.254940    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:11:46.245915 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:11:46.245880    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:11:56.869418 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:11:56.869380    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:11:59.151943 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:11:59.151899    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:12:01.770146 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:12:01.770116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:12:07.752186 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:12:07.752131    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:12:19.158887 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:12:19.158848    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:12:28.249608 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:12:28.249570    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:12:40.755543 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:12:40.755452    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:12:48.548392 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:12:48.548350    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:13:01.254644 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:01.254594    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:13:12.752812 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:12.752779    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:13:25.052600 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:25.052562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:13:27.673002 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:27.672963    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:34.495969 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:34.495932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:37.547755 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:37.547723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:13:42.747957 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:42.747926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:46.750375 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:46.750343    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:13:47.356779 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:47.356754    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:13:47.362300 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:47.362280    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:13:47.865018 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:47.864985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:50.740475 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:50.740434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:50.842734 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:50.842679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:51.178484 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:51.178409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:56.447078 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:56.447033    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:13:56.879391 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:56.879309    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:56.983339 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:56.983304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:57.080963 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:57.080935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:57.136014 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:57.135935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:58.270540 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:58.270502    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:58.344722 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:58.344674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:58.405917 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:58.405889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:58.710935 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:58.710903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:58.917342 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:58.917310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:13:59.019844 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:13:59.019766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:00.832139 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:00.832110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:03.320052 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:03.320010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:03.513026 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:03.512994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:03.618024 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:03.617946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:03.707119 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:03.707086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:07.170517 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:07.170487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:09.339987 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:09.339899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:09.399138 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:09.399102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:09.614603 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:09.614520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:09.711659 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:09.711629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:10.749756 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:10.749721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:10.816528 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:10.816493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:10.886087 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:10.886060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:11.259328 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:11.259294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:11.364993 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:11.364965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:11.458495 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:11.458466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:13.008010 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:13.007976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:13.450579 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:13.450546    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:14:15.809123 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:15.809087    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:16.191740 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:16.191711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:21.920222 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:21.920187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:22.028113 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:22.028033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:24.521606 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:24.521576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:25.450343 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:25.450310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:14:27.660191 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:27.660152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:27.714218 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:27.714187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:27.875345 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:27.875318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:27.930072 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:27.929994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:28.972759 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:28.972726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:29.064214 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:29.064183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:29.129796 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:29.129759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:29.571770 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:29.571733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:29.669674 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:29.669643    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:29.744660 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:29.744618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:31.275237 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:31.275203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:32.748438 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:32.748407    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:14:33.419017 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:33.418982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:33.616020 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:33.615981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:33.717013 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:33.716979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:33.779482 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:33.779456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:35.773169 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:35.773140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:39.302569 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:39.302537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:39.404483 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:39.404453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:39.777738 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:39.777707    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:39.882019 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:39.881985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:39.980960 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:39.980916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:41.403904 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:41.403864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:44.151484 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:44.151449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:14:47.164666 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:47.164637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:47.221083 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:47.221055    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:47.293443 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:47.293407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:47.391477 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:47.391449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:47.491995 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:47.491958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:14:47.889405 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:14:47.889328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:13.882500 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:13.882465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:19.613735 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:19.613672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:19.719166 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:19.719134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:19.813495 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:19.813461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:35.713993 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:35.713957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:41.224387 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:41.224315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:41.284283 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:41.284254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:41.366987 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:41.366947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:41.466265 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:41.466234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:49.950956 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:49.950922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:51.969473 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:51.969417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:52.775306 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:52.775270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:58.495213 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:58.495176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:58.565955 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:58.565922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:58.634727 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:58.634653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:58.735597 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:58.735566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:58.837774 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:58.837670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:59.554976 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:59.554921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:59.654174 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:59.654141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:15:59.754648 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:15:59.754614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:00.654178 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:00.654146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:16:01.404083 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:01.404054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:07.250789 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:07.250754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:07.312614 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:07.312582    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:07.753627 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:07.753589    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:16:07.929658 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:07.929621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:13.670994 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:13.670957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:13.729465 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:13.729431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:13.906731 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:13.906667    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:14.211964 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:14.211916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:14.312643 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:14.312598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:16.643327 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:16.643291    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:16:17.173461 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:17.173426    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:17.254574 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:17.254529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:17.319149 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:17.319120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:17.459610 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:17.459576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:17.729561 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:17.729475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:17.831297 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:17.831266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:21.688367 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:21.688327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:22.343353 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:22.343318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:22.441550 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:22.441515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:22.785162 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:22.785125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:28.044525 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:28.044490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:16:28.390272 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:28.390190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:28.501472 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:28.501436    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:28.813760 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:28.813726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:29.185386 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:29.185300    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:29.285762 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:29.285734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:34.859093 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:34.859053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:34.920539 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:34.920509    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:35.121765 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:35.121657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:35.350009 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:35.349979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:35.471073 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:35.471044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:35.578573 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:35.578536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:35.691709 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:35.691651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:37.447652 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:37.447620    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:16:41.580239 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:41.580204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:41.683857 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:41.683823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:41.792557 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:41.792508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:41.957512 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:41.957477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:47.615597 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:47.615564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:47.715717 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:47.715672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:54.416914 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:54.416864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:54.728809 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:54.728773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:55.334381 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:55.334349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:57.405316 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:57.405267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:57.501557 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:57.501516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:57.631095 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:57.631062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:58.013893 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:58.013830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:58.114282 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:58.114247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:16:59.143358 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:16:59.143318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:01.922071 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:01.922028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:02.947229 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:02.947197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:17:08.055337 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:08.055304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:08.164909 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:08.164839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:17.950393 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.950362    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"]
Jul 10 03:17:17.950888 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.950794    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371dc32e-056f-4709-9445-b1f39b615347" containerName="cleanup"
Jul 10 03:17:17.950888 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.950807    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="371dc32e-056f-4709-9445-b1f39b615347" containerName="cleanup"
Jul 10 03:17:17.950888 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.950878    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="371dc32e-056f-4709-9445-b1f39b615347" containerName="cleanup"
Jul 10 03:17:17.953854 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.953833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:17.957297 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.957274    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0212b4b5\"/\"default-dockercfg-h66vm\""
Jul 10 03:17:17.957464 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.957288    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0212b4b5\"/\"kube-root-ca.crt\""
Jul 10 03:17:17.957531 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.957304    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0212b4b5\"/\"openshift-service-ca.crt\""
Jul 10 03:17:17.957593 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.957302    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0212b4b5\"/\"e2e-lifecycle-model-0212b4b5-kserve-self-signed-certs\""
Jul 10 03:17:17.961318 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.961292    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"]
Jul 10 03:17:17.976803 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:17.976774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:18.062288 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.062254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-dshm\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.062288 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.062297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tmp-dir\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.062544 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.062364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tls-certs\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.062544 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.062441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-model-cache\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.062544 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.062473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-home\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.062544 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.062497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2flx\" (UniqueName: \"kubernetes.io/projected/4f1020df-d4c1-4e64-b9c1-b79bd9278203-kube-api-access-h2flx\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163237 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-dshm\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163237 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tmp-dir\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163473 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tls-certs\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163473 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-model-cache\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163473 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-home\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163473 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2flx\" (UniqueName: \"kubernetes.io/projected/4f1020df-d4c1-4e64-b9c1-b79bd9278203-kube-api-access-h2flx\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163632 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tmp-dir\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163776 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-model-cache\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.163880 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.163789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-home\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.165808 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.165787    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-dshm\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.166043 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.166025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tls-certs\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.171259 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.171236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2flx\" (UniqueName: \"kubernetes.io/projected/4f1020df-d4c1-4e64-b9c1-b79bd9278203-kube-api-access-h2flx\") pod \"e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") " pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.265247 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.265173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:18.394730 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.394676    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"]
Jul 10 03:17:18.397763 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:17:18.397730    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f1020df_d4c1_4e64_b9c1_b79bd9278203.slice/crio-09b72aff89a100eca49b24fd7b4b37390fedbbd82fc7c9c92345f2c7cf4305f6 WatchSource:0}: Error finding container 09b72aff89a100eca49b24fd7b4b37390fedbbd82fc7c9c92345f2c7cf4305f6: Status 404 returned error can't find the container with id 09b72aff89a100eca49b24fd7b4b37390fedbbd82fc7c9c92345f2c7cf4305f6
Jul 10 03:17:18.924907 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.924870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r" event={"ID":"4f1020df-d4c1-4e64-b9c1-b79bd9278203","Type":"ContainerStarted","Data":"db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43"}
Jul 10 03:17:18.924907 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.924910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r" event={"ID":"4f1020df-d4c1-4e64-b9c1-b79bd9278203","Type":"ContainerStarted","Data":"09b72aff89a100eca49b24fd7b4b37390fedbbd82fc7c9c92345f2c7cf4305f6"}
Jul 10 03:17:18.940486 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:18.940441    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r" podStartSLOduration=1.9404263419999999 podStartE2EDuration="1.940426342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:17:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:17:18.939113065 +0000 UTC m=+1712.060312081" watchObservedRunningTime="2026-07-10 03:17:18.940426342 +0000 UTC m=+1712.061625316"
Jul 10 03:17:19.604076 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:19.604038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:19.705199 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:19.705161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:21.057187 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:21.057157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:17:28.266189 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:28.266154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:28.266673 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:28.266211    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:28.278793 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:28.278771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:28.983151 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:28.983123    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:17:38.949227 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:38.949192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:17:44.583788 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:44.583747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:44.929308 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:44.929228    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:48.451646 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:48.451614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:17:50.670479 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:50.670446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:55.656587 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:55.656552    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"]
Jul 10 03:17:55.706174 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:55.706144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:17:59.348207 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:17:59.348175    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:18:10.676776 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:10.676730    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r" podUID="4f1020df-d4c1-4e64-b9c1-b79bd9278203" containerName="main" containerID="cri-o://db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43" gracePeriod=45
Jul 10 03:18:10.916340 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:10.916310    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:18:11.021561 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.021534    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-home\") pod \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") "
Jul 10 03:18:11.021759 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.021591    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tls-certs\") pod \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") "
Jul 10 03:18:11.021759 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.021627    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tmp-dir\") pod \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") "
Jul 10 03:18:11.021759 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.021722    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-dshm\") pod \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") "
Jul 10 03:18:11.021942 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.021806    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-model-cache\") pod \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") "
Jul 10 03:18:11.021942 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.021855    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2flx\" (UniqueName: \"kubernetes.io/projected/4f1020df-d4c1-4e64-b9c1-b79bd9278203-kube-api-access-h2flx\") pod \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\" (UID: \"4f1020df-d4c1-4e64-b9c1-b79bd9278203\") "
Jul 10 03:18:11.021942 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.021867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-home" (OuterVolumeSpecName: "home") pod "4f1020df-d4c1-4e64-b9c1-b79bd9278203" (UID: "4f1020df-d4c1-4e64-b9c1-b79bd9278203"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:18:11.022097 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.021950    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4f1020df-d4c1-4e64-b9c1-b79bd9278203" (UID: "4f1020df-d4c1-4e64-b9c1-b79bd9278203"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:18:11.022097 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.022058    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-model-cache" (OuterVolumeSpecName: "model-cache") pod "4f1020df-d4c1-4e64-b9c1-b79bd9278203" (UID: "4f1020df-d4c1-4e64-b9c1-b79bd9278203"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:18:11.022194 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.022163    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:18:11.022194 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.022182    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:18:11.022194 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.022194    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:18:11.024009 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.023984    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-dshm" (OuterVolumeSpecName: "dshm") pod "4f1020df-d4c1-4e64-b9c1-b79bd9278203" (UID: "4f1020df-d4c1-4e64-b9c1-b79bd9278203"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:18:11.024155 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.024053    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4f1020df-d4c1-4e64-b9c1-b79bd9278203" (UID: "4f1020df-d4c1-4e64-b9c1-b79bd9278203"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:18:11.024155 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.024051    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1020df-d4c1-4e64-b9c1-b79bd9278203-kube-api-access-h2flx" (OuterVolumeSpecName: "kube-api-access-h2flx") pod "4f1020df-d4c1-4e64-b9c1-b79bd9278203" (UID: "4f1020df-d4c1-4e64-b9c1-b79bd9278203"). InnerVolumeSpecName "kube-api-access-h2flx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:18:11.123087 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.123063    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2flx\" (UniqueName: \"kubernetes.io/projected/4f1020df-d4c1-4e64-b9c1-b79bd9278203-kube-api-access-h2flx\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:18:11.123087 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.123085    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1020df-d4c1-4e64-b9c1-b79bd9278203-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:18:11.123087 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.123096    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f1020df-d4c1-4e64-b9c1-b79bd9278203-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:18:11.158919 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.158888    2578 generic.go:356] "Generic (PLEG): container finished" podID="4f1020df-d4c1-4e64-b9c1-b79bd9278203" containerID="db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43" exitCode=0
Jul 10 03:18:11.159034 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.158932    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"
Jul 10 03:18:11.159034 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.158950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r" event={"ID":"4f1020df-d4c1-4e64-b9c1-b79bd9278203","Type":"ContainerDied","Data":"db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43"}
Jul 10 03:18:11.159034 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.158982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r" event={"ID":"4f1020df-d4c1-4e64-b9c1-b79bd9278203","Type":"ContainerDied","Data":"09b72aff89a100eca49b24fd7b4b37390fedbbd82fc7c9c92345f2c7cf4305f6"}
Jul 10 03:18:11.159034 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.159004    2578 scope.go:117] "RemoveContainer" containerID="db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43"
Jul 10 03:18:11.167825 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.167806    2578 scope.go:117] "RemoveContainer" containerID="db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43"
Jul 10 03:18:11.168073 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:18:11.168056    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43\": container with ID starting with db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43 not found: ID does not exist" containerID="db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43"
Jul 10 03:18:11.168120 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.168082    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43"} err="failed to get container status \"db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43\": rpc error: code = NotFound desc = could not find container \"db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43\": container with ID starting with db5352be78ac2af470e2f4ac070931418050455b7a52560a1d688a8b71f6bf43 not found: ID does not exist"
Jul 10 03:18:11.178435 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.178416    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"]
Jul 10 03:18:11.181741 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.181723    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0212b4b5/e2e-lifecycle-model-0212b4b5-kserve-b494f45cf-qc68r"]
Jul 10 03:18:11.348045 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:11.347980    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f1020df-d4c1-4e64-b9c1-b79bd9278203" path="/var/lib/kubelet/pods/4f1020df-d4c1-4e64-b9c1-b79bd9278203/volumes"
Jul 10 03:18:32.210894 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:32.210859    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:32.590122 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:32.590032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:35.852166 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:35.852130    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:18:38.041392 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:38.041360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:38.103193 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:38.103165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:38.321936 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:38.321862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:38.565719 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:38.565624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:39.616126 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:39.616092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:39.715244 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:39.715211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:39.819069 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:39.819023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:40.579034 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:40.579005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:40.684726 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:40.684673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:40.798298 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:40.798265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:42.204143 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:42.204112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:47.385621 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:47.385594    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:18:47.392892 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:47.392870    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:18:47.877671 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:47.877640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:47.977147 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:47.977104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:48.395843 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:48.395735    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:18:48.572161 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:48.572122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:54.306760 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:54.306726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:54.415278 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:54.415245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:54.512388 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:54.512349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:18:57.850505 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:18:57.850470    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:19:05.036453 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:05.036401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:05.362240 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:05.362148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:26.341917 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:26.341878    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:32.015234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:32.015203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:32.114882 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:32.114856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:32.377852 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:32.377780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:32.689112 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:32.689037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:32.969052 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:32.969023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:35.162855 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:35.162819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:35.264256 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:35.264223    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:35.468111 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:35.468082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:35.556013 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:35.555981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:35.655610 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:35.655578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:35.897880 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:35.897804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:36.000390 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:36.000356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:39.677359 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:39.677326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:40.014653 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:40.014615    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:40.330310 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:40.330222    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:40.873408 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:40.873360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:41.348271 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:41.348242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:19:43.226316 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:43.226286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:43.366440 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:43.366412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:43.452895 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:43.452856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:43.553139 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:43.553044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:43.868018 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:43.867946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:43.976849 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:43.976812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:47.717446 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:47.717414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:48.954789 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.954759    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"]
Jul 10 03:19:48.955158 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.955137    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1020df-d4c1-4e64-b9c1-b79bd9278203" containerName="main"
Jul 10 03:19:48.955158 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.955150    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1020df-d4c1-4e64-b9c1-b79bd9278203" containerName="main"
Jul 10 03:19:48.955231 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.955201    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f1020df-d4c1-4e64-b9c1-b79bd9278203" containerName="main"
Jul 10 03:19:48.957944 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.957928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:48.960657 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.960636    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-58a4b7\"/\"kube-root-ca.crt\""
Jul 10 03:19:48.961646 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.961632    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-58a4b7\"/\"openshift-service-ca.crt\""
Jul 10 03:19:48.961827 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.961808    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-58a4b7\"/\"test-model-58a4b7-kserve-self-signed-certs\""
Jul 10 03:19:48.961873 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.961824    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-58a4b7\"/\"default-dockercfg-d6qfw\""
Jul 10 03:19:48.968013 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.967992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"]
Jul 10 03:19:48.974988 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:48.974959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:49.082996 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.082964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-home\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.082996 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.082999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-dshm\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.083234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.083036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-tmp-dir\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.083234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.083080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-model-cache\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.083234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.083096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9npf\" (UniqueName: \"kubernetes.io/projected/51875630-6c4c-44c5-9906-6ade6dceb929-kube-api-access-z9npf\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.083234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.083115    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51875630-6c4c-44c5-9906-6ade6dceb929-tls-certs\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184160 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-model-cache\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184160 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9npf\" (UniqueName: \"kubernetes.io/projected/51875630-6c4c-44c5-9906-6ade6dceb929-kube-api-access-z9npf\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184413 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51875630-6c4c-44c5-9906-6ade6dceb929-tls-certs\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184413 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-home\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184413 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-dshm\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184413 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-tmp-dir\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184633 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184596    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-model-cache\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184725 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-tmp-dir\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.184725 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.184725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-home\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.186753 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.186725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-dshm\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.186927 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.186908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51875630-6c4c-44c5-9906-6ade6dceb929-tls-certs\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.192463 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.192444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9npf\" (UniqueName: \"kubernetes.io/projected/51875630-6c4c-44c5-9906-6ade6dceb929-kube-api-access-z9npf\") pod \"test-model-58a4b7-kserve-69d469798c-9tmh8\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") " pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.267872 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.267797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:49.399494 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.399468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"]
Jul 10 03:19:49.401973 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:19:49.401934    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51875630_6c4c_44c5_9906_6ade6dceb929.slice/crio-efa0009d0ffa2b5d5d11cf4d055aaaa8eef19d7527ed5476d504907cddf3a8bc WatchSource:0}: Error finding container efa0009d0ffa2b5d5d11cf4d055aaaa8eef19d7527ed5476d504907cddf3a8bc: Status 404 returned error can't find the container with id efa0009d0ffa2b5d5d11cf4d055aaaa8eef19d7527ed5476d504907cddf3a8bc
Jul 10 03:19:49.628937 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.628852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8" event={"ID":"51875630-6c4c-44c5-9906-6ade6dceb929","Type":"ContainerStarted","Data":"de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3"}
Jul 10 03:19:49.628937 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.628893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8" event={"ID":"51875630-6c4c-44c5-9906-6ade6dceb929","Type":"ContainerStarted","Data":"efa0009d0ffa2b5d5d11cf4d055aaaa8eef19d7527ed5476d504907cddf3a8bc"}
Jul 10 03:19:49.646738 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:49.646672    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8" podStartSLOduration=1.6466565100000001 podStartE2EDuration="1.64665651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:19:49.64576479 +0000 UTC m=+1862.766963789" watchObservedRunningTime="2026-07-10 03:19:49.64665651 +0000 UTC m=+1862.767855489"
Jul 10 03:19:56.580211 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:56.580150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:56.687366 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:56.687336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:19:56.855951 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:56.855876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:19:59.268559 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:59.268528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:59.268559 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:59.268570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:59.280966 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:59.280937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:19:59.684040 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:19:59.683962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:20:04.582026 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:04.581986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:04.684037 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:04.684002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:13.065725 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.065635    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"]
Jul 10 03:20:13.069147 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.069130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.073235 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.073214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5597fe\"/\"kube-root-ca.crt\""
Jul 10 03:20:13.073363 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.073258    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5597fe\"/\"default-dockercfg-lkb89\""
Jul 10 03:20:13.073363 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.073264    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5597fe\"/\"test-model-5597fe-kserve-self-signed-certs\""
Jul 10 03:20:13.073363 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.073304    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5597fe\"/\"openshift-service-ca.crt\""
Jul 10 03:20:13.077347 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.077325    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"]
Jul 10 03:20:13.081111 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.081086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tls-certs\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.081210 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.081135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm44t\" (UniqueName: \"kubernetes.io/projected/31dc4b24-f38b-4e67-9e66-e995674a1fa8-kube-api-access-sm44t\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.081248 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.081224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tmp-dir\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.081283 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.081261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-model-cache\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.081323 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.081287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-home\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.081372 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.081352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-dshm\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.082845 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.082824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:13.181765 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.181737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tmp-dir\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.181912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.181774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-model-cache\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.181912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.181796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-home\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.181912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.181830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-dshm\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.181912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.181857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tls-certs\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.181912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.181892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm44t\" (UniqueName: \"kubernetes.io/projected/31dc4b24-f38b-4e67-9e66-e995674a1fa8-kube-api-access-sm44t\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.182170 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.182139    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-model-cache\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.182234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.182187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tmp-dir\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.182234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.182203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-home\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.184261 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.184243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-dshm\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.184444 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.184429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tls-certs\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.189731 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.189711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm44t\" (UniqueName: \"kubernetes.io/projected/31dc4b24-f38b-4e67-9e66-e995674a1fa8-kube-api-access-sm44t\") pod \"test-model-5597fe-kserve-75fb4c8959-qsrg8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") " pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.379905 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.379833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:13.509791 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.509767    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"]
Jul 10 03:20:13.511332 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:20:13.511304    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31dc4b24_f38b_4e67_9e66_e995674a1fa8.slice/crio-9aa0daf1c66d5437507d6b7d9c4738ad850e3e82b197b3db406c79d76fbc7bae WatchSource:0}: Error finding container 9aa0daf1c66d5437507d6b7d9c4738ad850e3e82b197b3db406c79d76fbc7bae: Status 404 returned error can't find the container with id 9aa0daf1c66d5437507d6b7d9c4738ad850e3e82b197b3db406c79d76fbc7bae
Jul 10 03:20:13.738221 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.738185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8" event={"ID":"31dc4b24-f38b-4e67-9e66-e995674a1fa8","Type":"ContainerStarted","Data":"d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae"}
Jul 10 03:20:13.738388 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.738235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8" event={"ID":"31dc4b24-f38b-4e67-9e66-e995674a1fa8","Type":"ContainerStarted","Data":"9aa0daf1c66d5437507d6b7d9c4738ad850e3e82b197b3db406c79d76fbc7bae"}
Jul 10 03:20:13.760877 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:13.760825    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8" podStartSLOduration=0.760809591 podStartE2EDuration="760.809591ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:20:13.753119592 +0000 UTC m=+1886.874318574" watchObservedRunningTime="2026-07-10 03:20:13.760809591 +0000 UTC m=+1886.882008571"
Jul 10 03:20:18.747310 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:18.747274    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:20:23.380835 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:23.380805    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:23.381221 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:23.380848    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:23.392934 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:23.392907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:23.793878 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:23.793845    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:30.836239 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:30.836204    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"]
Jul 10 03:20:30.857616 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:30.857584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:31.763237 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:31.763204    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"]
Jul 10 03:20:31.782866 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:31.782836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:31.958904 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:31.958874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:32.359120 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:32.359082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:32.458750 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:32.458662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:32.563808 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:32.563780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:32.659853 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:32.659779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:35.852361 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:35.852332    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:20:37.437839 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:37.437803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:42.832444 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:42.832406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:20:45.856877 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:45.856822    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8" podUID="51875630-6c4c-44c5-9906-6ade6dceb929" containerName="main" containerID="cri-o://de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3" gracePeriod=45
Jul 10 03:20:46.110780 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.110725    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:20:46.264423 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.264391    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-home\") pod \"51875630-6c4c-44c5-9906-6ade6dceb929\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") "
Jul 10 03:20:46.264604 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.264459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51875630-6c4c-44c5-9906-6ade6dceb929-tls-certs\") pod \"51875630-6c4c-44c5-9906-6ade6dceb929\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") "
Jul 10 03:20:46.264604 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.264492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9npf\" (UniqueName: \"kubernetes.io/projected/51875630-6c4c-44c5-9906-6ade6dceb929-kube-api-access-z9npf\") pod \"51875630-6c4c-44c5-9906-6ade6dceb929\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") "
Jul 10 03:20:46.264604 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.264531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-model-cache\") pod \"51875630-6c4c-44c5-9906-6ade6dceb929\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") "
Jul 10 03:20:46.264604 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.264572    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-tmp-dir\") pod \"51875630-6c4c-44c5-9906-6ade6dceb929\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") "
Jul 10 03:20:46.264604 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.264605    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-dshm\") pod \"51875630-6c4c-44c5-9906-6ade6dceb929\" (UID: \"51875630-6c4c-44c5-9906-6ade6dceb929\") "
Jul 10 03:20:46.264938 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.264904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-home" (OuterVolumeSpecName: "home") pod "51875630-6c4c-44c5-9906-6ade6dceb929" (UID: "51875630-6c4c-44c5-9906-6ade6dceb929"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:20:46.265140 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.265063    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-model-cache" (OuterVolumeSpecName: "model-cache") pod "51875630-6c4c-44c5-9906-6ade6dceb929" (UID: "51875630-6c4c-44c5-9906-6ade6dceb929"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:20:46.265385 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.265109    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "51875630-6c4c-44c5-9906-6ade6dceb929" (UID: "51875630-6c4c-44c5-9906-6ade6dceb929"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:20:46.266879 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.266846    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51875630-6c4c-44c5-9906-6ade6dceb929-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "51875630-6c4c-44c5-9906-6ade6dceb929" (UID: "51875630-6c4c-44c5-9906-6ade6dceb929"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:20:46.266996 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.266881    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51875630-6c4c-44c5-9906-6ade6dceb929-kube-api-access-z9npf" (OuterVolumeSpecName: "kube-api-access-z9npf") pod "51875630-6c4c-44c5-9906-6ade6dceb929" (UID: "51875630-6c4c-44c5-9906-6ade6dceb929"). InnerVolumeSpecName "kube-api-access-z9npf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:20:46.266996 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.266931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-dshm" (OuterVolumeSpecName: "dshm") pod "51875630-6c4c-44c5-9906-6ade6dceb929" (UID: "51875630-6c4c-44c5-9906-6ade6dceb929"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:20:46.365723 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.365636    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:46.365723 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.365661    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:46.365723 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.365669    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:46.365723 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.365677    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51875630-6c4c-44c5-9906-6ade6dceb929-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:46.365723 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.365707    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9npf\" (UniqueName: \"kubernetes.io/projected/51875630-6c4c-44c5-9906-6ade6dceb929-kube-api-access-z9npf\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:46.365723 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.365715    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51875630-6c4c-44c5-9906-6ade6dceb929-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:46.784299 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.784246    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8" podUID="31dc4b24-f38b-4e67-9e66-e995674a1fa8" containerName="main" containerID="cri-o://d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae" gracePeriod=45
Jul 10 03:20:46.888555 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.888521    2578 generic.go:356] "Generic (PLEG): container finished" podID="51875630-6c4c-44c5-9906-6ade6dceb929" containerID="de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3" exitCode=0
Jul 10 03:20:46.888947 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.888567    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"
Jul 10 03:20:46.888947 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.888566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8" event={"ID":"51875630-6c4c-44c5-9906-6ade6dceb929","Type":"ContainerDied","Data":"de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3"}
Jul 10 03:20:46.888947 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.888704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8" event={"ID":"51875630-6c4c-44c5-9906-6ade6dceb929","Type":"ContainerDied","Data":"efa0009d0ffa2b5d5d11cf4d055aaaa8eef19d7527ed5476d504907cddf3a8bc"}
Jul 10 03:20:46.888947 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.888730    2578 scope.go:117] "RemoveContainer" containerID="de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3"
Jul 10 03:20:46.898464 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.898448    2578 scope.go:117] "RemoveContainer" containerID="de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3"
Jul 10 03:20:46.898766 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:20:46.898743    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3\": container with ID starting with de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3 not found: ID does not exist" containerID="de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3"
Jul 10 03:20:46.898868 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.898774    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3"} err="failed to get container status \"de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3\": rpc error: code = NotFound desc = could not find container \"de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3\": container with ID starting with de876bbe993b5bd3344acae05d53336275083899f0e6aedf4ecbdb8d236067e3 not found: ID does not exist"
Jul 10 03:20:46.909911 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.909888    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"]
Jul 10 03:20:46.913748 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:46.913725    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-58a4b7/test-model-58a4b7-kserve-69d469798c-9tmh8"]
Jul 10 03:20:47.042070 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.042012    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:47.172701 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.172660    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-home\") pod \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") "
Jul 10 03:20:47.172891 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.172769    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-model-cache\") pod \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") "
Jul 10 03:20:47.172891 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.172840    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tmp-dir\") pod \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") "
Jul 10 03:20:47.172891 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.172874    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tls-certs\") pod \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") "
Jul 10 03:20:47.173046 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.172899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm44t\" (UniqueName: \"kubernetes.io/projected/31dc4b24-f38b-4e67-9e66-e995674a1fa8-kube-api-access-sm44t\") pod \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") "
Jul 10 03:20:47.173046 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.172921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-dshm\") pod \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\" (UID: \"31dc4b24-f38b-4e67-9e66-e995674a1fa8\") "
Jul 10 03:20:47.173046 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.172983    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-home" (OuterVolumeSpecName: "home") pod "31dc4b24-f38b-4e67-9e66-e995674a1fa8" (UID: "31dc4b24-f38b-4e67-9e66-e995674a1fa8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:20:47.173046 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.173002    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-model-cache" (OuterVolumeSpecName: "model-cache") pod "31dc4b24-f38b-4e67-9e66-e995674a1fa8" (UID: "31dc4b24-f38b-4e67-9e66-e995674a1fa8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:20:47.173229 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.173152    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "31dc4b24-f38b-4e67-9e66-e995674a1fa8" (UID: "31dc4b24-f38b-4e67-9e66-e995674a1fa8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:20:47.173273 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.173261    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:47.173311 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.173278    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:47.173311 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.173290    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:47.175257 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.175221    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-dshm" (OuterVolumeSpecName: "dshm") pod "31dc4b24-f38b-4e67-9e66-e995674a1fa8" (UID: "31dc4b24-f38b-4e67-9e66-e995674a1fa8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:20:47.175368 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.175282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31dc4b24-f38b-4e67-9e66-e995674a1fa8" (UID: "31dc4b24-f38b-4e67-9e66-e995674a1fa8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:20:47.175368 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.175302    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31dc4b24-f38b-4e67-9e66-e995674a1fa8-kube-api-access-sm44t" (OuterVolumeSpecName: "kube-api-access-sm44t") pod "31dc4b24-f38b-4e67-9e66-e995674a1fa8" (UID: "31dc4b24-f38b-4e67-9e66-e995674a1fa8"). InnerVolumeSpecName "kube-api-access-sm44t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:20:47.273977 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.273946    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31dc4b24-f38b-4e67-9e66-e995674a1fa8-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:47.273977 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.273971    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm44t\" (UniqueName: \"kubernetes.io/projected/31dc4b24-f38b-4e67-9e66-e995674a1fa8-kube-api-access-sm44t\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:47.273977 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.273980    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31dc4b24-f38b-4e67-9e66-e995674a1fa8-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:20:47.349606 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.349532    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51875630-6c4c-44c5-9906-6ade6dceb929" path="/var/lib/kubelet/pods/51875630-6c4c-44c5-9906-6ade6dceb929/volumes"
Jul 10 03:20:47.894031 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.894004    2578 generic.go:356] "Generic (PLEG): container finished" podID="31dc4b24-f38b-4e67-9e66-e995674a1fa8" containerID="d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae" exitCode=0
Jul 10 03:20:47.894437 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.894054    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"
Jul 10 03:20:47.894437 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.894086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8" event={"ID":"31dc4b24-f38b-4e67-9e66-e995674a1fa8","Type":"ContainerDied","Data":"d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae"}
Jul 10 03:20:47.894437 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.894124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8" event={"ID":"31dc4b24-f38b-4e67-9e66-e995674a1fa8","Type":"ContainerDied","Data":"9aa0daf1c66d5437507d6b7d9c4738ad850e3e82b197b3db406c79d76fbc7bae"}
Jul 10 03:20:47.894437 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.894140    2578 scope.go:117] "RemoveContainer" containerID="d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae"
Jul 10 03:20:47.902247 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.902228    2578 scope.go:117] "RemoveContainer" containerID="d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae"
Jul 10 03:20:47.902507 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:20:47.902478    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae\": container with ID starting with d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae not found: ID does not exist" containerID="d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae"
Jul 10 03:20:47.902581 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.902512    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae"} err="failed to get container status \"d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae\": rpc error: code = NotFound desc = could not find container \"d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae\": container with ID starting with d7ae1c6c55bbaf8f1b96fc74852ea627cbac5dd3a71f12c58dfcfe25e4d7a3ae not found: ID does not exist"
Jul 10 03:20:47.911360 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.911334    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"]
Jul 10 03:20:47.913126 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:47.913103    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5597fe/test-model-5597fe-kserve-75fb4c8959-qsrg8"]
Jul 10 03:20:49.348591 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:20:49.348559    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31dc4b24-f38b-4e67-9e66-e995674a1fa8" path="/var/lib/kubelet/pods/31dc4b24-f38b-4e67-9e66-e995674a1fa8/volumes"
Jul 10 03:21:14.033255 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:14.033219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:14.343279 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:14.343161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:14.566536 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:14.566507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:14.742888 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:14.742848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:15.174253 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:15.174167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:15.381359 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:15.381324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:15.483749 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:15.483720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:15.634214 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:15.634169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:18.481354 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:18.481317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:21:20.899128 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:20.899084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:20.959647 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:20.959617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:21.185370 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:21.185287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:21.435885 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:21.435808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:21.787841 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:21.787806    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:22.099450 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:22.099337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:22.211333 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:22.211297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:24.767263 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:24.767211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:24.877974 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:24.877931    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:24.977294 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:24.977264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:25.310464 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:25.310427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:25.411812 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:25.411755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:25.628720 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:25.628585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:29.315511 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:29.315479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:29.794751 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:29.794712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:30.104731 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:30.104621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:30.292232 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:30.292197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:32.653897 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:32.653862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:21:32.795394 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:32.795350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:32.876526 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:32.876491    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:32.942196 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:32.942159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:33.412624 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:33.412553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:33.513112 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:33.513082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:33.613967 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:33.613938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:37.302800 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:37.302756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:45.419419 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:45.419336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:45.519947 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:45.519918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:45.799130 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:45.799091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:45.902098 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:45.902065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:46.002014 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:46.001980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:46.093247 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:46.093176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:47.253401 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:47.253373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:21:51.684829 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:51.684792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:51.742843 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:51.742811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:51.971994 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:51.971956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:52.205947 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:52.205913    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:52.387696 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:52.387604    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:52.793006 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:52.792974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:52.888566 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:52.888532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:52.989102 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:52.989073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:53.078562 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:53.078489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:58.428609 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:58.428576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:58.495640 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:58.495607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:58.676047 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:58.676018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:58.905525 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:58.905493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:21:58.952025 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:58.951993    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:21:59.247309 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:21:59.247278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:00.534289 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:00.534254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:02.989080 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:02.989044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:03.069389 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:03.069337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:03.133529 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:03.133496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:03.418116 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:03.418025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:03.561205 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:03.561176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:03.661016 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:03.660990    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:07.516172 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:07.516135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:07.880590 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:07.880514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:08.161173 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:08.161097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:08.346135 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:08.346100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:08.883987 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:08.883955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:08.984837 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:08.984802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:10.751144 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:10.751109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:22:11.008508 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:11.008382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:11.089586 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:11.089558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:11.146426 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:11.146388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:11.486318 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:11.486290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:11.587396 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:11.587359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:11.684888 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:11.684857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:15.545210 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:15.545179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:23.558828 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.558797    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"]
Jul 10 03:22:23.559291 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.559175    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51875630-6c4c-44c5-9906-6ade6dceb929" containerName="main"
Jul 10 03:22:23.559291 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.559187    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="51875630-6c4c-44c5-9906-6ade6dceb929" containerName="main"
Jul 10 03:22:23.559291 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.559213    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dc4b24-f38b-4e67-9e66-e995674a1fa8" containerName="main"
Jul 10 03:22:23.559291 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.559218    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dc4b24-f38b-4e67-9e66-e995674a1fa8" containerName="main"
Jul 10 03:22:23.559291 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.559283    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dc4b24-f38b-4e67-9e66-e995674a1fa8" containerName="main"
Jul 10 03:22:23.559291 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.559291    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="51875630-6c4c-44c5-9906-6ade6dceb929" containerName="main"
Jul 10 03:22:23.562237 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.562221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.565114 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.565092    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"default-dockercfg-jfptv\""
Jul 10 03:22:23.565249 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.565093    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"openshift-service-ca.crt\""
Jul 10 03:22:23.566063 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.566046    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"kube-root-ca.crt\""
Jul 10 03:22:23.566355 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.566340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"auth-test-model-f42020-kserve-self-signed-certs\""
Jul 10 03:22:23.571281 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.571262    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"]
Jul 10 03:22:23.589208 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.589187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:23.676007 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.675978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-dshm\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.676128 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.676016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-home\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.676128 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.676037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tmp-dir\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.676128 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.676073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tls-certs\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.676234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.676185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8rm2\" (UniqueName: \"kubernetes.io/projected/dfb11702-18a7-4120-8b96-5caca4c4ecc8-kube-api-access-w8rm2\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.676234 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.676226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-model-cache\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.777616 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.777586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-home\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.777774 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.777622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tmp-dir\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.777774 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.777639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tls-certs\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.777774 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.777703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8rm2\" (UniqueName: \"kubernetes.io/projected/dfb11702-18a7-4120-8b96-5caca4c4ecc8-kube-api-access-w8rm2\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.777774 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.777744    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-model-cache\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.777941 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.777819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-dshm\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.778062 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.778042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-home\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.778137 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.778114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tmp-dir\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.778195 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.778175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-model-cache\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.780085 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.780054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-dshm\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.780212 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.780195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tls-certs\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.785126 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.785102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8rm2\" (UniqueName: \"kubernetes.io/projected/dfb11702-18a7-4120-8b96-5caca4c4ecc8-kube-api-access-w8rm2\") pod \"auth-test-model-f42020-kserve-7596c77f47-tb9ns\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") " pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.871298 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.871223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:23.999262 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:23.999236    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"]
Jul 10 03:22:24.002182 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:22:24.002150    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfb11702_18a7_4120_8b96_5caca4c4ecc8.slice/crio-e8732beca65e2360f6de27da95f1d1e92c352c811f4ea40b887e3ddea8b34bd4 WatchSource:0}: Error finding container e8732beca65e2360f6de27da95f1d1e92c352c811f4ea40b887e3ddea8b34bd4: Status 404 returned error can't find the container with id e8732beca65e2360f6de27da95f1d1e92c352c811f4ea40b887e3ddea8b34bd4
Jul 10 03:22:24.266632 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:24.266597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:24.322283 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:24.322251    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns" event={"ID":"dfb11702-18a7-4120-8b96-5caca4c4ecc8","Type":"ContainerStarted","Data":"e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8"}
Jul 10 03:22:24.322283 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:24.322288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns" event={"ID":"dfb11702-18a7-4120-8b96-5caca4c4ecc8","Type":"ContainerStarted","Data":"e8732beca65e2360f6de27da95f1d1e92c352c811f4ea40b887e3ddea8b34bd4"}
Jul 10 03:22:24.339774 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:24.339733    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns" podStartSLOduration=1.339720905 podStartE2EDuration="1.339720905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:22:24.338362262 +0000 UTC m=+2017.459561241" watchObservedRunningTime="2026-07-10 03:22:24.339720905 +0000 UTC m=+2017.460919885"
Jul 10 03:22:24.342226 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:24.342186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:26.154522 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:26.154485    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:22:33.160211 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:33.160177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:33.261303 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:33.261266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:33.872297 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:33.872263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:33.872503 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:33.872335    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:33.884842 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:33.884817    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:34.376433 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:34.376404    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:22:47.061751 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.061713    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"]
Jul 10 03:22:47.065400 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.065383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.067922 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.067894    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"openshift-service-ca.crt\""
Jul 10 03:22:47.068902 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.068884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"default-dockercfg-tqtpj\""
Jul 10 03:22:47.069214 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.069187    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"kube-root-ca.crt\""
Jul 10 03:22:47.069305 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.069216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"auth-test-model-45a5a5-kserve-self-signed-certs\""
Jul 10 03:22:47.076554 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.076526    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"]
Jul 10 03:22:47.173527 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.173497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sppdx\" (UniqueName: \"kubernetes.io/projected/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-kube-api-access-sppdx\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.173656 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.173537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tmp-dir\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.173656 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.173608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tls-certs\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.173765 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.173696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-home\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.173765 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.173727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-model-cache\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.173832 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.173789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-dshm\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.267156 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.267124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:22:47.274439 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.274411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sppdx\" (UniqueName: \"kubernetes.io/projected/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-kube-api-access-sppdx\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.274562 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.274462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tmp-dir\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.274562 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.274524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tls-certs\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.274562 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.274553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-home\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.274759 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.274581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-model-cache\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.274759 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.274645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-dshm\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.274958 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.274933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-home\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.275024 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.274958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-model-cache\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.275064 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.275018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tmp-dir\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.277013 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.276994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-dshm\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.277095 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.277043    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"auth-test-model-45a5a5-kserve-self-signed-certs\""
Jul 10 03:22:47.282531 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.282514    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"kube-root-ca.crt\""
Jul 10 03:22:47.287577 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.287550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tls-certs\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.292390 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.292374    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"openshift-service-ca.crt\""
Jul 10 03:22:47.302661 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.302637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sppdx\" (UniqueName: \"kubernetes.io/projected/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-kube-api-access-sppdx\") pod \"auth-test-model-45a5a5-kserve-5847d6987f-vvnzd\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") " pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.378984 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.378926    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"default-dockercfg-tqtpj\""
Jul 10 03:22:47.386167 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.386148    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:47.525054 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:47.525022    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"]
Jul 10 03:22:47.528916 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:22:47.528884    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb6ce1b5_70d8_481e_ba3f_00a9b08d56b4.slice/crio-41c63ec3557e3829a37e2800f37b91201a5d2cafcb063812ede0074e95484c3d WatchSource:0}: Error finding container 41c63ec3557e3829a37e2800f37b91201a5d2cafcb063812ede0074e95484c3d: Status 404 returned error can't find the container with id 41c63ec3557e3829a37e2800f37b91201a5d2cafcb063812ede0074e95484c3d
Jul 10 03:22:48.426640 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:48.426608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd" event={"ID":"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4","Type":"ContainerStarted","Data":"a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450"}
Jul 10 03:22:48.427019 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:48.426647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd" event={"ID":"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4","Type":"ContainerStarted","Data":"41c63ec3557e3829a37e2800f37b91201a5d2cafcb063812ede0074e95484c3d"}
Jul 10 03:22:48.443030 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:48.442979    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd" podStartSLOduration=1.442965404 podStartE2EDuration="1.442965404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:22:48.441238933 +0000 UTC m=+2041.562437913" watchObservedRunningTime="2026-07-10 03:22:48.442965404 +0000 UTC m=+2041.564164383"
Jul 10 03:22:50.855495 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:50.855461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:22:57.386718 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:57.386667    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:57.386718 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:57.386725    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:57.398883 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:57.398859    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:22:57.482900 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:22:57.482875    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:23:03.754378 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:23:03.754338    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:23:22.051709 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:23:22.051608    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:23:38.954061 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:23:38.954026    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:23:47.416161 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:23:47.416130    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:23:47.424226 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:23:47.424207    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:23:55.947057 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:23:55.947015    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:24:13.052816 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:13.052780    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:24:23.964102 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:23.964070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:24:30.352487 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:30.352456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:24:42.241069 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:42.240993    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"]
Jul 10 03:24:42.265285 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:42.265252    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:24:43.074371 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:43.074325    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"]
Jul 10 03:24:43.090814 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:43.090782    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:24:46.047506 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:46.047470    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:24:57.261182 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.261138    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns" podUID="dfb11702-18a7-4120-8b96-5caca4c4ecc8" containerName="main" containerID="cri-o://e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8" gracePeriod=45
Jul 10 03:24:57.514677 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.514625    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:24:57.572693 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.572663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-home\") pod \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") "
Jul 10 03:24:57.572831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.572744    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tmp-dir\") pod \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") "
Jul 10 03:24:57.572831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.572779    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tls-certs\") pod \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") "
Jul 10 03:24:57.572831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.572797    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8rm2\" (UniqueName: \"kubernetes.io/projected/dfb11702-18a7-4120-8b96-5caca4c4ecc8-kube-api-access-w8rm2\") pod \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") "
Jul 10 03:24:57.572831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.572823    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-model-cache\") pod \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") "
Jul 10 03:24:57.573044 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.572952    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-dshm\") pod \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\" (UID: \"dfb11702-18a7-4120-8b96-5caca4c4ecc8\") "
Jul 10 03:24:57.573109 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.572949    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-home" (OuterVolumeSpecName: "home") pod "dfb11702-18a7-4120-8b96-5caca4c4ecc8" (UID: "dfb11702-18a7-4120-8b96-5caca4c4ecc8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:24:57.573109 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.572989    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dfb11702-18a7-4120-8b96-5caca4c4ecc8" (UID: "dfb11702-18a7-4120-8b96-5caca4c4ecc8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:24:57.573109 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.573079    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-model-cache" (OuterVolumeSpecName: "model-cache") pod "dfb11702-18a7-4120-8b96-5caca4c4ecc8" (UID: "dfb11702-18a7-4120-8b96-5caca4c4ecc8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:24:57.573279 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.573262    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:57.573316 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.573285    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:57.573316 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.573296    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:57.575059 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.575039    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-dshm" (OuterVolumeSpecName: "dshm") pod "dfb11702-18a7-4120-8b96-5caca4c4ecc8" (UID: "dfb11702-18a7-4120-8b96-5caca4c4ecc8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:24:57.575164 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.575100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dfb11702-18a7-4120-8b96-5caca4c4ecc8" (UID: "dfb11702-18a7-4120-8b96-5caca4c4ecc8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:24:57.575164 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.575100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb11702-18a7-4120-8b96-5caca4c4ecc8-kube-api-access-w8rm2" (OuterVolumeSpecName: "kube-api-access-w8rm2") pod "dfb11702-18a7-4120-8b96-5caca4c4ecc8" (UID: "dfb11702-18a7-4120-8b96-5caca4c4ecc8"). InnerVolumeSpecName "kube-api-access-w8rm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:24:57.673912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.673882    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb11702-18a7-4120-8b96-5caca4c4ecc8-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:57.673912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.673905    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8rm2\" (UniqueName: \"kubernetes.io/projected/dfb11702-18a7-4120-8b96-5caca4c4ecc8-kube-api-access-w8rm2\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:57.673912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:57.673914    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb11702-18a7-4120-8b96-5caca4c4ecc8-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:58.018632 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.018598    2578 generic.go:356] "Generic (PLEG): container finished" podID="dfb11702-18a7-4120-8b96-5caca4c4ecc8" containerID="e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8" exitCode=0
Jul 10 03:24:58.018824 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.018654    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"
Jul 10 03:24:58.018824 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.018658    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns" event={"ID":"dfb11702-18a7-4120-8b96-5caca4c4ecc8","Type":"ContainerDied","Data":"e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8"}
Jul 10 03:24:58.018824 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.018767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns" event={"ID":"dfb11702-18a7-4120-8b96-5caca4c4ecc8","Type":"ContainerDied","Data":"e8732beca65e2360f6de27da95f1d1e92c352c811f4ea40b887e3ddea8b34bd4"}
Jul 10 03:24:58.018824 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.018794    2578 scope.go:117] "RemoveContainer" containerID="e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8"
Jul 10 03:24:58.027742 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.027722    2578 scope.go:117] "RemoveContainer" containerID="e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8"
Jul 10 03:24:58.027990 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:24:58.027972    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8\": container with ID starting with e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8 not found: ID does not exist" containerID="e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8"
Jul 10 03:24:58.028064 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.028003    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8"} err="failed to get container status \"e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8\": rpc error: code = NotFound desc = could not find container \"e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8\": container with ID starting with e67629ee0dfba4ada83b9a197603a065cc27897dbf391d85504e8b2e9f1c97e8 not found: ID does not exist"
Jul 10 03:24:58.038650 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.038618    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"]
Jul 10 03:24:58.040481 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.040460    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/auth-test-model-f42020-kserve-7596c77f47-tb9ns"]
Jul 10 03:24:58.096457 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.096423    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd" podUID="bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" containerName="main" containerID="cri-o://a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450" gracePeriod=45
Jul 10 03:24:58.350769 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.350748    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:24:58.481453 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481423    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sppdx\" (UniqueName: \"kubernetes.io/projected/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-kube-api-access-sppdx\") pod \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") "
Jul 10 03:24:58.481636 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481466    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tmp-dir\") pod \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") "
Jul 10 03:24:58.481636 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481498    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tls-certs\") pod \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") "
Jul 10 03:24:58.481636 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-model-cache\") pod \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") "
Jul 10 03:24:58.481636 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-dshm\") pod \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") "
Jul 10 03:24:58.481636 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-home\") pod \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\" (UID: \"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4\") "
Jul 10 03:24:58.481938 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481819    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" (UID: "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:24:58.481938 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481875    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" (UID: "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:24:58.481938 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.481915    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-home" (OuterVolumeSpecName: "home") pod "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" (UID: "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:24:58.483816 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.483795    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-kube-api-access-sppdx" (OuterVolumeSpecName: "kube-api-access-sppdx") pod "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" (UID: "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4"). InnerVolumeSpecName "kube-api-access-sppdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:24:58.483941 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.483916    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-dshm" (OuterVolumeSpecName: "dshm") pod "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" (UID: "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:24:58.484014 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.483955    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" (UID: "bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:24:58.582823 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.582761    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sppdx\" (UniqueName: \"kubernetes.io/projected/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-kube-api-access-sppdx\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:58.582823 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.582787    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:58.582823 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.582796    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:58.582823 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.582805    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:58.582823 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.582813    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:58.582823 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:58.582820    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:24:59.025862 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.025824    2578 generic.go:356] "Generic (PLEG): container finished" podID="bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" containerID="a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450" exitCode=0
Jul 10 03:24:59.026036 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.025872    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"
Jul 10 03:24:59.026036 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.025887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd" event={"ID":"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4","Type":"ContainerDied","Data":"a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450"}
Jul 10 03:24:59.026036 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.025924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd" event={"ID":"bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4","Type":"ContainerDied","Data":"41c63ec3557e3829a37e2800f37b91201a5d2cafcb063812ede0074e95484c3d"}
Jul 10 03:24:59.026036 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.025945    2578 scope.go:117] "RemoveContainer" containerID="a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450"
Jul 10 03:24:59.034799 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.034779    2578 scope.go:117] "RemoveContainer" containerID="a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450"
Jul 10 03:24:59.035053 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:24:59.035020    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450\": container with ID starting with a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450 not found: ID does not exist" containerID="a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450"
Jul 10 03:24:59.035104 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.035062    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450"} err="failed to get container status \"a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450\": rpc error: code = NotFound desc = could not find container \"a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450\": container with ID starting with a6348468008f8df46efd182274f5c6784327e847b059d0186795b7c754956450 not found: ID does not exist"
Jul 10 03:24:59.045908 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.045885    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"]
Jul 10 03:24:59.048690 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.048657    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/auth-test-model-45a5a5-kserve-5847d6987f-vvnzd"]
Jul 10 03:24:59.348281 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.348201    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" path="/var/lib/kubelet/pods/bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4/volumes"
Jul 10 03:24:59.348586 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.348574    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb11702-18a7-4120-8b96-5caca4c4ecc8" path="/var/lib/kubelet/pods/dfb11702-18a7-4120-8b96-5caca4c4ecc8/volumes"
Jul 10 03:24:59.963419 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.963387    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"]
Jul 10 03:24:59.963794 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.963749    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb11702-18a7-4120-8b96-5caca4c4ecc8" containerName="main"
Jul 10 03:24:59.963794 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.963760    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb11702-18a7-4120-8b96-5caca4c4ecc8" containerName="main"
Jul 10 03:24:59.963794 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.963770    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" containerName="main"
Jul 10 03:24:59.963794 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.963775    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" containerName="main"
Jul 10 03:24:59.963938 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.963832    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb6ce1b5-70d8-481e-ba3f-00a9b08d56b4" containerName="main"
Jul 10 03:24:59.963938 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.963841    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb11702-18a7-4120-8b96-5caca4c4ecc8" containerName="main"
Jul 10 03:24:59.973288 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.973265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:24:59.975976 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.975954    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"kube-root-ca.crt\""
Jul 10 03:24:59.976728 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.976707    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"default-dockercfg-jfptv\""
Jul 10 03:24:59.976728 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.976725    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"openshift-service-ca.crt\""
Jul 10 03:24:59.976906 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.976712    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"sub-test-model-f42020-kserve-self-signed-certs\""
Jul 10 03:24:59.977015 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.976990    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"]
Jul 10 03:24:59.995318 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:24:59.995297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:25:00.095141 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.095108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-model-cache\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.095141 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.095142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2fth\" (UniqueName: \"kubernetes.io/projected/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-kube-api-access-g2fth\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.095355 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.095230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-dshm\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.095355 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.095264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tmp-dir\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.095355 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.095293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-home\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.095355 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.095319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tls-certs\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.196495 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.196461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-model-cache\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.196495 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.196496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2fth\" (UniqueName: \"kubernetes.io/projected/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-kube-api-access-g2fth\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.196728 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.196567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-dshm\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.196728 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.196597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tmp-dir\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.196728 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.196634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-home\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.196728 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.196665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tls-certs\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.196976 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.196951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-model-cache\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.197054 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.196973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tmp-dir\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.197109 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.197065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-home\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.198911 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.198889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-dshm\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.199166 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.199149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tls-certs\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.204720 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.204676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2fth\" (UniqueName: \"kubernetes.io/projected/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-kube-api-access-g2fth\") pod \"sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") " pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.284532 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.284458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:00.425087 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:00.425063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"]
Jul 10 03:25:00.427861 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:25:00.427834    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26dfbfc5_3ae9_4ece_80d5_1ef9be8a777c.slice/crio-289bd676cc384106d0f30ca906c13fe65882319ad50b7f8e4f6d5cdeb43fec07 WatchSource:0}: Error finding container 289bd676cc384106d0f30ca906c13fe65882319ad50b7f8e4f6d5cdeb43fec07: Status 404 returned error can't find the container with id 289bd676cc384106d0f30ca906c13fe65882319ad50b7f8e4f6d5cdeb43fec07
Jul 10 03:25:01.037892 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:01.037860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb" event={"ID":"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c","Type":"ContainerStarted","Data":"874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c"}
Jul 10 03:25:01.038272 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:01.037902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb" event={"ID":"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c","Type":"ContainerStarted","Data":"289bd676cc384106d0f30ca906c13fe65882319ad50b7f8e4f6d5cdeb43fec07"}
Jul 10 03:25:01.054898 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:01.054853    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb" podStartSLOduration=2.054838902 podStartE2EDuration="2.054838902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:25:01.053902159 +0000 UTC m=+2174.175101138" watchObservedRunningTime="2026-07-10 03:25:01.054838902 +0000 UTC m=+2174.176037882"
Jul 10 03:25:05.051788 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:05.051753    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:25:10.285488 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:10.285450    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:10.285896 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:10.285501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:10.298191 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:10.298167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:11.094536 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:11.094507    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:25:28.055083 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.055052    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"]
Jul 10 03:25:28.058290 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.058271    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.060762 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.060741    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"openshift-service-ca.crt\""
Jul 10 03:25:28.061776 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.061753    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"sub-test-model-45a5a5-kserve-self-signed-certs\""
Jul 10 03:25:28.061882 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.061866    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"kube-root-ca.crt\""
Jul 10 03:25:28.062139 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.062123    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"default-dockercfg-tqtpj\""
Jul 10 03:25:28.067593 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.067573    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"]
Jul 10 03:25:28.089689 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.089664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:25:28.135630 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.135608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-model-cache\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.135763 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.135638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tls-certs\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.135763 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.135661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-dshm\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.135763 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.135677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpx99\" (UniqueName: \"kubernetes.io/projected/67ecc678-60bd-4f22-a8c8-507884b2f8f5-kube-api-access-xpx99\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.135929 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.135805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-home\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.135929 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.135838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tmp-dir\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.236586 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.236557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-home\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.236586 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.236589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tmp-dir\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.236811 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.236670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-model-cache\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.236811 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.236732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tls-certs\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.236811 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.236765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-dshm\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.236811 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.236787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpx99\" (UniqueName: \"kubernetes.io/projected/67ecc678-60bd-4f22-a8c8-507884b2f8f5-kube-api-access-xpx99\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.237063 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.237042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-home\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.237117 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.237078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tmp-dir\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.237194 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.237176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-model-cache\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.239055 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.239022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-dshm\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.239364 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.239345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tls-certs\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.243981 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.243960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpx99\" (UniqueName: \"kubernetes.io/projected/67ecc678-60bd-4f22-a8c8-507884b2f8f5-kube-api-access-xpx99\") pod \"sub-test-model-45a5a5-kserve-7d457b4477-bn977\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") " pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.368981 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.368921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:28.498480 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:28.498451    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"]
Jul 10 03:25:28.500115 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:25:28.500086    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67ecc678_60bd_4f22_a8c8_507884b2f8f5.slice/crio-beff3832ddb81da945a0508d291b1e0dd97032fbccd9b40dc6b2ff732d57fc17 WatchSource:0}: Error finding container beff3832ddb81da945a0508d291b1e0dd97032fbccd9b40dc6b2ff732d57fc17: Status 404 returned error can't find the container with id beff3832ddb81da945a0508d291b1e0dd97032fbccd9b40dc6b2ff732d57fc17
Jul 10 03:25:29.166793 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:29.166756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977" event={"ID":"67ecc678-60bd-4f22-a8c8-507884b2f8f5","Type":"ContainerStarted","Data":"36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021"}
Jul 10 03:25:29.167179 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:29.166802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977" event={"ID":"67ecc678-60bd-4f22-a8c8-507884b2f8f5","Type":"ContainerStarted","Data":"beff3832ddb81da945a0508d291b1e0dd97032fbccd9b40dc6b2ff732d57fc17"}
Jul 10 03:25:32.057610 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:32.057557    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977" podStartSLOduration=4.057540694 podStartE2EDuration="4.057540694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:25:29.184760586 +0000 UTC m=+2202.305959565" watchObservedRunningTime="2026-07-10 03:25:32.057540694 +0000 UTC m=+2205.178739673"
Jul 10 03:25:32.058922 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:32.058902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:25:38.369665 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:38.369625    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:38.370085 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:38.369698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:38.382072 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:38.382037    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:39.226933 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:39.226905    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:25:51.848413 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:25:51.848379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:26:06.076177 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:06.076140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:26:06.127845 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:06.127799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:26:08.879899 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:08.879822    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"]
Jul 10 03:26:08.893180 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:08.893150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:26:09.674380 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:09.674350    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"]
Jul 10 03:26:09.696999 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:09.696966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:26:11.722556 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:11.722504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:26:14.147303 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:14.147264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:26:23.900563 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:23.900525    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb" podUID="26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" containerName="main" containerID="cri-o://874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c" gracePeriod=45
Jul 10 03:26:24.155572 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.155516    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:26:24.216470 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216441    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-dshm\") pod \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") "
Jul 10 03:26:24.216618 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tmp-dir\") pod \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") "
Jul 10 03:26:24.216618 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216549    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-home\") pod \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") "
Jul 10 03:26:24.216618 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216585    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-model-cache\") pod \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") "
Jul 10 03:26:24.216618 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216605    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tls-certs\") pod \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") "
Jul 10 03:26:24.216859 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216649    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2fth\" (UniqueName: \"kubernetes.io/projected/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-kube-api-access-g2fth\") pod \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\" (UID: \"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c\") "
Jul 10 03:26:24.216859 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216664    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" (UID: "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:26:24.216859 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216847    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-home" (OuterVolumeSpecName: "home") pod "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" (UID: "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:26:24.216976 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-model-cache" (OuterVolumeSpecName: "model-cache") pod "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" (UID: "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:26:24.216976 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216957    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:24.216976 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216970    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:24.217122 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.216977    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:24.218731 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.218709    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-dshm" (OuterVolumeSpecName: "dshm") pod "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" (UID: "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:26:24.218731 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.218716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" (UID: "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:26:24.218844 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.218816    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-kube-api-access-g2fth" (OuterVolumeSpecName: "kube-api-access-g2fth") pod "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" (UID: "26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c"). InnerVolumeSpecName "kube-api-access-g2fth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:26:24.317831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.317798    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:24.317831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.317823    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2fth\" (UniqueName: \"kubernetes.io/projected/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-kube-api-access-g2fth\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:24.317831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.317833    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:24.436369 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.436264    2578 generic.go:356] "Generic (PLEG): container finished" podID="26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" containerID="874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c" exitCode=0
Jul 10 03:26:24.436369 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.436330    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"
Jul 10 03:26:24.436369 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.436336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb" event={"ID":"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c","Type":"ContainerDied","Data":"874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c"}
Jul 10 03:26:24.436640 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.436386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb" event={"ID":"26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c","Type":"ContainerDied","Data":"289bd676cc384106d0f30ca906c13fe65882319ad50b7f8e4f6d5cdeb43fec07"}
Jul 10 03:26:24.436640 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.436415    2578 scope.go:117] "RemoveContainer" containerID="874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c"
Jul 10 03:26:24.445885 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.445867    2578 scope.go:117] "RemoveContainer" containerID="874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c"
Jul 10 03:26:24.446153 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:26:24.446131    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c\": container with ID starting with 874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c not found: ID does not exist" containerID="874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c"
Jul 10 03:26:24.446222 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.446160    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c"} err="failed to get container status \"874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c\": rpc error: code = NotFound desc = could not find container \"874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c\": container with ID starting with 874514b2be03e5fb06962c6ac68ffd0ccef694c25c5112486929f7dd0c0e3c3c not found: ID does not exist"
Jul 10 03:26:24.456752 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.456726    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"]
Jul 10 03:26:24.460075 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.460052    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/sub-test-model-f42020-kserve-c8cdb5cbc-bj6vb"]
Jul 10 03:26:24.694907 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.694871    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977" podUID="67ecc678-60bd-4f22-a8c8-507884b2f8f5" containerName="main" containerID="cri-o://36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021" gracePeriod=45
Jul 10 03:26:24.950439 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:24.950385    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:26:25.024637 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.024604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-dshm\") pod \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") "
Jul 10 03:26:25.024818 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.024669    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tls-certs\") pod \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") "
Jul 10 03:26:25.024818 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.024748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-home\") pod \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") "
Jul 10 03:26:25.024818 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.024786    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tmp-dir\") pod \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") "
Jul 10 03:26:25.024818 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.024813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-model-cache\") pod \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") "
Jul 10 03:26:25.024976 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.024870    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpx99\" (UniqueName: \"kubernetes.io/projected/67ecc678-60bd-4f22-a8c8-507884b2f8f5-kube-api-access-xpx99\") pod \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\" (UID: \"67ecc678-60bd-4f22-a8c8-507884b2f8f5\") "
Jul 10 03:26:25.025029 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.025005    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-home" (OuterVolumeSpecName: "home") pod "67ecc678-60bd-4f22-a8c8-507884b2f8f5" (UID: "67ecc678-60bd-4f22-a8c8-507884b2f8f5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:26:25.025082 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.025042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67ecc678-60bd-4f22-a8c8-507884b2f8f5" (UID: "67ecc678-60bd-4f22-a8c8-507884b2f8f5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:26:25.025154 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.025129    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-model-cache" (OuterVolumeSpecName: "model-cache") pod "67ecc678-60bd-4f22-a8c8-507884b2f8f5" (UID: "67ecc678-60bd-4f22-a8c8-507884b2f8f5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:26:25.025219 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.025201    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:25.025219 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.025215    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:25.026952 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.026931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67ecc678-60bd-4f22-a8c8-507884b2f8f5" (UID: "67ecc678-60bd-4f22-a8c8-507884b2f8f5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:26:25.026952 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.026941    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-dshm" (OuterVolumeSpecName: "dshm") pod "67ecc678-60bd-4f22-a8c8-507884b2f8f5" (UID: "67ecc678-60bd-4f22-a8c8-507884b2f8f5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:26:25.027116 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.027098    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ecc678-60bd-4f22-a8c8-507884b2f8f5-kube-api-access-xpx99" (OuterVolumeSpecName: "kube-api-access-xpx99") pod "67ecc678-60bd-4f22-a8c8-507884b2f8f5" (UID: "67ecc678-60bd-4f22-a8c8-507884b2f8f5"). InnerVolumeSpecName "kube-api-access-xpx99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:26:25.125797 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.125756    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67ecc678-60bd-4f22-a8c8-507884b2f8f5-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:25.125797 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.125790    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:25.125797 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.125804    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpx99\" (UniqueName: \"kubernetes.io/projected/67ecc678-60bd-4f22-a8c8-507884b2f8f5-kube-api-access-xpx99\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:25.126040 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.125816    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67ecc678-60bd-4f22-a8c8-507884b2f8f5-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:26:25.348970 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.348888    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" path="/var/lib/kubelet/pods/26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c/volumes"
Jul 10 03:26:25.442124 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.442092    2578 generic.go:356] "Generic (PLEG): container finished" podID="67ecc678-60bd-4f22-a8c8-507884b2f8f5" containerID="36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021" exitCode=0
Jul 10 03:26:25.442303 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.442138    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"
Jul 10 03:26:25.442303 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.442195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977" event={"ID":"67ecc678-60bd-4f22-a8c8-507884b2f8f5","Type":"ContainerDied","Data":"36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021"}
Jul 10 03:26:25.442303 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.442235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977" event={"ID":"67ecc678-60bd-4f22-a8c8-507884b2f8f5","Type":"ContainerDied","Data":"beff3832ddb81da945a0508d291b1e0dd97032fbccd9b40dc6b2ff732d57fc17"}
Jul 10 03:26:25.442303 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.442254    2578 scope.go:117] "RemoveContainer" containerID="36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021"
Jul 10 03:26:25.450715 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.450667    2578 scope.go:117] "RemoveContainer" containerID="36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021"
Jul 10 03:26:25.450950 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:26:25.450933    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021\": container with ID starting with 36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021 not found: ID does not exist" containerID="36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021"
Jul 10 03:26:25.451016 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.450962    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021"} err="failed to get container status \"36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021\": rpc error: code = NotFound desc = could not find container \"36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021\": container with ID starting with 36e6a51148ff8ae2db9bfb365e53212f988f95883023e09ece60ffbf522fa021 not found: ID does not exist"
Jul 10 03:26:25.457206 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.457178    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"]
Jul 10 03:26:25.459312 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.459290    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/sub-test-model-45a5a5-kserve-7d457b4477-bn977"]
Jul 10 03:26:25.661846 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.661762    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"]
Jul 10 03:26:25.662102 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.662090    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" containerName="main"
Jul 10 03:26:25.662151 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.662104    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" containerName="main"
Jul 10 03:26:25.662151 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.662116    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecc678-60bd-4f22-a8c8-507884b2f8f5" containerName="main"
Jul 10 03:26:25.662151 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.662121    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecc678-60bd-4f22-a8c8-507884b2f8f5" containerName="main"
Jul 10 03:26:25.662257 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.662208    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="26dfbfc5-3ae9-4ece-80d5-1ef9be8a777c" containerName="main"
Jul 10 03:26:25.662257 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.662217    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecc678-60bd-4f22-a8c8-507884b2f8f5" containerName="main"
Jul 10 03:26:25.666446 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.666429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.669067 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.669033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"openshift-service-ca.crt\""
Jul 10 03:26:25.669067 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.669033    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"rate-test-model-f42020-kserve-self-signed-certs\""
Jul 10 03:26:25.669256 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.669068    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"kube-root-ca.crt\""
Jul 10 03:26:25.669362 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.669349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f42020\"/\"default-dockercfg-jfptv\""
Jul 10 03:26:25.674743 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.674721    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"]
Jul 10 03:26:25.730655 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.730622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-home\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.730853 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.730705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-dshm\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.730853 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.730759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tmp-dir\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.730853 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.730778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tls-certs\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.730853 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.730807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-model-cache\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.730853 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.730830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2p42\" (UniqueName: \"kubernetes.io/projected/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-kube-api-access-j2p42\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.759133 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.759103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:26:25.831408 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-model-cache\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.831408 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2p42\" (UniqueName: \"kubernetes.io/projected/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-kube-api-access-j2p42\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.831629 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-home\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.831629 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-dshm\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.831629 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tmp-dir\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.831629 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tls-certs\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.831890 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831868    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-model-cache\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.831954 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-home\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.832012 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.831966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tmp-dir\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.833863 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.833845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-dshm\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.834140 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.834125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tls-certs\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.838905 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.838886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2p42\" (UniqueName: \"kubernetes.io/projected/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-kube-api-access-j2p42\") pod \"rate-test-model-f42020-kserve-7b5c84996c-f4szd\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") " pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:25.975867 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:25.975814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:26.107238 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:26.107215    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"]
Jul 10 03:26:26.109274 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:26:26.109248    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70006ef0_2421_4e3a_93f6_2fd0ab460b4e.slice/crio-24390ed9b72e5ed48e6ed3d9810844a8c280e845061eac6ce587d06f67a38e08 WatchSource:0}: Error finding container 24390ed9b72e5ed48e6ed3d9810844a8c280e845061eac6ce587d06f67a38e08: Status 404 returned error can't find the container with id 24390ed9b72e5ed48e6ed3d9810844a8c280e845061eac6ce587d06f67a38e08
Jul 10 03:26:26.449947 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:26.449916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd" event={"ID":"70006ef0-2421-4e3a-93f6-2fd0ab460b4e","Type":"ContainerStarted","Data":"d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66"}
Jul 10 03:26:26.450142 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:26.449956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd" event={"ID":"70006ef0-2421-4e3a-93f6-2fd0ab460b4e","Type":"ContainerStarted","Data":"24390ed9b72e5ed48e6ed3d9810844a8c280e845061eac6ce587d06f67a38e08"}
Jul 10 03:26:26.465997 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:26.465948    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd" podStartSLOduration=1.465934165 podStartE2EDuration="1.465934165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:26:26.464224125 +0000 UTC m=+2259.585423109" watchObservedRunningTime="2026-07-10 03:26:26.465934165 +0000 UTC m=+2259.587133122"
Jul 10 03:26:27.353146 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:27.353106    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ecc678-60bd-4f22-a8c8-507884b2f8f5" path="/var/lib/kubelet/pods/67ecc678-60bd-4f22-a8c8-507884b2f8f5/volumes"
Jul 10 03:26:31.551240 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:31.551207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:26:35.976024 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:35.975982    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:35.976382 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:35.976037    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:35.988853 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:35.988829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:36.506945 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:36.506916    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:26:51.960258 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:51.960221    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"]
Jul 10 03:26:51.963482 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:51.963458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:51.967314 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:51.967290    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"kube-root-ca.crt\""
Jul 10 03:26:51.967314 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:51.967308    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"default-dockercfg-tqtpj\""
Jul 10 03:26:51.967498 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:51.967331    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"openshift-service-ca.crt\""
Jul 10 03:26:51.967498 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:51.967340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45a5a5\"/\"rate-test-model-45a5a5-kserve-self-signed-certs\""
Jul 10 03:26:51.974304 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:51.974273    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"]
Jul 10 03:26:51.998502 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:51.998475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:26:52.059783 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.059747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-model-cache\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.059948 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.059786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-tmp-dir\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.059948 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.059876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6709971a-36d0-47b8-8bf8-98d1507f129b-tls-certs\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.060036 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.059952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-dshm\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.060036 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.059975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-home\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.060036 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.059996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdngh\" (UniqueName: \"kubernetes.io/projected/6709971a-36d0-47b8-8bf8-98d1507f129b-kube-api-access-wdngh\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.160383 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.160353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-dshm\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.160557 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.160385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-home\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.160557 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.160425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdngh\" (UniqueName: \"kubernetes.io/projected/6709971a-36d0-47b8-8bf8-98d1507f129b-kube-api-access-wdngh\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.160557 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.160446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-model-cache\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.160557 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.160466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-tmp-dir\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.160557 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.160524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6709971a-36d0-47b8-8bf8-98d1507f129b-tls-certs\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.160935 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.160911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-home\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.161013 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.160991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-model-cache\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.161265 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.161243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-tmp-dir\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.162604 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.162573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-dshm\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.163017 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.162998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6709971a-36d0-47b8-8bf8-98d1507f129b-tls-certs\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.168431 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.168408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdngh\" (UniqueName: \"kubernetes.io/projected/6709971a-36d0-47b8-8bf8-98d1507f129b-kube-api-access-wdngh\") pod \"rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") " pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.273081 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.273054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:26:52.401744 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.401710    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"]
Jul 10 03:26:52.405472 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:26:52.405444    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6709971a_36d0_47b8_8bf8_98d1507f129b.slice/crio-a8b3780c3f7ba028c403e96f319aed5e0ce74c6d2635648b70e68455964734c0 WatchSource:0}: Error finding container a8b3780c3f7ba028c403e96f319aed5e0ce74c6d2635648b70e68455964734c0: Status 404 returned error can't find the container with id a8b3780c3f7ba028c403e96f319aed5e0ce74c6d2635648b70e68455964734c0
Jul 10 03:26:52.567653 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.567561    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw" event={"ID":"6709971a-36d0-47b8-8bf8-98d1507f129b","Type":"ContainerStarted","Data":"ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8"}
Jul 10 03:26:52.567653 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.567606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw" event={"ID":"6709971a-36d0-47b8-8bf8-98d1507f129b","Type":"ContainerStarted","Data":"a8b3780c3f7ba028c403e96f319aed5e0ce74c6d2635648b70e68455964734c0"}
Jul 10 03:26:52.584793 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:52.584745    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw" podStartSLOduration=1.584731869 podStartE2EDuration="1.584731869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:26:52.58346385 +0000 UTC m=+2285.704662842" watchObservedRunningTime="2026-07-10 03:26:52.584731869 +0000 UTC m=+2285.705930849"
Jul 10 03:26:56.146453 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:26:56.146416    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:27:02.273540 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:02.273501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:27:02.273540 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:02.273549    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:27:02.286288 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:02.286263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:27:02.623035 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:02.622961    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:27:09.579831 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:09.579793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:10.666597 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:10.666565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:14.253263 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:14.253225    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:27:24.981946 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:24.981906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:25.082056 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:25.082021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:29.365591 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:29.365559    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:27:33.881517 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:33.881484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:33.991467 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:33.991437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:36.447408 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:36.447377    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"]
Jul 10 03:27:36.470308 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:36.470274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:37.281327 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:37.281289    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"]
Jul 10 03:27:37.301353 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:37.301319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:43.254917 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:43.254835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:27:51.467589 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.467535    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd" podUID="70006ef0-2421-4e3a-93f6-2fd0ab460b4e" containerName="main" containerID="cri-o://d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66" gracePeriod=45
Jul 10 03:27:51.722437 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.722376    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:27:51.836989 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.836949    2578 generic.go:356] "Generic (PLEG): container finished" podID="70006ef0-2421-4e3a-93f6-2fd0ab460b4e" containerID="d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66" exitCode=0
Jul 10 03:27:51.837163 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.837008    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"
Jul 10 03:27:51.837163 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.837017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd" event={"ID":"70006ef0-2421-4e3a-93f6-2fd0ab460b4e","Type":"ContainerDied","Data":"d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66"}
Jul 10 03:27:51.837163 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.837059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd" event={"ID":"70006ef0-2421-4e3a-93f6-2fd0ab460b4e","Type":"ContainerDied","Data":"24390ed9b72e5ed48e6ed3d9810844a8c280e845061eac6ce587d06f67a38e08"}
Jul 10 03:27:51.837163 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.837081    2578 scope.go:117] "RemoveContainer" containerID="d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66"
Jul 10 03:27:51.845535 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.845517    2578 scope.go:117] "RemoveContainer" containerID="d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66"
Jul 10 03:27:51.845823 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:27:51.845804    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66\": container with ID starting with d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66 not found: ID does not exist" containerID="d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66"
Jul 10 03:27:51.845881 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.845832    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66"} err="failed to get container status \"d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66\": rpc error: code = NotFound desc = could not find container \"d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66\": container with ID starting with d41b3f06c23ab69f4a5849d7df167ef7443d4f50519f6ff7235f5519e7504c66 not found: ID does not exist"
Jul 10 03:27:51.877157 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tls-certs\") pod \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") "
Jul 10 03:27:51.877283 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877168    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-home\") pod \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") "
Jul 10 03:27:51.877283 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-model-cache\") pod \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") "
Jul 10 03:27:51.877283 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2p42\" (UniqueName: \"kubernetes.io/projected/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-kube-api-access-j2p42\") pod \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") "
Jul 10 03:27:51.877438 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877285    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tmp-dir\") pod \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") "
Jul 10 03:27:51.877438 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877336    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-dshm\") pod \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\" (UID: \"70006ef0-2421-4e3a-93f6-2fd0ab460b4e\") "
Jul 10 03:27:51.877542 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877437    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-home" (OuterVolumeSpecName: "home") pod "70006ef0-2421-4e3a-93f6-2fd0ab460b4e" (UID: "70006ef0-2421-4e3a-93f6-2fd0ab460b4e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:27:51.877603 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877535    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-model-cache" (OuterVolumeSpecName: "model-cache") pod "70006ef0-2421-4e3a-93f6-2fd0ab460b4e" (UID: "70006ef0-2421-4e3a-93f6-2fd0ab460b4e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:27:51.877661 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877621    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70006ef0-2421-4e3a-93f6-2fd0ab460b4e" (UID: "70006ef0-2421-4e3a-93f6-2fd0ab460b4e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:27:51.877725 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877707    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:51.877725 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.877723    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:51.879424 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.879402    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-kube-api-access-j2p42" (OuterVolumeSpecName: "kube-api-access-j2p42") pod "70006ef0-2421-4e3a-93f6-2fd0ab460b4e" (UID: "70006ef0-2421-4e3a-93f6-2fd0ab460b4e"). InnerVolumeSpecName "kube-api-access-j2p42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:27:51.879508 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.879461    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-dshm" (OuterVolumeSpecName: "dshm") pod "70006ef0-2421-4e3a-93f6-2fd0ab460b4e" (UID: "70006ef0-2421-4e3a-93f6-2fd0ab460b4e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:27:51.879508 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.879461    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70006ef0-2421-4e3a-93f6-2fd0ab460b4e" (UID: "70006ef0-2421-4e3a-93f6-2fd0ab460b4e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:27:51.978660 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.978564    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:51.978660 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.978595    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:51.978660 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.978608    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:51.978660 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:51.978621    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2p42\" (UniqueName: \"kubernetes.io/projected/70006ef0-2421-4e3a-93f6-2fd0ab460b4e-kube-api-access-j2p42\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:52.160247 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.160199    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"]
Jul 10 03:27:52.162012 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.161989    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f42020/rate-test-model-f42020-kserve-7b5c84996c-f4szd"]
Jul 10 03:27:52.305169 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.305079    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw" podUID="6709971a-36d0-47b8-8bf8-98d1507f129b" containerName="main" containerID="cri-o://ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8" gracePeriod=45
Jul 10 03:27:52.557571 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.557511    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:27:52.683978 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.683948    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-model-cache\") pod \"6709971a-36d0-47b8-8bf8-98d1507f129b\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") "
Jul 10 03:27:52.684145 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.683994    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-dshm\") pod \"6709971a-36d0-47b8-8bf8-98d1507f129b\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") "
Jul 10 03:27:52.684145 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684020    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-tmp-dir\") pod \"6709971a-36d0-47b8-8bf8-98d1507f129b\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") "
Jul 10 03:27:52.684145 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684050    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdngh\" (UniqueName: \"kubernetes.io/projected/6709971a-36d0-47b8-8bf8-98d1507f129b-kube-api-access-wdngh\") pod \"6709971a-36d0-47b8-8bf8-98d1507f129b\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") "
Jul 10 03:27:52.684145 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684097    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6709971a-36d0-47b8-8bf8-98d1507f129b-tls-certs\") pod \"6709971a-36d0-47b8-8bf8-98d1507f129b\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") "
Jul 10 03:27:52.684145 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684134    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-home\") pod \"6709971a-36d0-47b8-8bf8-98d1507f129b\" (UID: \"6709971a-36d0-47b8-8bf8-98d1507f129b\") "
Jul 10 03:27:52.684406 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-model-cache" (OuterVolumeSpecName: "model-cache") pod "6709971a-36d0-47b8-8bf8-98d1507f129b" (UID: "6709971a-36d0-47b8-8bf8-98d1507f129b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:27:52.684406 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684285    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6709971a-36d0-47b8-8bf8-98d1507f129b" (UID: "6709971a-36d0-47b8-8bf8-98d1507f129b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:27:52.684517 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684405    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-model-cache\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:52.684517 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684428    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-tmp-dir\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:52.684517 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.684440    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-home" (OuterVolumeSpecName: "home") pod "6709971a-36d0-47b8-8bf8-98d1507f129b" (UID: "6709971a-36d0-47b8-8bf8-98d1507f129b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:27:52.686258 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.686229    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6709971a-36d0-47b8-8bf8-98d1507f129b-kube-api-access-wdngh" (OuterVolumeSpecName: "kube-api-access-wdngh") pod "6709971a-36d0-47b8-8bf8-98d1507f129b" (UID: "6709971a-36d0-47b8-8bf8-98d1507f129b"). InnerVolumeSpecName "kube-api-access-wdngh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:27:52.686258 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.686229    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6709971a-36d0-47b8-8bf8-98d1507f129b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6709971a-36d0-47b8-8bf8-98d1507f129b" (UID: "6709971a-36d0-47b8-8bf8-98d1507f129b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:27:52.686447 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.686284    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-dshm" (OuterVolumeSpecName: "dshm") pod "6709971a-36d0-47b8-8bf8-98d1507f129b" (UID: "6709971a-36d0-47b8-8bf8-98d1507f129b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:27:52.785065 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.785034    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdngh\" (UniqueName: \"kubernetes.io/projected/6709971a-36d0-47b8-8bf8-98d1507f129b-kube-api-access-wdngh\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:52.785065 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.785059    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6709971a-36d0-47b8-8bf8-98d1507f129b-tls-certs\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:52.785065 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.785070    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-home\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:52.785291 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.785078    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6709971a-36d0-47b8-8bf8-98d1507f129b-dshm\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:52.844266 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.844193    2578 generic.go:356] "Generic (PLEG): container finished" podID="6709971a-36d0-47b8-8bf8-98d1507f129b" containerID="ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8" exitCode=0
Jul 10 03:27:52.844266 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.844237    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"
Jul 10 03:27:52.844266 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.844246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw" event={"ID":"6709971a-36d0-47b8-8bf8-98d1507f129b","Type":"ContainerDied","Data":"ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8"}
Jul 10 03:27:52.844478 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.844277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw" event={"ID":"6709971a-36d0-47b8-8bf8-98d1507f129b","Type":"ContainerDied","Data":"a8b3780c3f7ba028c403e96f319aed5e0ce74c6d2635648b70e68455964734c0"}
Jul 10 03:27:52.844478 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.844295    2578 scope.go:117] "RemoveContainer" containerID="ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8"
Jul 10 03:27:52.858887 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.858866    2578 scope.go:117] "RemoveContainer" containerID="ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8"
Jul 10 03:27:52.859139 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:27:52.859119    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8\": container with ID starting with ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8 not found: ID does not exist" containerID="ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8"
Jul 10 03:27:52.859189 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.859147    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8"} err="failed to get container status \"ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8\": rpc error: code = NotFound desc = could not find container \"ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8\": container with ID starting with ad0bce7a06d54da02f7bf1c766e1efc991e187949ace9d214e74114a533009e8 not found: ID does not exist"
Jul 10 03:27:52.868678 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.868653    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"]
Jul 10 03:27:52.872865 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.872845    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-45a5a5/rate-test-model-45a5a5-kserve-fb9f44c67-8rwfw"]
Jul 10 03:27:52.978620 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.978582    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7146-140688457620336"]
Jul 10 03:27:52.979024 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.979007    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6709971a-36d0-47b8-8bf8-98d1507f129b" containerName="main"
Jul 10 03:27:52.979119 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.979027    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6709971a-36d0-47b8-8bf8-98d1507f129b" containerName="main"
Jul 10 03:27:52.979119 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.979040    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70006ef0-2421-4e3a-93f6-2fd0ab460b4e" containerName="main"
Jul 10 03:27:52.979119 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.979048    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="70006ef0-2421-4e3a-93f6-2fd0ab460b4e" containerName="main"
Jul 10 03:27:52.979276 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.979159    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="70006ef0-2421-4e3a-93f6-2fd0ab460b4e" containerName="main"
Jul 10 03:27:52.979276 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.979177    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6709971a-36d0-47b8-8bf8-98d1507f129b" containerName="main"
Jul 10 03:27:52.983316 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.983293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:52.985875 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.985852    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-4tp4q\""
Jul 10 03:27:52.985986 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:52.985949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7146-140688457620336"]
Jul 10 03:27:53.086562 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.086529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mtsf\" (UniqueName: \"kubernetes.io/projected/8f189e86-953f-4b5c-b812-e5cc8dc0ad00-kube-api-access-8mtsf\") pod \"test-curl-7146-140688457620336\" (UID: \"8f189e86-953f-4b5c-b812-e5cc8dc0ad00\") " pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:53.187593 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.187506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mtsf\" (UniqueName: \"kubernetes.io/projected/8f189e86-953f-4b5c-b812-e5cc8dc0ad00-kube-api-access-8mtsf\") pod \"test-curl-7146-140688457620336\" (UID: \"8f189e86-953f-4b5c-b812-e5cc8dc0ad00\") " pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:53.195498 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.195472    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mtsf\" (UniqueName: \"kubernetes.io/projected/8f189e86-953f-4b5c-b812-e5cc8dc0ad00-kube-api-access-8mtsf\") pod \"test-curl-7146-140688457620336\" (UID: \"8f189e86-953f-4b5c-b812-e5cc8dc0ad00\") " pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:53.293502 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.293474    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:53.350832 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.350804    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6709971a-36d0-47b8-8bf8-98d1507f129b" path="/var/lib/kubelet/pods/6709971a-36d0-47b8-8bf8-98d1507f129b/volumes"
Jul 10 03:27:53.351297 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.351277    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70006ef0-2421-4e3a-93f6-2fd0ab460b4e" path="/var/lib/kubelet/pods/70006ef0-2421-4e3a-93f6-2fd0ab460b4e/volumes"
Jul 10 03:27:53.424855 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.424818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7146-140688457620336"]
Jul 10 03:27:53.428477 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:27:53.428450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f189e86_953f_4b5c_b812_e5cc8dc0ad00.slice/crio-0678c4377e04b5b7651614016be0a9d9c276c53eb4c034c5dadc989fc18d925d WatchSource:0}: Error finding container 0678c4377e04b5b7651614016be0a9d9c276c53eb4c034c5dadc989fc18d925d: Status 404 returned error can't find the container with id 0678c4377e04b5b7651614016be0a9d9c276c53eb4c034c5dadc989fc18d925d
Jul 10 03:27:53.429720 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.429675    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 03:27:53.853643 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:53.853554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7146-140688457620336" event={"ID":"8f189e86-953f-4b5c-b812-e5cc8dc0ad00","Type":"ContainerStarted","Data":"0678c4377e04b5b7651614016be0a9d9c276c53eb4c034c5dadc989fc18d925d"}
Jul 10 03:27:54.859430 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:54.859395    2578 generic.go:356] "Generic (PLEG): container finished" podID="8f189e86-953f-4b5c-b812-e5cc8dc0ad00" containerID="b4547b68b02df99913a510b5c4d9429f52f7f89f7c73c9a9b1c6c51085d51e89" exitCode=0
Jul 10 03:27:54.859839 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:54.859468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7146-140688457620336" event={"ID":"8f189e86-953f-4b5c-b812-e5cc8dc0ad00","Type":"ContainerDied","Data":"b4547b68b02df99913a510b5c4d9429f52f7f89f7c73c9a9b1c6c51085d51e89"}
Jul 10 03:27:55.996286 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:55.996263    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:56.016369 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.016347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7146-140688457620336_8f189e86-953f-4b5c-b812-e5cc8dc0ad00/test-curl-7146-140688457620336/0.log"
Jul 10 03:27:56.039487 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.039459    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7146-140688457620336"]
Jul 10 03:27:56.041349 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.041327    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7146-140688457620336"]
Jul 10 03:27:56.117416 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.117349    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mtsf\" (UniqueName: \"kubernetes.io/projected/8f189e86-953f-4b5c-b812-e5cc8dc0ad00-kube-api-access-8mtsf\") pod \"8f189e86-953f-4b5c-b812-e5cc8dc0ad00\" (UID: \"8f189e86-953f-4b5c-b812-e5cc8dc0ad00\") "
Jul 10 03:27:56.119638 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.119615    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f189e86-953f-4b5c-b812-e5cc8dc0ad00-kube-api-access-8mtsf" (OuterVolumeSpecName: "kube-api-access-8mtsf") pod "8f189e86-953f-4b5c-b812-e5cc8dc0ad00" (UID: "8f189e86-953f-4b5c-b812-e5cc8dc0ad00"). InnerVolumeSpecName "kube-api-access-8mtsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:27:56.218749 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.218718    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mtsf\" (UniqueName: \"kubernetes.io/projected/8f189e86-953f-4b5c-b812-e5cc8dc0ad00-kube-api-access-8mtsf\") on node \"ip-10-0-134-61.ec2.internal\" DevicePath \"\""
Jul 10 03:27:56.265566 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.265536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:56.732905 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.732863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:56.836275 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.836244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:56.870034 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.870011    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:56.870220 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.870036    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0678c4377e04b5b7651614016be0a9d9c276c53eb4c034c5dadc989fc18d925d"
Jul 10 03:27:56.879772 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:27:56.879746    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7146-140688457620336\" is forbidden: User \"system:node:ip-10-0-134-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-61.ec2.internal' and this object" podUID="8f189e86-953f-4b5c-b812-e5cc8dc0ad00" pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:56.933912 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:56.933888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:57.072942 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:57.072856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:27:57.347450 ip-10-0-134-61 kubenswrapper[2578]: E0710 03:27:57.347373    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7146-140688457620336\" is forbidden: User \"system:node:ip-10-0-134-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-61.ec2.internal' and this object" podUID="8f189e86-953f-4b5c-b812-e5cc8dc0ad00" pod="openshift-ingress/test-curl-7146-140688457620336"
Jul 10 03:27:57.348582 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:27:57.348553    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f189e86-953f-4b5c-b812-e5cc8dc0ad00" path="/var/lib/kubelet/pods/8f189e86-953f-4b5c-b812-e5cc8dc0ad00/volumes"
Jul 10 03:28:00.147439 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:00.147404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:28:02.633233 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:02.633198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:02.692176 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:02.692148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:02.945635 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:02.945602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:03.133417 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:03.133386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:03.290187 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:03.290109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:03.689447 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:03.689365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:03.792485 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:03.792451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:03.892323 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:03.892286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:03.999445 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:03.999409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:09.597723 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:09.597671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:09.698293 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:09.698261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:09.879036 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:09.878959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:10.108569 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:10.108538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:10.522501 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:10.522470    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd78c5544-vt286_f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5/authorino/0.log"
Jul 10 03:28:12.657412 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:12.657372    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t2cm9"]
Jul 10 03:28:15.539952 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:15.539922    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9shpp_a69016da-eee2-4bfe-8467-4c379b413a9a/manager/0.log"
Jul 10 03:28:16.012352 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:16.012323    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd56b898-fx474_fdfcc114-979c-49b1-b611-0d5289ae9f6d/copy-manifests/0.log"
Jul 10 03:28:16.025263 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:16.025239    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd56b898-fx474_fdfcc114-979c-49b1-b611-0d5289ae9f6d/manager/0.log"
Jul 10 03:28:18.070470 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:18.070438    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd78c5544-vt286_f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5/authorino/0.log"
Jul 10 03:28:18.805714 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:18.805669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t2cm9_008450ee-98aa-4949-acd9-0828494fc171/limitador/0.log"
Jul 10 03:28:19.524634 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:19.524596    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-864dd46fbc-5r4zh_ae2775ad-a5e1-47d4-a126-63fb964d08ac/kube-auth-proxy/0.log"
Jul 10 03:28:20.688044 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:20.688011    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ggwkj_c3ef9eee-5202-4eab-b5e9-4bfba3ee2f07/main/0.log"
Jul 10 03:28:21.030168 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:21.030140    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-cnls2_605cee0c-7ed6-43a0-8d99-08b7dbab5a5a/main/0.log"
Jul 10 03:28:25.376510 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:25.376481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:25.476759 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:25.476728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log" limit=1024
Jul 10 03:28:28.160856 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:28.160827    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mncdm_128b98af-e789-4aa2-a300-f7bc264afc7e/global-pull-secret-syncer/0.log"
Jul 10 03:28:28.287974 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:28.287948    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h2wmc_096c206a-8c10-4fe6-8bc5-da37a862180f/konnectivity-agent/0.log"
Jul 10 03:28:28.409607 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:28.409556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-61.ec2.internal_a3984128191a768de8282e6033794994/haproxy/0.log"
Jul 10 03:28:33.420498 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:33.420470    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd78c5544-vt286_f62ffc5e-f2cb-4ec8-9719-3d4b9ffce2a5/authorino/0.log"
Jul 10 03:28:33.694628 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:33.694605    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t2cm9_008450ee-98aa-4949-acd9-0828494fc171/limitador/0.log"
Jul 10 03:28:35.350383 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.350358    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64223656-a076-48ff-adf7-2428cdf597f8/alertmanager/0.log"
Jul 10 03:28:35.374789 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.374758    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64223656-a076-48ff-adf7-2428cdf597f8/config-reloader/0.log"
Jul 10 03:28:35.396738 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.396654    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64223656-a076-48ff-adf7-2428cdf597f8/kube-rbac-proxy-web/0.log"
Jul 10 03:28:35.423189 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.423164    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64223656-a076-48ff-adf7-2428cdf597f8/kube-rbac-proxy/0.log"
Jul 10 03:28:35.446467 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.446444    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64223656-a076-48ff-adf7-2428cdf597f8/kube-rbac-proxy-metric/0.log"
Jul 10 03:28:35.469187 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.469166    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64223656-a076-48ff-adf7-2428cdf597f8/prom-label-proxy/0.log"
Jul 10 03:28:35.494427 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.494406    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64223656-a076-48ff-adf7-2428cdf597f8/init-config-reloader/0.log"
Jul 10 03:28:35.723066 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.723041    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-zvnch_80b17993-acec-404d-bc39-37034d43bbaa/monitoring-plugin/0.log"
Jul 10 03:28:35.752692 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.752669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wcmr_68f54298-fbc2-4358-b8c0-4e0f01d5f7fb/node-exporter/0.log"
Jul 10 03:28:35.775132 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.775115    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wcmr_68f54298-fbc2-4358-b8c0-4e0f01d5f7fb/kube-rbac-proxy/0.log"
Jul 10 03:28:35.798344 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.798327    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wcmr_68f54298-fbc2-4358-b8c0-4e0f01d5f7fb/init-textfile/0.log"
Jul 10 03:28:35.976084 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.976014    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-mq7h8_d4f8a7bb-81c1-4f04-a764-7771d15416c9/kube-rbac-proxy-main/0.log"
Jul 10 03:28:35.998184 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:35.998161    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-mq7h8_d4f8a7bb-81c1-4f04-a764-7771d15416c9/kube-rbac-proxy-self/0.log"
Jul 10 03:28:36.024587 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.024568    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-mq7h8_d4f8a7bb-81c1-4f04-a764-7771d15416c9/openshift-state-metrics/0.log"
Jul 10 03:28:36.058727 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.058707    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed083ab3-0866-4292-b748-79bae77a1328/prometheus/0.log"
Jul 10 03:28:36.080933 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.080916    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed083ab3-0866-4292-b748-79bae77a1328/config-reloader/0.log"
Jul 10 03:28:36.103544 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.103518    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed083ab3-0866-4292-b748-79bae77a1328/thanos-sidecar/0.log"
Jul 10 03:28:36.124994 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.124975    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed083ab3-0866-4292-b748-79bae77a1328/kube-rbac-proxy-web/0.log"
Jul 10 03:28:36.151935 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.151910    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed083ab3-0866-4292-b748-79bae77a1328/kube-rbac-proxy/0.log"
Jul 10 03:28:36.168488 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.168466    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed083ab3-0866-4292-b748-79bae77a1328/kube-rbac-proxy-thanos/0.log"
Jul 10 03:28:36.189329 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.189314    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed083ab3-0866-4292-b748-79bae77a1328/init-config-reloader/0.log"
Jul 10 03:28:36.377706 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.377624    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67ccd95c9b-rggp8_cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9/thanos-query/0.log"
Jul 10 03:28:36.402312 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.402293    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67ccd95c9b-rggp8_cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9/kube-rbac-proxy-web/0.log"
Jul 10 03:28:36.424986 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.424968    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67ccd95c9b-rggp8_cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9/kube-rbac-proxy/0.log"
Jul 10 03:28:36.446313 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.446294    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67ccd95c9b-rggp8_cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9/prom-label-proxy/0.log"
Jul 10 03:28:36.467209 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.467191    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67ccd95c9b-rggp8_cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9/kube-rbac-proxy-rules/0.log"
Jul 10 03:28:36.488048 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:36.488030    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67ccd95c9b-rggp8_cdf0db97-a2b0-47dd-97ec-cb4e8ddd49b9/kube-rbac-proxy-metrics/0.log"
Jul 10 03:28:38.538407 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.538375    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"]
Jul 10 03:28:38.538854 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.538775    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f189e86-953f-4b5c-b812-e5cc8dc0ad00" containerName="test-curl-7146-140688457620336"
Jul 10 03:28:38.538854 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.538787    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f189e86-953f-4b5c-b812-e5cc8dc0ad00" containerName="test-curl-7146-140688457620336"
Jul 10 03:28:38.538854 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.538854    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f189e86-953f-4b5c-b812-e5cc8dc0ad00" containerName="test-curl-7146-140688457620336"
Jul 10 03:28:38.543386 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.543368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.546333 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.546314    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lplzd\"/\"default-dockercfg-plrlg\""
Jul 10 03:28:38.546434 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.546355    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lplzd\"/\"openshift-service-ca.crt\""
Jul 10 03:28:38.546434 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.546353    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lplzd\"/\"kube-root-ca.crt\""
Jul 10 03:28:38.551778 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.551758    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"]
Jul 10 03:28:38.674035 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.674006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-sys\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.674179 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.674061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqmgj\" (UniqueName: \"kubernetes.io/projected/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-kube-api-access-lqmgj\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.674179 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.674082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-lib-modules\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.674179 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.674100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-proc\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.674179 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.674123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-podres\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774413 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-sys\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774536 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqmgj\" (UniqueName: \"kubernetes.io/projected/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-kube-api-access-lqmgj\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774536 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-lib-modules\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774536 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-sys\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774654 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-lib-modules\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774654 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-proc\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774654 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-podres\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774788 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-proc\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.774822 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.774792    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-podres\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.783649 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.783629    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqmgj\" (UniqueName: \"kubernetes.io/projected/f17c8bde-1f45-4c8f-8af0-4a59fd566cb7-kube-api-access-lqmgj\") pod \"perf-node-gather-daemonset-lxwx5\" (UID: \"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7\") " pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.854780 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.854728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:38.983311 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:38.983238    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"]
Jul 10 03:28:38.986162 ip-10-0-134-61 kubenswrapper[2578]: W0710 03:28:38.986137    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf17c8bde_1f45_4c8f_8af0_4a59fd566cb7.slice/crio-23f5bfbf96bd3667b9a424752d3fe057b001465ae0315e30ae3b400d3924e27c WatchSource:0}: Error finding container 23f5bfbf96bd3667b9a424752d3fe057b001465ae0315e30ae3b400d3924e27c: Status 404 returned error can't find the container with id 23f5bfbf96bd3667b9a424752d3fe057b001465ae0315e30ae3b400d3924e27c
Jul 10 03:28:39.057260 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:39.057235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5" event={"ID":"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7","Type":"ContainerStarted","Data":"23f5bfbf96bd3667b9a424752d3fe057b001465ae0315e30ae3b400d3924e27c"}
Jul 10 03:28:39.065783 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:39.065752    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74fb58d66c-m47cq_7ab721ad-afc7-4173-a24e-dfd2df7bbadf/console/0.log"
Jul 10 03:28:40.062981 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:40.062941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5" event={"ID":"f17c8bde-1f45-4c8f-8af0-4a59fd566cb7","Type":"ContainerStarted","Data":"2082f0f108318a342b958faae8fbebdb344529af8e0b39ffd10c36f5f35220e4"}
Jul 10 03:28:40.063390 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:40.063005    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:40.080312 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:40.080264    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5" podStartSLOduration=2.080250689 podStartE2EDuration="2.080250689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:28:40.07895814 +0000 UTC m=+2393.200157123" watchObservedRunningTime="2026-07-10 03:28:40.080250689 +0000 UTC m=+2393.201449663"
Jul 10 03:28:40.757895 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:40.757870    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5mg7v_c91a3e50-db1a-4931-950d-cf4d214ebfd8/dns/0.log"
Jul 10 03:28:40.779481 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:40.779460    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5mg7v_c91a3e50-db1a-4931-950d-cf4d214ebfd8/kube-rbac-proxy/0.log"
Jul 10 03:28:40.918956 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:40.918921    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gp7vb_79f302d7-8044-4a7d-b448-2512a954519c/dns-node-resolver/0.log"
Jul 10 03:28:41.483069 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:41.483044    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g5vs5_1c5dcb40-cc6f-497b-bc15-af5219c166f4/node-ca/0.log"
Jul 10 03:28:42.610749 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:42.610719    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-864dd46fbc-5r4zh_ae2775ad-a5e1-47d4-a126-63fb964d08ac/kube-auth-proxy/0.log"
Jul 10 03:28:43.629571 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:43.629539    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgl9s_b472ff97-f489-424c-94da-975404734b2a/serve-healthcheck-canary/0.log"
Jul 10 03:28:44.219363 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:44.219334    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4fgt_9f95ed84-94f9-4184-9911-a9e29d38732e/kube-rbac-proxy/0.log"
Jul 10 03:28:44.240327 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:44.240302    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4fgt_9f95ed84-94f9-4184-9911-a9e29d38732e/exporter/0.log"
Jul 10 03:28:44.265096 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:44.265078    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4fgt_9f95ed84-94f9-4184-9911-a9e29d38732e/extractor/0.log"
Jul 10 03:28:46.077990 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:46.077962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lplzd/perf-node-gather-daemonset-lxwx5"
Jul 10 03:28:46.510156 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:46.510123    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9shpp_a69016da-eee2-4bfe-8467-4c379b413a9a/manager/0.log"
Jul 10 03:28:46.875607 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:46.875522    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd56b898-fx474_fdfcc114-979c-49b1-b611-0d5289ae9f6d/manager/0.log"
Jul 10 03:28:46.892414 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:46.892396    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd56b898-fx474_fdfcc114-979c-49b1-b611-0d5289ae9f6d/copy-manifests/0.log"
Jul 10 03:28:47.446800 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:47.446772    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:28:47.456189 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:47.456166    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:28:48.205351 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:48.205312    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-646f759ddf-994gj_d72b3e0f-cfd5-4c67-b747-070b4fa837c1/manager/0.log"
Jul 10 03:28:48.549487 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:48.549418    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-864dd46fbc-5r4zh_ae2775ad-a5e1-47d4-a126-63fb964d08ac/kube-auth-proxy/0.log"
Jul 10 03:28:50.172842 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:50.172815    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-864dd46fbc-5r4zh_ae2775ad-a5e1-47d4-a126-63fb964d08ac/kube-auth-proxy/0.log"
Jul 10 03:28:54.854578 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:54.854548    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hldvt_32d11469-731f-41a0-86b3-8326bab87c44/kube-multus-additional-cni-plugins/0.log"
Jul 10 03:28:54.883003 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:54.882980    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hldvt_32d11469-731f-41a0-86b3-8326bab87c44/egress-router-binary-copy/0.log"
Jul 10 03:28:54.903717 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:54.903677    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hldvt_32d11469-731f-41a0-86b3-8326bab87c44/cni-plugins/0.log"
Jul 10 03:28:54.924451 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:54.924423    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hldvt_32d11469-731f-41a0-86b3-8326bab87c44/bond-cni-plugin/0.log"
Jul 10 03:28:54.948187 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:54.948167    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hldvt_32d11469-731f-41a0-86b3-8326bab87c44/routeoverride-cni/0.log"
Jul 10 03:28:54.971127 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:54.971112    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hldvt_32d11469-731f-41a0-86b3-8326bab87c44/whereabouts-cni-bincopy/0.log"
Jul 10 03:28:54.993052 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:54.993034    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hldvt_32d11469-731f-41a0-86b3-8326bab87c44/whereabouts-cni/0.log"
Jul 10 03:28:55.394949 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:55.394921    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zcskg_f238384e-cf4a-420a-bf38-bae6ec627f4c/kube-multus/0.log"
Jul 10 03:28:55.513536 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:55.513508    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zx4tf_96df90f3-2b21-40e8-ab9a-cab5310d7fb6/network-metrics-daemon/0.log"
Jul 10 03:28:55.535666 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:55.535643    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zx4tf_96df90f3-2b21-40e8-ab9a-cab5310d7fb6/kube-rbac-proxy/0.log"
Jul 10 03:28:56.971947 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:56.971918    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-controller/0.log"
Jul 10 03:28:56.993107 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:56.993071    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/0.log"
Jul 10 03:28:56.993107 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:56.993080    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovn-acl-logging/1.log"
Jul 10 03:28:57.010654 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:57.010633    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/kube-rbac-proxy-node/0.log"
Jul 10 03:28:57.037561 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:57.037541    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/kube-rbac-proxy-ovn-metrics/0.log"
Jul 10 03:28:57.064466 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:57.064446    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/northd/0.log"
Jul 10 03:28:57.087427 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:57.087395    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/nbdb/0.log"
Jul 10 03:28:57.111154 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:57.111135    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/sbdb/0.log"
Jul 10 03:28:57.160613 ip-10-0-134-61 kubenswrapper[2578]: I0710 03:28:57.160590    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpldh_3b18a770-3def-4e63-acde-1ba84ad187bc/ovnkube-controller/0.log"