Jul 21 17:06:13.028053 ip-10-0-128-12 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 17:06:13.028064 ip-10-0-128-12 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 17:06:13.028074 ip-10-0-128-12 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 17:06:13.028408 ip-10-0-128-12 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 17:06:23.059580 ip-10-0-128-12 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 17:06:23.059599 ip-10-0-128-12 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8b86512bfe8146278583fdf219ad9ed7 --
Jul 21 17:08:17.310486 ip-10-0-128-12 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.767007    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770919    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770930    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770933    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770937    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770940    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770943    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770946    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:17.776689 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770949    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770952    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770954    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770957    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770959    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770962    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770965    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770967    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770970    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770973    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770975    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770979    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770982    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770984    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770987    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770990    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770993    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770996    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.770999    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771002    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:17.777657 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771005    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771008    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771010    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771013    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771015    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771018    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771021    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771023    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771026    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771028    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771031    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771034    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771037    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771039    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771042    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771044    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771047    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771049    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771052    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771055    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:17.778221 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771057    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771061    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771063    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771066    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771068    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771071    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771074    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771076    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771079    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771082    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771085    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771087    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771090    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771092    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771095    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771098    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771102    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771104    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771107    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:17.778938 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771109    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771112    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771116    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771120    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771123    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771126    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771129    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771132    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771135    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771138    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771141    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771144    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771146    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771149    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771152    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771155    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771158    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771161    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771163    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:17.779454 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771167    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771171    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771174    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771179    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771182    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771185    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771188    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771191    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771194    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771198    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771201    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771203    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771206    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.771208    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772584    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772591    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772594    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772597    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772600    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772609    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:17.780248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772612    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772615    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772618    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772621    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772623    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772626    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772629    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772631    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772634    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772636    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772641    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772644    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772647    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772650    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772653    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772656    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772659    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772662    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772664    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:17.780816 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772667    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772670    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772673    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772675    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772678    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772680    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772683    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772686    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772688    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772690    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772693    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772697    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772700    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772704    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772707    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772711    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772714    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772718    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772721    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772723    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:17.781592 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772726    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772729    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772732    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772735    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772737    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772740    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772743    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772745    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772748    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772751    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772754    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772757    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772760    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772767    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772769    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772772    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772776    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772779    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772782    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772785    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:17.782160 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772789    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772792    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772813    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772816    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772819    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772822    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772825    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772828    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772830    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772833    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772836    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772839    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772841    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772844    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772846    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772849    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772851    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772854    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772857    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772859    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:17.782920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772862    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772864    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772867    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772870    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772872    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772876    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772879    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772881    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772884    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772887    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772889    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772892    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772895    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.772898    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773273    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773278    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773281    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773285    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773289    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:17.783467 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773293    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773296    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773299    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773301    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773304    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773306    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773309    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773321    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773324    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773327    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773329    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773332    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773335    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773339    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773343    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773346    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773349    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773351    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773356    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773359    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:17.981212 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773362    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:17.848664 ip-10-0-128-12 systemd[1]: Started Kubernetes Kubelet.
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773364    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773367    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773370    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773372    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773375    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773378    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773380    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773383    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773386    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773388    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773391    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773395    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773397    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773400    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773403    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773405    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773408    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773411    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773414    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:18.008248 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773417    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773419    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773422    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773424    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773427    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773429    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773432    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773435    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773437    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773440    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773444    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773446    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773449    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773451    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773454    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773457    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773459    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773462    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773464    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773485    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:18.009362 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773489    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773491    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773494    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773497    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773500    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773506    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773509    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773512    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773515    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773518    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773521    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773523    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773526    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773528    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773531    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773533    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773536    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773539    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773541    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:18.010117 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773543    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773546    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773548    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773552    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773554    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773557    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773559    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773562    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773565    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773567    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773570    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773573    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773575    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773578    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.773580    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773647    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773654    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773660    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773666    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773673    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773680    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 17:08:18.011071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773689    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773697    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773701    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773705    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773708    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773712    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773715    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773718    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773720    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773724    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773727    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773730    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773735    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773737    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773742    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773745    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773748    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773752    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773755    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773758    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773762    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773765    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773768    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773771    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 17:08:18.011776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773774    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773777    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773782    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773785    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773788    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773791    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773807    2557 flags.go:64] FLAG: --enable-server="true"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773812    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773817    2557 flags.go:64] FLAG: --event-burst="100"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773820    2557 flags.go:64] FLAG: --event-qps="50"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773823    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773826    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773829    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773833    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773836    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773839    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773842    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773845    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773847    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773850    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773853    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773856    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773860    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773863    2557 flags.go:64] FLAG: --feature-gates=""
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773867    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 17:08:18.016710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773870    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773873    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773877    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773880    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773883    2557 flags.go:64] FLAG: --help="false"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773886    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773889    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773892    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773895    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773900    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773904    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773906    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773909    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773912    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773915    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773918    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773922    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773924    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773927    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773930    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773933    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773936    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773939    2557 flags.go:64] FLAG: --lock-file=""
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773942    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 17:08:18.018291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773944    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773947    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773953    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773955    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773958    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773962    2557 flags.go:64] FLAG: --logging-format="text"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773965    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773968    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773971    2557 flags.go:64] FLAG: --manifest-url=""
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773974    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773978    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773981    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773985    2557 flags.go:64] FLAG: --max-pods="110"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773988    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773991    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773994    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.773997    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774001    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774004    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774007    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774014    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774017    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774020    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 17:08:18.020174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774023    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774027    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774033    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774036    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774039    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774042    2557 flags.go:64] FLAG: --port="10250"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774045    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774048    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082d8018c64f362d8"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774051    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774054    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774057    2557 flags.go:64] FLAG: --register-node="true"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774060    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774064    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774067    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774069    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774074    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774077    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774080    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774083    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774086    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774089    2557 flags.go:64] FLAG: --runonce="false"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774092    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774095    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774099    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774102    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 17:08:18.021032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774104    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774109    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774112    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774115    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774118    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774121    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774124    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774127    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774130    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774133    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774136    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774142    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774144    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774147    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774151    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774154    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774157    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774160    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774163    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774166    2557 flags.go:64] FLAG: --v="2"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774170    2557 flags.go:64] FLAG: --version="false"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774173    2557 flags.go:64] FLAG: --vmodule=""
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774178    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774182    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774306    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:18.022096 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774310    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774313    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774315    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774318    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774321    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774323    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774326    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774329    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774333    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774335    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774338    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774340    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774343    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774346    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774349    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774352    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774354    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774358    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774362    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:18.022908 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774365    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774368    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774370    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774373    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774376    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774378    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774381    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774385    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774388    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774391    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774395    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774398    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774403    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774406    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774409    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774411    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774414    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774417    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774419    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:18.023869 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774422    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774424    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774428    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774431    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774434    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774436    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774439    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774441    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774444    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774446    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774449    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774451    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774454    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774457    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774459    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774462    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774465    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774467    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774470    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774473    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:18.024483 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774475    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774478    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774480    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774485    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774487    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774490    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774492    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774495    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774497    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774500    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774503    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774505    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774507    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774510    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774514    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774517    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774519    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774522    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774525    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774527    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:18.137785 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774530    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774533    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774535    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774538    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774540    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774543    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774546    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774566    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774569    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774573    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774575    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774578    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774581    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774583    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774586    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774590    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774592    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774595    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774598    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:18.142884 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.774600    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.774605    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.781504    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.781518    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.781537    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.781545    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781611    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781617    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781621    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781624    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781626    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781629    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781632    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781635    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781637    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:18.143891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781640    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781642    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781645    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781649    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781652    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781655    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781657    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781660    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781662    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781665    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781668    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781670    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781673    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781676    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781679    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781682    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781684    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781687    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781690    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:18.144836 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781694    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781698    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781701    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781703    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781706    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781709    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781712    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781715    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781719    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781721    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781724    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781726    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781729    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781731    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781734    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781737    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781739    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781742    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781746    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:18.147553 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781749    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781752    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781756    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781760    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781763    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781766    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781769    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781772    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781775    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781778    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781780    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781783    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781786    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781789    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781792    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781809    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781812    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781815    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781818    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:18.148560 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781821    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781823    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781826    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781828    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781831    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781834    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781837    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781839    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781842    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781845    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781847    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781850    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781853    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781855    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781858    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781861    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781864    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781866    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781869    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781872    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:18.152097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781875    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781877    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781880    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781882    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781885    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781887    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781890    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781893    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781896    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781898    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781901    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781904    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.781908    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.781913    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782022    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:18.153097 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782027    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782030    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782033    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782037    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782040    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782043    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782046    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782049    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782052    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782054    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782057    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782060    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782062    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782066    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782069    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782071    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782074    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782077    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782079    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782082    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:18.249627 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782084    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782087    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782089    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782092    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782094    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782097    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782100    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782102    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782105    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782110    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782114    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782117    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782120    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782123    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782125    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782128    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782131    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782133    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782136    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:18.250614 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782138    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782141    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782143    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782146    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782149    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782151    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782154    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782157    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782159    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782162    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782165    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782168    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782171    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782174    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782176    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782179    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782181    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782184    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782187    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782189    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:18.259636 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782192    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782194    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782199    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782202    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782204    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782209    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782212    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782214    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782216    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782219    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782222    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782224    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782227    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782230    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782232    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782236    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782239    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782244    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782247    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782250    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:18.261056 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782253    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782255    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782258    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782260    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782263    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782265    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782268    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782270    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782273    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782275    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782278    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782280    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782283    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782285    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782289    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782292    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782295    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782298    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:18.262021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:17.782301    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.782306    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.782405    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.784367    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.785521    2557 server.go:1019] "Starting client certificate rotation"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.785623    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.785658    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.791100    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.794729    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.812644    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.814651    2557 log.go:25] "Validated CRI v1 image API"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.818359    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 17:08:18.263844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.821117    2557 fs.go:135] Filesystem UUIDs: map[73dde086-ac15-4dd2-996e-ec43a3a4ab60:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c6ab83a1-edbb-4c94-b9c2-9b07827846f7:/dev/nvme0n1p4]
Jul 21 17:08:18.264790 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.821134    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 17:08:18.264790 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.822154    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.828131    2557 manager.go:216] Machine: {Timestamp:2026-07-21 17:08:17.826622457 +0000 UTC m=+0.371938668 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099674 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec231adb8df38131c9fb615f433bf2a3 SystemUUID:ec231adb-8df3-8131-c9fb-615f433bf2a3 BootID:8b86512b-fe81-4627-8583-fdf219ad9ed7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:30:58:4b:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:30:58:4b:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:38:85:11:e9:de Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.828234    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.828353    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.830741    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.830787    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.831628    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.831647    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.831660    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.832373    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.834203    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838075    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838212    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838243    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838257    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838282    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838295    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838308    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 17:08:18.266092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838727    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.838754    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.840981    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.842675    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.842704    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844760    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844775    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844782    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844787    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844808    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844815    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844824    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844830    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844837    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844843    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844858    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844864    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844898    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.844903    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.848034    2557 server.go:1268] "Started kubelet"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.850527    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.850598    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.850668    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.852811    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.852965    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.853009    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.853615    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.855072    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.855499    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.860817    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-12.ec2.internal.18c45d152b515c64  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-12.ec2.internal,UID:ip-10-0-128-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-12.ec2.internal,},FirstTimestamp:2026-07-21 17:08:17.84800778 +0000 UTC m=+0.393323990,LastTimestamp:2026-07-21 17:08:17.84800778 +0000 UTC m=+0.393323990,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-12.ec2.internal,}"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.867303    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.867324    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.867434    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868125    2557 factory.go:55] Registering systemd factory
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868143    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868344    2557 factory.go:153] Registering CRI-O factory
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868357    2557 factory.go:223] Registration of the crio container factory successfully
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868427    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868455    2557 factory.go:103] Registering Raw factory
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868472    2557 manager.go:1196] Started watching for new ooms in manager
Jul 21 17:08:18.267502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868584    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868590    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868598    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868687    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868696    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.868993    2557 manager.go:349] Starting recovery of all containers
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.869108    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.869149    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.876781    2557 manager.go:354] Recovery completed
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.881957    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.882305    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kb54x"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.883765    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.883792    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.883804    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.884394    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.884403    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.884422    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.884470    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.885235    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.885274    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.885290    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.887448    2557 policy_none.go:49] "None policy: Start"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.888072    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.888093    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.890233    2557 policy_none.go:47] "Start"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.891111    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kb54x"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.896334    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-12.ec2.internal.18c45d152d732bc4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-12.ec2.internal,UID:ip-10-0-128-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-12.ec2.internal,},FirstTimestamp:2026-07-21 17:08:17.883777988 +0000 UTC m=+0.429094201,LastTimestamp:2026-07-21 17:08:17.883777988 +0000 UTC m=+0.429094201,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-12.ec2.internal,}"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.934460    2557 manager.go:337] "Starting Device Plugin manager"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.934628    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.934639    2557 server.go:87] "Starting device plugin registration server"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.934880    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.934893    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.935005    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.935132    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:17.935148    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.935612    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:17.935658    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.035832    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.036841    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:18.361520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.036871    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.036882    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.036918    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.050579    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.050603    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-12.ec2.internal\": node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.053949    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.055363    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.055423    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.055445    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.055483    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.060231    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.086914    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.187977    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.288583    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.362440    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal"]
Jul 21 17:08:18.362749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.362519    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:18.364072 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.364053    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:18.364170 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.364094    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:18.364170 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.364111    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:18.366407 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.366391    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:18.366514 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.366498    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.366571 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.366530    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:18.367249 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.367230    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:18.367332 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.367258    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:18.367332 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.367271    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:18.367765 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.367750    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:18.367827 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.367778    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:18.367827 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.367793    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:18.370222 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.370202    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.370303 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.370241    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:18.370439 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.370421    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa105e049b9d72e7308c55b3aecfcaeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal\" (UID: \"fa105e049b9d72e7308c55b3aecfcaeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.370487 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.370447    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa105e049b9d72e7308c55b3aecfcaeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal\" (UID: \"fa105e049b9d72e7308c55b3aecfcaeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.370531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.370486    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76884c21cf54c80d0a792e713b054514-config\") pod \"kube-apiserver-proxy-ip-10-0-128-12.ec2.internal\" (UID: \"76884c21cf54c80d0a792e713b054514\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.371085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.371067    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:18.371185 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.371097    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:18.371185 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.371114    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:18.389403 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.389386    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.402545 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.402520    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-12.ec2.internal\" not found" node="ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.407157 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.407140    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-12.ec2.internal\" not found" node="ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.471155 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.471113    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa105e049b9d72e7308c55b3aecfcaeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal\" (UID: \"fa105e049b9d72e7308c55b3aecfcaeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.471155 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.471162    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa105e049b9d72e7308c55b3aecfcaeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal\" (UID: \"fa105e049b9d72e7308c55b3aecfcaeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.471289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.471180    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76884c21cf54c80d0a792e713b054514-config\") pod \"kube-apiserver-proxy-ip-10-0-128-12.ec2.internal\" (UID: \"76884c21cf54c80d0a792e713b054514\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.471289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.471216    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76884c21cf54c80d0a792e713b054514-config\") pod \"kube-apiserver-proxy-ip-10-0-128-12.ec2.internal\" (UID: \"76884c21cf54c80d0a792e713b054514\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.471289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.471221    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa105e049b9d72e7308c55b3aecfcaeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal\" (UID: \"fa105e049b9d72e7308c55b3aecfcaeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.471289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.471229    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa105e049b9d72e7308c55b3aecfcaeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal\" (UID: \"fa105e049b9d72e7308c55b3aecfcaeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.489922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.489894    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.590607 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.590522    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.692188 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.692143    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.705963 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.705929    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.709856 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.709838    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:18.784673 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.784627    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 17:08:18.785121 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.784778    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 17:08:18.792401 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.792379    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.893477 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.893392    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.896825 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.896784    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 17:03:18 +0000 UTC" deadline="2028-02-14 04:06:28.7474567 +0000 UTC"
Jul 21 17:08:18.896927 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.896829    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13738h58m9.850635105s"
Jul 21 17:08:18.959268 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.959238    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:18.994948 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:18.994901    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-12.ec2.internal\" not found"
Jul 21 17:08:18.999047 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:18.999027    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:19.067879 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.067846    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:19.084088 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.084067    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 17:08:19.085637 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.085624    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal"
Jul 21 17:08:19.097772 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.097751    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 17:08:19.286012 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.285936    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:19.496027 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:19.495979    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa105e049b9d72e7308c55b3aecfcaeb.slice/crio-ab0df563f5e93ad7de34fa8d45d9e7ed7f013b2560827d22d8bf8f98ea62f068 WatchSource:0}: Error finding container ab0df563f5e93ad7de34fa8d45d9e7ed7f013b2560827d22d8bf8f98ea62f068: Status 404 returned error can't find the container with id ab0df563f5e93ad7de34fa8d45d9e7ed7f013b2560827d22d8bf8f98ea62f068
Jul 21 17:08:19.501700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.501683    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:08:19.507575 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:19.507550    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76884c21cf54c80d0a792e713b054514.slice/crio-8de74c8583166370a5a7fdb2f5cd4d22035a5987cecf942827baf0d685642fb5 WatchSource:0}: Error finding container 8de74c8583166370a5a7fdb2f5cd4d22035a5987cecf942827baf0d685642fb5: Status 404 returned error can't find the container with id 8de74c8583166370a5a7fdb2f5cd4d22035a5987cecf942827baf0d685642fb5
Jul 21 17:08:19.842016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.841985    2557 apiserver.go:52] "Watching apiserver"
Jul 21 17:08:19.853095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.853069    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 17:08:19.854320 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.854298    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg","openshift-cluster-node-tuning-operator/tuned-sn949","openshift-dns/node-resolver-fcjjl","openshift-image-registry/node-ca-q6ndw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal","openshift-multus/multus-5vrp5","openshift-multus/multus-additional-cni-plugins-rgr88","kube-system/konnectivity-agent-25s6x","kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal","openshift-multus/network-metrics-daemon-rlz7d","openshift-network-diagnostics/network-check-target-p58wr","openshift-network-operator/iptables-alerter-dk2bg","openshift-ovn-kubernetes/ovnkube-node-rtjql","kube-system/global-pull-secret-syncer-qgrwt"]
Jul 21 17:08:19.857333 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.857314    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.859508 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.859486    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:19.859597 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.859564    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:19.860248 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.860233    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 17:08:19.860296 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.860237    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6x82w\""
Jul 21 17:08:19.860349 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.860236    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 17:08:19.860687 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.860664    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 17:08:19.860776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.860759    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 17:08:19.860860 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.860761    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 17:08:19.861749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.861732    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.864143 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.864081    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fdmt2\""
Jul 21 17:08:19.864256 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.864233    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.864378 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.864309    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 17:08:19.864832 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.864813    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 17:08:19.866550 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.866534    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.866679 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.866600    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:19.866865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.866846    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 17:08:19.867187 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.867164    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 17:08:19.869730 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.867443    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 17:08:19.869730 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.867629    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 17:08:19.869730 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.867675    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r5v5j\""
Jul 21 17:08:19.870398 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.870378    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.872926 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.872903    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:19.873022 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.872963    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 17:08:19.873657 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.873640    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pr7l4\""
Jul 21 17:08:19.875465 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.875444    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.876577 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.876558    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hmphm\""
Jul 21 17:08:19.876680 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.876663    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 17:08:19.877134 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.877120    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 17:08:19.878110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.878089    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.879735 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.879710    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 17:08:19.879913 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.879896    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ksf6w\""
Jul 21 17:08:19.880413 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.880399    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 17:08:19.880614 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.880596    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 17:08:19.880702 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.880639    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 17:08:19.880702 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.880595    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 17:08:19.880771 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.880645    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.880876    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.880930    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z49t\" (UniqueName: \"kubernetes.io/projected/3e406a77-f8af-4928-ad04-9cb21b97185e-kube-api-access-6z49t\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.880986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-os-release\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881019    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881066    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f972653-5525-4d5e-9224-9909fce9fd2b-dbus\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881085    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881112    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-conf-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.881121    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881145    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-daemon-config\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881161    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h4xbd\""
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881192    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-etc-kubernetes\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881210    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881235    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881264    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5np\" (UniqueName: \"kubernetes.io/projected/3b83efff-645b-49a3-a4de-1097a9f5594b-kube-api-access-lq5np\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.881282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881333    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-cni-bin\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-cni-multus\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881392    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-kubelet\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a071c9e9-5ae5-4311-891e-c82a81a2c399-hosts-file\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fc7b\" (UniqueName: \"kubernetes.io/projected/246c4c15-60a5-4442-bb07-779b13563b24-kube-api-access-2fc7b\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-socket-dir-parent\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a071c9e9-5ae5-4311-891e-c82a81a2c399-tmp-dir\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881532    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e406a77-f8af-4928-ad04-9cb21b97185e-cni-binary-copy\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881564    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-netns\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-hostroot\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-cnibin\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/246c4c15-60a5-4442-bb07-779b13563b24-host\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f972653-5525-4d5e-9224-9909fce9fd2b-kubelet-config\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881691    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-cnibin\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.882700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881790    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crj6p\" (UniqueName: \"kubernetes.io/projected/a071c9e9-5ae5-4311-891e-c82a81a2c399-kube-api-access-crj6p\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.882700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881838    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/246c4c15-60a5-4442-bb07-779b13563b24-serviceca\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.882700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881865    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-system-cni-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-cni-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881915    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-k8s-cni-cncf-io\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.881941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-system-cni-dir\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.882700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.882003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-os-release\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.882700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.882030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-multus-certs\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.883349 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.883328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:19.885795 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.885735    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 17:08:19.886117 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.886096    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 17:08:19.886243 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.886171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 17:08:19.886326 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.886304    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qrsq8\""
Jul 21 17:08:19.886451 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.886432    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:19.889170 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.889154    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:19.889400 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.889359    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:19.889706 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.889681    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 17:08:19.890078 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.890050    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:19.890681 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.890668    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t945v\""
Jul 21 17:08:19.921970 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.921949    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8phb"
Jul 21 17:08:19.933225 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.933199    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8phb"
Jul 21 17:08:19.969201 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.969178    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 17:08:19.982908 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.982880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e406a77-f8af-4928-ad04-9cb21b97185e-cni-binary-copy\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.982916    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-modprobe-d\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.982936    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-lib-modules\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.982954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-device-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.982976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-run-netns\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983001    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-var-lib-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983024    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-system-cni-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983041    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-k8s-cni-cncf-io\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983058    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-system-cni-dir\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.983085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983120    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-k8s-cni-cncf-io\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983131    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-host\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-system-cni-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983161    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-system-cni-dir\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983177    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z49t\" (UniqueName: \"kubernetes.io/projected/3e406a77-f8af-4928-ad04-9cb21b97185e-kube-api-access-6z49t\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983302    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983351    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-conf-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983406    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-conf-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.983460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-systemd\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983507    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-sys\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-iptables-alerter-script\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983554    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e406a77-f8af-4928-ad04-9cb21b97185e-cni-binary-copy\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93368af1-63b0-4112-ae5a-b6e20d16e7c4-agent-certs\") pod \"konnectivity-agent-25s6x\" (UID: \"93368af1-63b0-4112-ae5a-b6e20d16e7c4\") " pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-kubelet\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-cni-multus\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-kubelet\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983683    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fc7b\" (UniqueName: \"kubernetes.io/projected/246c4c15-60a5-4442-bb07-779b13563b24-kube-api-access-2fc7b\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysctl-conf\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983708    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-cni-multus\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983716    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-kubelet\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnp2d\" (UniqueName: \"kubernetes.io/projected/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-kube-api-access-xnp2d\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983846    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed4d2aec-d814-4211-896a-8b868ea5075e-ovn-node-metrics-cert\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983880    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdxk7\" (UniqueName: \"kubernetes.io/projected/ed4d2aec-d814-4211-896a-8b868ea5075e-kube-api-access-fdxk7\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-socket-dir-parent\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.983990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-tuned\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.983983    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-node-log\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984005    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-cni-bin\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984026    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-ovnkube-config\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984026    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984044    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-socket-dir-parent\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984077    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl48n\" (UniqueName: \"kubernetes.io/projected/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-kube-api-access-vl48n\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-systemd-units\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-netns\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-hostroot\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984177    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-netns\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984177    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-cnibin\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984210    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-cnibin\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984216    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/246c4c15-60a5-4442-bb07-779b13563b24-host\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984228    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-hostroot\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.984656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984246    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f972653-5525-4d5e-9224-9909fce9fd2b-kubelet-config\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984250    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/246c4c15-60a5-4442-bb07-779b13563b24-host\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984272    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-kubernetes\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984308    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-cnibin\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984325    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f972653-5525-4d5e-9224-9909fce9fd2b-kubelet-config\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984353    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crj6p\" (UniqueName: \"kubernetes.io/projected/a071c9e9-5ae5-4311-891e-c82a81a2c399-kube-api-access-crj6p\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.984365    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/246c4c15-60a5-4442-bb07-779b13563b24-serviceca\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysconfig\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984365    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-cnibin\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.984434    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret podName:2f972653-5525-4d5e-9224-9909fce9fd2b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:20.484413347 +0000 UTC m=+3.029729559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret") pod "global-pull-secret-syncer-qgrwt" (UID: "2f972653-5525-4d5e-9224-9909fce9fd2b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984518    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysctl-d\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b225e581-a894-45e2-b03f-26ea3c4b96e0-tmp\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984558    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-sys-fs\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-cni-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.985369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984634    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-slash\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984632    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984698    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984723    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-var-lib-kubelet\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-os-release\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984778    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-multus-certs\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-cni-dir\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984797    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-os-release\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-os-release\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984858    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-run-multus-certs\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984887    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/246c4c15-60a5-4442-bb07-779b13563b24-serviceca\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984898    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f972653-5525-4d5e-9224-9909fce9fd2b-dbus\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984924    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b83efff-645b-49a3-a4de-1097a9f5594b-os-release\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-etc-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.984976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-log-socket\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985045    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f972653-5525-4d5e-9224-9909fce9fd2b-dbus\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-env-overrides\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.986095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-daemon-config\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-etc-kubernetes\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5np\" (UniqueName: \"kubernetes.io/projected/3b83efff-645b-49a3-a4de-1097a9f5594b-kube-api-access-lq5np\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-etc-kubernetes\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985290    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-socket-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-etc-selinux\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-host-slash\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985386    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93368af1-63b0-4112-ae5a-b6e20d16e7c4-konnectivity-ca\") pod \"konnectivity-agent-25s6x\" (UID: \"93368af1-63b0-4112-ae5a-b6e20d16e7c4\") " pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-systemd\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985461    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-cni-bin\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e406a77-f8af-4928-ad04-9cb21b97185e-multus-daemon-config\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985492    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a071c9e9-5ae5-4311-891e-c82a81a2c399-hosts-file\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985529    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e406a77-f8af-4928-ad04-9cb21b97185e-host-var-lib-cni-bin\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-registration-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985562    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a071c9e9-5ae5-4311-891e-c82a81a2c399-hosts-file\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985588    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-run\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985603    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbbln\" (UniqueName: \"kubernetes.io/projected/b225e581-a894-45e2-b03f-26ea3c4b96e0-kube-api-access-jbbln\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:19.986624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985641    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r68mp\" (UniqueName: \"kubernetes.io/projected/150771fb-86ae-441a-bf9b-26a5c0f7a220-kube-api-access-r68mp\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-ovn\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985764    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985840    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a071c9e9-5ae5-4311-891e-c82a81a2c399-tmp-dir\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-cni-netd\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.985889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-ovnkube-script-lib\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.986111    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a071c9e9-5ae5-4311-891e-c82a81a2c399-tmp-dir\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:19.987142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.986795    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b83efff-645b-49a3-a4de-1097a9f5594b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.991120 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.991104    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:19.991168 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.991123    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:19.991168 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.991133    2557 projected.go:196] Error preparing data for projected volume kube-api-access-pwzln for pod openshift-network-diagnostics/network-check-target-p58wr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:19.991227 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:19.991206    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln podName:6805355f-023f-4ffe-8634-37c5a67c7ae8 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:20.491193645 +0000 UTC m=+3.036509840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pwzln" (UniqueName: "kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln") pod "network-check-target-p58wr" (UID: "6805355f-023f-4ffe-8634-37c5a67c7ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:19.992017 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.991989    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 17:08:19.995491 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.995465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5np\" (UniqueName: \"kubernetes.io/projected/3b83efff-645b-49a3-a4de-1097a9f5594b-kube-api-access-lq5np\") pod \"multus-additional-cni-plugins-rgr88\" (UID: \"3b83efff-645b-49a3-a4de-1097a9f5594b\") " pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:19.995584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.995469    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fc7b\" (UniqueName: \"kubernetes.io/projected/246c4c15-60a5-4442-bb07-779b13563b24-kube-api-access-2fc7b\") pod \"node-ca-q6ndw\" (UID: \"246c4c15-60a5-4442-bb07-779b13563b24\") " pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:19.995584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.995471    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z49t\" (UniqueName: \"kubernetes.io/projected/3e406a77-f8af-4928-ad04-9cb21b97185e-kube-api-access-6z49t\") pod \"multus-5vrp5\" (UID: \"3e406a77-f8af-4928-ad04-9cb21b97185e\") " pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:19.996000 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:19.995985    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crj6p\" (UniqueName: \"kubernetes.io/projected/a071c9e9-5ae5-4311-891e-c82a81a2c399-kube-api-access-crj6p\") pod \"node-resolver-fcjjl\" (UID: \"a071c9e9-5ae5-4311-891e-c82a81a2c399\") " pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:20.061143 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.061084    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal" event={"ID":"76884c21cf54c80d0a792e713b054514","Type":"ContainerStarted","Data":"8de74c8583166370a5a7fdb2f5cd4d22035a5987cecf942827baf0d685642fb5"}
Jul 21 17:08:20.062726 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.062701    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal" event={"ID":"fa105e049b9d72e7308c55b3aecfcaeb","Type":"ContainerStarted","Data":"ab0df563f5e93ad7de34fa8d45d9e7ed7f013b2560827d22d8bf8f98ea62f068"}
Jul 21 17:08:20.086923 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.086894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-kubernetes\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.086933    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysconfig\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.086959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysctl-d\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b225e581-a894-45e2-b03f-26ea3c4b96e0-tmp\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087028    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-sys-fs\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.087048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087038    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysconfig\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087042    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-kubernetes\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-slash\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-sys-fs\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087117    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-var-lib-kubelet\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-etc-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087177    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysctl-d\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-log-socket\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087217    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-etc-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087222    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-env-overrides\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087226    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087197    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-slash\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087168    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-var-lib-kubelet\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087255    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-log-socket\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.087273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087257    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-socket-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-etc-selinux\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087312    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-host-slash\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93368af1-63b0-4112-ae5a-b6e20d16e7c4-konnectivity-ca\") pod \"konnectivity-agent-25s6x\" (UID: \"93368af1-63b0-4112-ae5a-b6e20d16e7c4\") " pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-systemd\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087379    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-registration-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-run\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087418    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-etc-selinux\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087428    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbbln\" (UniqueName: \"kubernetes.io/projected/b225e581-a894-45e2-b03f-26ea3c4b96e0-kube-api-access-jbbln\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087418    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-host-slash\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087469    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-systemd\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087553    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087561    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-run\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087594    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68mp\" (UniqueName: \"kubernetes.io/projected/150771fb-86ae-441a-bf9b-26a5c0f7a220-kube-api-access-r68mp\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087625    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-ovn\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087643    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-socket-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087652    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.088059 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.087672    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087691    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-cni-netd\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.087725    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs podName:3f8bef54-e3ac-4056-9f92-6a0dd382d2c7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:20.587708439 +0000 UTC m=+3.133024649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs") pod "network-metrics-daemon-rlz7d" (UID: "3f8bef54-e3ac-4056-9f92-6a0dd382d2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087754    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-cni-netd\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087768    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-env-overrides\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087788    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-registration-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.087941    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-run-ovn\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088003    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-ovnkube-script-lib\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-modprobe-d\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088079    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-lib-modules\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088106    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-device-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-run-netns\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088155    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-modprobe-d\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088174    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-var-lib-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088228    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-device-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088263    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-host\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-systemd\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088338    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-lib-modules\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-sys\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088377    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-iptables-alerter-script\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088392    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088402    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93368af1-63b0-4112-ae5a-b6e20d16e7c4-agent-certs\") pod \"konnectivity-agent-25s6x\" (UID: \"93368af1-63b0-4112-ae5a-b6e20d16e7c4\") " pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088439    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-run-netns\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-kubelet\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088485    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-var-lib-openvswitch\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088478    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysctl-conf\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088543    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93368af1-63b0-4112-ae5a-b6e20d16e7c4-konnectivity-ca\") pod \"konnectivity-agent-25s6x\" (UID: \"93368af1-63b0-4112-ae5a-b6e20d16e7c4\") " pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnp2d\" (UniqueName: \"kubernetes.io/projected/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-kube-api-access-xnp2d\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-sys\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088600    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-systemd\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088604    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed4d2aec-d814-4211-896a-8b868ea5075e-ovn-node-metrics-cert\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.089644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088628    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-kubelet\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdxk7\" (UniqueName: \"kubernetes.io/projected/ed4d2aec-d814-4211-896a-8b868ea5075e-kube-api-access-fdxk7\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088672    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-tuned\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088783    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-node-log\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-cni-bin\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.088845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-ovnkube-config\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.089379    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl48n\" (UniqueName: \"kubernetes.io/projected/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-kube-api-access-vl48n\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.089436    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-systemd-units\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.089996    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-sysctl-conf\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.090079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b225e581-a894-45e2-b03f-26ea3c4b96e0-host\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.090186    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-ovnkube-script-lib\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.090352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.090355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b225e581-a894-45e2-b03f-26ea3c4b96e0-tmp\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.090862 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.090426    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-host-cni-bin\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.090965 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.090944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-iptables-alerter-script\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:20.091399 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.091378    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/150771fb-86ae-441a-bf9b-26a5c0f7a220-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.091477 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.091404    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-node-log\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.092115 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.092040    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed4d2aec-d814-4211-896a-8b868ea5075e-ovnkube-config\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.092598 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.092575    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed4d2aec-d814-4211-896a-8b868ea5075e-systemd-units\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.094454 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.094429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b225e581-a894-45e2-b03f-26ea3c4b96e0-etc-tuned\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.095958 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.095932    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93368af1-63b0-4112-ae5a-b6e20d16e7c4-agent-certs\") pod \"konnectivity-agent-25s6x\" (UID: \"93368af1-63b0-4112-ae5a-b6e20d16e7c4\") " pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:20.096038 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.096011    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed4d2aec-d814-4211-896a-8b868ea5075e-ovn-node-metrics-cert\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.100567 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.100543    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbbln\" (UniqueName: \"kubernetes.io/projected/b225e581-a894-45e2-b03f-26ea3c4b96e0-kube-api-access-jbbln\") pod \"tuned-sn949\" (UID: \"b225e581-a894-45e2-b03f-26ea3c4b96e0\") " pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.101223 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.101159    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r68mp\" (UniqueName: \"kubernetes.io/projected/150771fb-86ae-441a-bf9b-26a5c0f7a220-kube-api-access-r68mp\") pod \"aws-ebs-csi-driver-node-5c8pg\" (UID: \"150771fb-86ae-441a-bf9b-26a5c0f7a220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.101539 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.101514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdxk7\" (UniqueName: \"kubernetes.io/projected/ed4d2aec-d814-4211-896a-8b868ea5075e-kube-api-access-fdxk7\") pod \"ovnkube-node-rtjql\" (UID: \"ed4d2aec-d814-4211-896a-8b868ea5075e\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.101879 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.101855    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl48n\" (UniqueName: \"kubernetes.io/projected/abbebfbf-7bb9-490a-b362-eea8ee19e4d5-kube-api-access-vl48n\") pod \"iptables-alerter-dk2bg\" (UID: \"abbebfbf-7bb9-490a-b362-eea8ee19e4d5\") " pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:20.102937 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.102913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnp2d\" (UniqueName: \"kubernetes.io/projected/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-kube-api-access-xnp2d\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:20.167621 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.167588    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rgr88"
Jul 21 17:08:20.175745 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.175718    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fcjjl"
Jul 21 17:08:20.178137 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:20.178102    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b83efff_645b_49a3_a4de_1097a9f5594b.slice/crio-d40b5c3e31d5027425c0adabff6fa7004487183ee8fee8a9c5e6ecd6c4133a01 WatchSource:0}: Error finding container d40b5c3e31d5027425c0adabff6fa7004487183ee8fee8a9c5e6ecd6c4133a01: Status 404 returned error can't find the container with id d40b5c3e31d5027425c0adabff6fa7004487183ee8fee8a9c5e6ecd6c4133a01
Jul 21 17:08:20.184713 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.184685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q6ndw"
Jul 21 17:08:20.188808 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.188789    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vrp5"
Jul 21 17:08:20.193668 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:20.193641    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda071c9e9_5ae5_4311_891e_c82a81a2c399.slice/crio-fbabca10054cdaa14ec41e528f44f12a969bfbe0286c1b1c748ac3cda1fa55df WatchSource:0}: Error finding container fbabca10054cdaa14ec41e528f44f12a969bfbe0286c1b1c748ac3cda1fa55df: Status 404 returned error can't find the container with id fbabca10054cdaa14ec41e528f44f12a969bfbe0286c1b1c748ac3cda1fa55df
Jul 21 17:08:20.195090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.195070    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:20.198344 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:20.198321    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246c4c15_60a5_4442_bb07_779b13563b24.slice/crio-4a064f70ab666b078593d93a75e6f6c58913761e41a6267992be284258f9aeab WatchSource:0}: Error finding container 4a064f70ab666b078593d93a75e6f6c58913761e41a6267992be284258f9aeab: Status 404 returned error can't find the container with id 4a064f70ab666b078593d93a75e6f6c58913761e41a6267992be284258f9aeab
Jul 21 17:08:20.201271 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.201235    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:20.201920 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:20.201893    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e406a77_f8af_4928_ad04_9cb21b97185e.slice/crio-4cad818629222113266d4a025af5bb8734f134a90a0b440298fb33825407136a WatchSource:0}: Error finding container 4cad818629222113266d4a025af5bb8734f134a90a0b440298fb33825407136a: Status 404 returned error can't find the container with id 4cad818629222113266d4a025af5bb8734f134a90a0b440298fb33825407136a
Jul 21 17:08:20.206725 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:20.206703    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93368af1_63b0_4112_ae5a_b6e20d16e7c4.slice/crio-558093d1c796792b5779ec02528ad92b8acdb04c9947125ce71c909620f5dca2 WatchSource:0}: Error finding container 558093d1c796792b5779ec02528ad92b8acdb04c9947125ce71c909620f5dca2: Status 404 returned error can't find the container with id 558093d1c796792b5779ec02528ad92b8acdb04c9947125ce71c909620f5dca2
Jul 21 17:08:20.207999 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.207976    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sn949"
Jul 21 17:08:20.212939 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.212916    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg"
Jul 21 17:08:20.213573 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:20.213541    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4d2aec_d814_4211_896a_8b868ea5075e.slice/crio-1bab3a8d2597f9b5fa3506ac0874779995eb0f93d3810ad4fdf104155f65fd63 WatchSource:0}: Error finding container 1bab3a8d2597f9b5fa3506ac0874779995eb0f93d3810ad4fdf104155f65fd63: Status 404 returned error can't find the container with id 1bab3a8d2597f9b5fa3506ac0874779995eb0f93d3810ad4fdf104155f65fd63
Jul 21 17:08:20.221570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.221327    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dk2bg"
Jul 21 17:08:20.226358 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:20.226333    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb225e581_a894_45e2_b03f_26ea3c4b96e0.slice/crio-fed6b091c7e0a72964c4adfba1d2be6f5373ab44f780532f4f94ee5d42cb651c WatchSource:0}: Error finding container fed6b091c7e0a72964c4adfba1d2be6f5373ab44f780532f4f94ee5d42cb651c: Status 404 returned error can't find the container with id fed6b091c7e0a72964c4adfba1d2be6f5373ab44f780532f4f94ee5d42cb651c
Jul 21 17:08:20.492025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.491931    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:20.492025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.492013    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:20.492244 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.492096    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:20.492244 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.492122    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:20.492244 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.492135    2557 projected.go:196] Error preparing data for projected volume kube-api-access-pwzln for pod openshift-network-diagnostics/network-check-target-p58wr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:20.492244 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.492182    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:20.492244 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.492194    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln podName:6805355f-023f-4ffe-8634-37c5a67c7ae8 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:21.492178544 +0000 UTC m=+4.037494745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwzln" (UniqueName: "kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln") pod "network-check-target-p58wr" (UID: "6805355f-023f-4ffe-8634-37c5a67c7ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:20.492604 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.492261    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret podName:2f972653-5525-4d5e-9224-9909fce9fd2b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:21.492241633 +0000 UTC m=+4.037557846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret") pod "global-pull-secret-syncer-qgrwt" (UID: "2f972653-5525-4d5e-9224-9909fce9fd2b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:20.593430 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.593387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:20.593605 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.593563    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:20.593664 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:20.593631    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs podName:3f8bef54-e3ac-4056-9f92-6a0dd382d2c7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:21.593617137 +0000 UTC m=+4.138933336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs") pod "network-metrics-daemon-rlz7d" (UID: "3f8bef54-e3ac-4056-9f92-6a0dd382d2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:20.937206 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.937111    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 17:03:20 +0000 UTC" deadline="2027-12-21 09:03:52.466562305 +0000 UTC"
Jul 21 17:08:20.937206 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:20.937152    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12423h55m31.529414765s"
Jul 21 17:08:21.056618 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.056557    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:21.056618 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.056575    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:21.056882 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.056692    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:21.056951 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.056901    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:21.066473 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.066432    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dk2bg" event={"ID":"abbebfbf-7bb9-490a-b362-eea8ee19e4d5","Type":"ContainerStarted","Data":"a4b05612889bb591e73a91e1614d6cfcb8f8bf4a42122c2f07d5f12cba619315"}
Jul 21 17:08:21.068098 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.068065    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sn949" event={"ID":"b225e581-a894-45e2-b03f-26ea3c4b96e0","Type":"ContainerStarted","Data":"fed6b091c7e0a72964c4adfba1d2be6f5373ab44f780532f4f94ee5d42cb651c"}
Jul 21 17:08:21.069408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.069381    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fcjjl" event={"ID":"a071c9e9-5ae5-4311-891e-c82a81a2c399","Type":"ContainerStarted","Data":"fbabca10054cdaa14ec41e528f44f12a969bfbe0286c1b1c748ac3cda1fa55df"}
Jul 21 17:08:21.070842 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.070778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg" event={"ID":"150771fb-86ae-441a-bf9b-26a5c0f7a220","Type":"ContainerStarted","Data":"b7647a95e38574412e02c1d92002e93fa2455a1ab9e7880a91a2aa5cb868db3a"}
Jul 21 17:08:21.072311 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.072218    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"1bab3a8d2597f9b5fa3506ac0874779995eb0f93d3810ad4fdf104155f65fd63"}
Jul 21 17:08:21.073548 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.073519    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-25s6x" event={"ID":"93368af1-63b0-4112-ae5a-b6e20d16e7c4","Type":"ContainerStarted","Data":"558093d1c796792b5779ec02528ad92b8acdb04c9947125ce71c909620f5dca2"}
Jul 21 17:08:21.074841 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.074801    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vrp5" event={"ID":"3e406a77-f8af-4928-ad04-9cb21b97185e","Type":"ContainerStarted","Data":"4cad818629222113266d4a025af5bb8734f134a90a0b440298fb33825407136a"}
Jul 21 17:08:21.075998 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.075975    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q6ndw" event={"ID":"246c4c15-60a5-4442-bb07-779b13563b24","Type":"ContainerStarted","Data":"4a064f70ab666b078593d93a75e6f6c58913761e41a6267992be284258f9aeab"}
Jul 21 17:08:21.077085 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.077061    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerStarted","Data":"d40b5c3e31d5027425c0adabff6fa7004487183ee8fee8a9c5e6ecd6c4133a01"}
Jul 21 17:08:21.500044 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.500005    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:21.500251 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.500083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:21.500251 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.500239    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:21.500373 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.500313    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret podName:2f972653-5525-4d5e-9224-9909fce9fd2b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:23.500285708 +0000 UTC m=+6.045601909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret") pod "global-pull-secret-syncer-qgrwt" (UID: "2f972653-5525-4d5e-9224-9909fce9fd2b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:21.500834 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.500621    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:21.500834 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.500651    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:21.500834 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.500666    2557 projected.go:196] Error preparing data for projected volume kube-api-access-pwzln for pod openshift-network-diagnostics/network-check-target-p58wr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:21.500834 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.500724    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln podName:6805355f-023f-4ffe-8634-37c5a67c7ae8 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:23.500705618 +0000 UTC m=+6.046021829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwzln" (UniqueName: "kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln") pod "network-check-target-p58wr" (UID: "6805355f-023f-4ffe-8634-37c5a67c7ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:21.601395 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.601357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:21.601622 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.601539    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:21.601760 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:21.601618    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs podName:3f8bef54-e3ac-4056-9f92-6a0dd382d2c7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:23.601598259 +0000 UTC m=+6.146914475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs") pod "network-metrics-daemon-rlz7d" (UID: "3f8bef54-e3ac-4056-9f92-6a0dd382d2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:21.937753 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.937677    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 17:03:20 +0000 UTC" deadline="2028-02-01 17:48:03.559978638 +0000 UTC"
Jul 21 17:08:21.937753 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:21.937718    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13440h39m41.622265822s"
Jul 21 17:08:22.058188 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:22.058153    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:22.058363 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:22.058303    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:23.056256 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:23.056213    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:23.056765 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.056378    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:23.056992 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:23.056971    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:23.057174 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.057142    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:23.516316 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:23.516231    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:23.516316 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:23.516293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:23.516541 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.516412    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:23.516541 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.516425    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:23.516541 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.516433    2557 projected.go:196] Error preparing data for projected volume kube-api-access-pwzln for pod openshift-network-diagnostics/network-check-target-p58wr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:23.516541 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.516476    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln podName:6805355f-023f-4ffe-8634-37c5a67c7ae8 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:27.516462375 +0000 UTC m=+10.061778569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwzln" (UniqueName: "kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln") pod "network-check-target-p58wr" (UID: "6805355f-023f-4ffe-8634-37c5a67c7ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:23.516541 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.516543    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:23.516790 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.516567    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret podName:2f972653-5525-4d5e-9224-9909fce9fd2b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:27.516560157 +0000 UTC m=+10.061876351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret") pod "global-pull-secret-syncer-qgrwt" (UID: "2f972653-5525-4d5e-9224-9909fce9fd2b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:23.617708 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:23.617671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:23.617898 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.617828    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:23.617898 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:23.617898    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs podName:3f8bef54-e3ac-4056-9f92-6a0dd382d2c7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:27.617877656 +0000 UTC m=+10.163193856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs") pod "network-metrics-daemon-rlz7d" (UID: "3f8bef54-e3ac-4056-9f92-6a0dd382d2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:24.058342 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:24.058309    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:24.058829 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:24.058443    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:25.056397 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:25.055980    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:25.056397 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:25.056096    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:25.056397 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:25.056347    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:25.056657 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:25.056466    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:26.056404 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:26.056330    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:26.056832 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:26.056480    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:27.055705 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:27.055670    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:27.055919 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.055815    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:27.056361 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:27.056251    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:27.056476 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.056387    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:27.548910 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:27.548742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:27.548910 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:27.548855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:27.549116 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.548962    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:27.549116 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.548994    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:27.549116 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.549022    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:27.549116 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.549035    2557 projected.go:196] Error preparing data for projected volume kube-api-access-pwzln for pod openshift-network-diagnostics/network-check-target-p58wr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:27.549116 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.549088    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret podName:2f972653-5525-4d5e-9224-9909fce9fd2b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:35.549045715 +0000 UTC m=+18.094361924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret") pod "global-pull-secret-syncer-qgrwt" (UID: "2f972653-5525-4d5e-9224-9909fce9fd2b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:27.549116 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.549110    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln podName:6805355f-023f-4ffe-8634-37c5a67c7ae8 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:35.549099537 +0000 UTC m=+18.094415746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwzln" (UniqueName: "kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln") pod "network-check-target-p58wr" (UID: "6805355f-023f-4ffe-8634-37c5a67c7ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:27.649951 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:27.649914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:27.650120 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.650088    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:27.650176 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:27.650169    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs podName:3f8bef54-e3ac-4056-9f92-6a0dd382d2c7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:35.650149113 +0000 UTC m=+18.195465326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs") pod "network-metrics-daemon-rlz7d" (UID: "3f8bef54-e3ac-4056-9f92-6a0dd382d2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:28.057286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:28.057250    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:28.057832 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:28.057371    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:29.056293 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:29.056195    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:29.056482 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:29.056333    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:29.056864 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:29.056777    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:29.056973 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:29.056905    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:30.056580 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:30.056544    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:30.057031 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:30.056667    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:31.056489 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:31.055621    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:31.056489 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:31.056031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:31.056489 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:31.056206    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:31.056489 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:31.056021    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:31.098934 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:31.098905    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal" event={"ID":"76884c21cf54c80d0a792e713b054514","Type":"ContainerStarted","Data":"832dc3fde46dac7f59a3cefd4ddd71ef3e917c5af1fe3ae11e6b7843562f595c"}
Jul 21 17:08:32.056492 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:32.056385    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:32.056638 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:32.056521    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:32.102484 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:32.102451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sn949" event={"ID":"b225e581-a894-45e2-b03f-26ea3c4b96e0","Type":"ContainerStarted","Data":"e98cb06ede483bba2288e98747e71a3fbe6bff3100dd7d47ef32847e07ba7655"}
Jul 21 17:08:32.144867 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:32.144790    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sn949" podStartSLOduration=3.449358314 podStartE2EDuration="14.144769822s" totalImagesPullingTime="10.695411508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:32.144203152 +0000 UTC m=+14.689519372" watchObservedRunningTime="2026-07-21 17:08:32.144769822 +0000 UTC m=+14.690086039"
Jul 21 17:08:32.168623 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:32.168475    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-12.ec2.internal" podStartSLOduration=13.168440518 podStartE2EDuration="13.168440518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:32.168108819 +0000 UTC m=+14.713425035" watchObservedRunningTime="2026-07-21 17:08:32.168440518 +0000 UTC m=+14.713756740"
Jul 21 17:08:33.056117 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.056080    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:33.056283 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:33.056209    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:33.056338 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.056274    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:33.056426 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:33.056397    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:33.106584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.106513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerStarted","Data":"ab4d2a50e7d39ac6706dae9aa281babe180967a792e6035b63d347018476e56b"}
Jul 21 17:08:33.108265 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.108233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal" event={"ID":"fa105e049b9d72e7308c55b3aecfcaeb","Type":"ContainerStarted","Data":"f6be361d7141d1d29c8abbf9897d9f9be106e5fd5f9a8c1ac5282a66c3a18cf9"}
Jul 21 17:08:33.110063 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.110022    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dk2bg" event={"ID":"abbebfbf-7bb9-490a-b362-eea8ee19e4d5","Type":"ContainerStarted","Data":"f512c971a66e72fb2882ef5ce9419ce042b3f7409f3828eb8322b86f88356f1c"}
Jul 21 17:08:33.111704 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.111679    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fcjjl" event={"ID":"a071c9e9-5ae5-4311-891e-c82a81a2c399","Type":"ContainerStarted","Data":"fda16841dad35fd8b8721bafa103294d92e9ef27f100cbb4a829f41ff59b15c0"}
Jul 21 17:08:33.113420 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.113396    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg" event={"ID":"150771fb-86ae-441a-bf9b-26a5c0f7a220","Type":"ContainerStarted","Data":"e54ba6268e001f15a5518c6f517ddb3701f87797dd29cf929d56921dd00c1633"}
Jul 21 17:08:33.114922 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.114900    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-25s6x" event={"ID":"93368af1-63b0-4112-ae5a-b6e20d16e7c4","Type":"ContainerStarted","Data":"535bb8243d3ee8453233681043ad3f81acc006a291d6af16eb40473b9181a055"}
Jul 21 17:08:33.116527 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.116490    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q6ndw" event={"ID":"246c4c15-60a5-4442-bb07-779b13563b24","Type":"ContainerStarted","Data":"8fc129bae49d04d0546f2ec0c4a5346a89f149bba1f093aee2e59d576b5a239a"}
Jul 21 17:08:33.218635 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.218579    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-25s6x" podStartSLOduration=4.497543044 podStartE2EDuration="15.218541944s" totalImagesPullingTime="10.7209989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:33.189304769 +0000 UTC m=+15.734620988" watchObservedRunningTime="2026-07-21 17:08:33.218541944 +0000 UTC m=+15.763858161"
Jul 21 17:08:33.249327 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.249272    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q6ndw" podStartSLOduration=4.788942752 podStartE2EDuration="15.249253502s" totalImagesPullingTime="10.46031075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:33.248918296 +0000 UTC m=+15.794234512" watchObservedRunningTime="2026-07-21 17:08:33.249253502 +0000 UTC m=+15.794569719"
Jul 21 17:08:33.311443 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.311356    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dk2bg" podStartSLOduration=4.626604012 podStartE2EDuration="15.311339782s" totalImagesPullingTime="10.68473577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:33.271067733 +0000 UTC m=+15.816383947" watchObservedRunningTime="2026-07-21 17:08:33.311339782 +0000 UTC m=+15.856656059"
Jul 21 17:08:33.311737 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:33.311706    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fcjjl" podStartSLOduration=4.584817996 podStartE2EDuration="15.311694984s" totalImagesPullingTime="10.726876988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:33.310939796 +0000 UTC m=+15.856256012" watchObservedRunningTime="2026-07-21 17:08:33.311694984 +0000 UTC m=+15.857011200"
Jul 21 17:08:34.033408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:34.033375    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:34.034161 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:34.034135    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:34.055874 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:34.055852    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:34.056025 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:34.055972    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:35.056483 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:35.056424    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:35.057106 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:35.056424    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:35.057106 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.056561    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:35.057106 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.056684    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:35.120588 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:35.120559    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 17:08:35.610024 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:35.609981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:35.610210 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:35.610076    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:35.610210 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.610131    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:35.610210 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.610172    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:35.610210 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.610189    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:35.610210 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.610192    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret podName:2f972653-5525-4d5e-9224-9909fce9fd2b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:51.610174203 +0000 UTC m=+34.155490404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret") pod "global-pull-secret-syncer-qgrwt" (UID: "2f972653-5525-4d5e-9224-9909fce9fd2b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:35.610210 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.610203    2557 projected.go:196] Error preparing data for projected volume kube-api-access-pwzln for pod openshift-network-diagnostics/network-check-target-p58wr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:35.610467 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.610236    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln podName:6805355f-023f-4ffe-8634-37c5a67c7ae8 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:51.610225018 +0000 UTC m=+34.155541225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwzln" (UniqueName: "kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln") pod "network-check-target-p58wr" (UID: "6805355f-023f-4ffe-8634-37c5a67c7ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:35.710882 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:35.710850    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:35.711037 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.711001    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:35.711085 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:35.711061    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs podName:3f8bef54-e3ac-4056-9f92-6a0dd382d2c7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:51.711046532 +0000 UTC m=+34.256362737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs") pod "network-metrics-daemon-rlz7d" (UID: "3f8bef54-e3ac-4056-9f92-6a0dd382d2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:36.055937 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:36.055898    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:36.056091 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:36.056018    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:36.124976 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:36.124935    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b83efff-645b-49a3-a4de-1097a9f5594b" containerID="ab4d2a50e7d39ac6706dae9aa281babe180967a792e6035b63d347018476e56b" exitCode=0
Jul 21 17:08:36.125515 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:36.125017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerDied","Data":"ab4d2a50e7d39ac6706dae9aa281babe180967a792e6035b63d347018476e56b"}
Jul 21 17:08:36.127250 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:36.127219    2557 generic.go:356] "Generic (PLEG): container finished" podID="fa105e049b9d72e7308c55b3aecfcaeb" containerID="f6be361d7141d1d29c8abbf9897d9f9be106e5fd5f9a8c1ac5282a66c3a18cf9" exitCode=0
Jul 21 17:08:36.127420 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:36.127275    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal" event={"ID":"fa105e049b9d72e7308c55b3aecfcaeb","Type":"ContainerDied","Data":"f6be361d7141d1d29c8abbf9897d9f9be106e5fd5f9a8c1ac5282a66c3a18cf9"}
Jul 21 17:08:37.056466 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:37.056418    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:37.056616 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:37.056490    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:37.056682 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:37.056618    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:37.056791 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:37.056765    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:38.059566 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:38.059540    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:38.060078 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:38.059643    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:39.056006 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:39.055973    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:39.056155 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:39.056106    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:39.056227 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:39.056203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:39.056327 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:39.056308    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:40.056072 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:40.056029    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:40.056500 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:40.056178    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:40.408369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:40.408188    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 17:08:40.948396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:40.948044    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T17:08:40.408366888Z","UUID":"65a5e979-4f89-44bb-a3ba-ce04471e916f","Handler":null,"Name":"","Endpoint":""}
Jul 21 17:08:40.949811 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:40.949773    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 17:08:40.949974 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:40.949835    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 17:08:41.056514 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.056487    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:41.057026 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:41.056608    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:41.057026 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.056638    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:41.057026 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:41.056764    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:41.138945 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.138911    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg" event={"ID":"150771fb-86ae-441a-bf9b-26a5c0f7a220","Type":"ContainerStarted","Data":"390e8be6c69f420644520486362152aad59d21c853cddfa8380d79167ad1abd8"}
Jul 21 17:08:41.141713 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.141688    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"5ae719b31d4fdaaff9f302e8aeecdf864ca8b574dc7933014f21f6e2a4a73d5d"}
Jul 21 17:08:41.141858 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.141762    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"8ed0f543ddc8debb5405862554880542952b56bac7063af9d54720b9b1bf28c9"}
Jul 21 17:08:41.141858 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.141825    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"d08fb975e37055990d29b79385a93de4baf149caf2702ab6051ab172448b08ba"}
Jul 21 17:08:41.141970 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.141872    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"aaea5f07bb0ba5b703bef8ed47da6d59a7467929da80920cdff5d05c19a3c915"}
Jul 21 17:08:41.141970 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.141918    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"80bd05b9c5a2f89acba461d230a36256b7f1212e62af8ff68b2814e48053688b"}
Jul 21 17:08:41.141970 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.141965    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"7870db7582385516db6d361c5a759f0680bf512a34d1e1815c11419f62fff673"}
Jul 21 17:08:41.143160 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.143130    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vrp5" event={"ID":"3e406a77-f8af-4928-ad04-9cb21b97185e","Type":"ContainerStarted","Data":"06daeb8925e196e0917c05c5bb7a2e17151a56b4cf752d00dbe9bf04c44d0ef2"}
Jul 21 17:08:41.144721 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.144696    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal" event={"ID":"fa105e049b9d72e7308c55b3aecfcaeb","Type":"ContainerStarted","Data":"109f4fc3457bcc91aa81551eb005e11c2b67964cb2195743e299a102463fd322"}
Jul 21 17:08:41.164310 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:41.164277    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5vrp5" podStartSLOduration=3.32638718 podStartE2EDuration="23.164265813s" totalImagesPullingTime="19.837878633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:41.164116368 +0000 UTC m=+23.709432582" watchObservedRunningTime="2026-07-21 17:08:41.164265813 +0000 UTC m=+23.709582026"
Jul 21 17:08:42.056230 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:42.056153    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:42.056391 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:42.056274    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:42.149240 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:42.149203    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg" event={"ID":"150771fb-86ae-441a-bf9b-26a5c0f7a220","Type":"ContainerStarted","Data":"95cc125897f6005c113c0ec74aa5dc532d0134abd88d327f8c78597d7e091ab5"}
Jul 21 17:08:42.170935 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:42.170886    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-12.ec2.internal" podStartSLOduration=23.170868706 podStartE2EDuration="23.170868706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:41.18002913 +0000 UTC m=+23.725345347" watchObservedRunningTime="2026-07-21 17:08:42.170868706 +0000 UTC m=+24.716184923"
Jul 21 17:08:43.056262 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:43.056231    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:43.056460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:43.056336    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:43.056460 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:43.056431    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:43.056590 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:43.056432    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:43.364309 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:43.364275    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:43.364781 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:43.364471    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 17:08:43.365064 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:43.365033    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-25s6x"
Jul 21 17:08:43.384745 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:43.384696    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5c8pg" podStartSLOduration=5.615934526 podStartE2EDuration="25.384677311s" totalImagesPullingTime="19.768742785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:42.17064815 +0000 UTC m=+24.715964356" watchObservedRunningTime="2026-07-21 17:08:43.384677311 +0000 UTC m=+25.929993528"
Jul 21 17:08:44.055640 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:44.055607    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:44.055836 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:44.055736    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:45.056675 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:45.056600    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:45.057165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:45.056600    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:45.057165 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:45.056711    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:45.057165 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:45.056811    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:45.157641 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:45.157609    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b83efff-645b-49a3-a4de-1097a9f5594b" containerID="d1cabf7e58253928536e092584e3cf867f7eb37e89a0aa6b65681b1d0f910e1d" exitCode=0
Jul 21 17:08:45.157839 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:45.157698    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerDied","Data":"d1cabf7e58253928536e092584e3cf867f7eb37e89a0aa6b65681b1d0f910e1d"}
Jul 21 17:08:45.161466 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:45.161446    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"16a58c7cea7a168169870ece822f2b633fc41880f6d717e8047cba1bed4c35e8"}
Jul 21 17:08:46.055984 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:46.055953    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:46.056157 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:46.056063    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:47.056485 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:47.056286    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:47.057145 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:47.056287    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:47.057145 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:47.056573    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:47.057145 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:47.056638    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:47.168976 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:47.168933    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" event={"ID":"ed4d2aec-d814-4211-896a-8b868ea5075e","Type":"ContainerStarted","Data":"0f485cc881dd08349682d46e322f1ccf1d446d8867029385643b62f5914816fb"}
Jul 21 17:08:47.169178 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:47.169153    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:47.171060 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:47.171033    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b83efff-645b-49a3-a4de-1097a9f5594b" containerID="33565c227924182c2e6e0771832c4ad999779a82f33964916473a1fad8b2fac0" exitCode=0
Jul 21 17:08:47.171166 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:47.171071    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerDied","Data":"33565c227924182c2e6e0771832c4ad999779a82f33964916473a1fad8b2fac0"}
Jul 21 17:08:47.185284 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:47.185265    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:47.203970 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:47.203933    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql" podStartSLOduration=9.378221127 podStartE2EDuration="29.203920148s" totalImagesPullingTime="19.825699021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:47.203593965 +0000 UTC m=+29.748910180" watchObservedRunningTime="2026-07-21 17:08:47.203920148 +0000 UTC m=+29.749236366"
Jul 21 17:08:48.057179 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.057146    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:48.057500 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:48.057267    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:48.175512 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.175443    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b83efff-645b-49a3-a4de-1097a9f5594b" containerID="a73a01cec0b41c7aa0bea86cd316f60e1a61b59dd1a32b90ae9301ee11cb59f5" exitCode=0
Jul 21 17:08:48.175650 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.175509    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerDied","Data":"a73a01cec0b41c7aa0bea86cd316f60e1a61b59dd1a32b90ae9301ee11cb59f5"}
Jul 21 17:08:48.176094 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.176075    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:48.176188 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.176149    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:48.190574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.190544    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:08:48.777710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.777673    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qgrwt"]
Jul 21 17:08:48.777886 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.777874    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:48.778003 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:48.777976    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:48.797264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.797233    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlz7d"]
Jul 21 17:08:48.797413 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.797371    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:48.797517 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:48.797493    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:48.818486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.818394    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p58wr"]
Jul 21 17:08:48.818622 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:48.818521    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:48.818679 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:48.818629    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:50.055745 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:50.055710    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:50.056206 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:50.055711    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:50.056206 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:50.055869    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:50.056206 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:50.055926    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:51.056023 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:51.055938    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:51.056462 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.056056    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p58wr" podUID="6805355f-023f-4ffe-8634-37c5a67c7ae8"
Jul 21 17:08:51.632874 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:51.632646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:51.633051 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.632836    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:51.633051 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.633009    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret podName:2f972653-5525-4d5e-9224-9909fce9fd2b nodeName:}" failed. No retries permitted until 2026-07-21 17:09:23.632988001 +0000 UTC m=+66.178304209 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret") pod "global-pull-secret-syncer-qgrwt" (UID: "2f972653-5525-4d5e-9224-9909fce9fd2b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:51.633051 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:51.632932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:51.633051 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.633035    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:51.633051 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.633054    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:51.633237 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.633067    2557 projected.go:196] Error preparing data for projected volume kube-api-access-pwzln for pod openshift-network-diagnostics/network-check-target-p58wr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:51.633237 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.633115    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln podName:6805355f-023f-4ffe-8634-37c5a67c7ae8 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:23.633104322 +0000 UTC m=+66.178420536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwzln" (UniqueName: "kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln") pod "network-check-target-p58wr" (UID: "6805355f-023f-4ffe-8634-37c5a67c7ae8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:51.734385 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:51.734352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:51.734565 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.734496    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:51.734565 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:51.734557    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs podName:3f8bef54-e3ac-4056-9f92-6a0dd382d2c7 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:23.734539843 +0000 UTC m=+66.279856041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs") pod "network-metrics-daemon-rlz7d" (UID: "3f8bef54-e3ac-4056-9f92-6a0dd382d2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:52.056023 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.055938    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:52.056023 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.055956    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:52.056487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:52.056067    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlz7d" podUID="3f8bef54-e3ac-4056-9f92-6a0dd382d2c7"
Jul 21 17:08:52.056487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:52.056212    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgrwt" podUID="2f972653-5525-4d5e-9224-9909fce9fd2b"
Jul 21 17:08:52.790297 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.790233    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-12.ec2.internal" event="NodeReady"
Jul 21 17:08:52.790491 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.790357    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 17:08:52.834814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.834775    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dc474dd6-jtqwk"]
Jul 21 17:08:52.841187 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.840871    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"]
Jul 21 17:08:52.841354 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.841333    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.844363 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.844345    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 17:08:52.844673 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.844660    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 17:08:52.844751 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.844663    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h5krw\""
Jul 21 17:08:52.844972 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.844958    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 17:08:52.846889 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.846871    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv"]
Jul 21 17:08:52.847050 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.847035    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:52.851043 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.851029    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dtrzc\""
Jul 21 17:08:52.851237 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.851209    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 21 17:08:52.851329 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.851249    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.851329 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.851278    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.851329 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.851299    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 21 17:08:52.851461 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.851396    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 17:08:52.853072 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.853055    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"]
Jul 21 17:08:52.853165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.853151    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv"
Jul 21 17:08:52.855988 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.855952    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.856715 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.856589    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.857668 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.856863    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wvswm\""
Jul 21 17:08:52.859292 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.859276    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-q6qqz"]
Jul 21 17:08:52.859487 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.859467    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:52.863888 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.863870    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.863970 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.863929    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 21 17:08:52.865583 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.865549    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"]
Jul 21 17:08:52.865583 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.865573    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dw2sz\""
Jul 21 17:08:52.865746 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.865582    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.865746 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.865621    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 21 17:08:52.865746 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.865678    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:52.871254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.870614    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xjsbs"]
Jul 21 17:08:52.871254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.870644    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.871254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.870854    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 17:08:52.871254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.870916    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 17:08:52.871254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.870857    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.871254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.871208    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m9btw\""
Jul 21 17:08:52.871621 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.871583    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:52.879593 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.878719    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"]
Jul 21 17:08:52.879593 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.878888    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:52.881185 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.880455    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.881185 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.880760    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.881534 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.881511    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 21 17:08:52.881757 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.881732    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zl8qj\""
Jul 21 17:08:52.884317 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884285    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dc474dd6-jtqwk"]
Jul 21 17:08:52.884421 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884351    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"]
Jul 21 17:08:52.884421 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884370    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv"]
Jul 21 17:08:52.884421 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884418    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"]
Jul 21 17:08:52.884590 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884464    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-q6qqz"]
Jul 21 17:08:52.884590 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884483    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xjsbs"]
Jul 21 17:08:52.884590 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884502    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"]
Jul 21 17:08:52.884590 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884540    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:52.884774 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.884519    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"]
Jul 21 17:08:52.885298 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.885263    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.885298 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.885279    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 17:08:52.885443 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.885264    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zdks4\""
Jul 21 17:08:52.885495 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.885272    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 21 17:08:52.885542 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.885490    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.885591 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.885538    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 21 17:08:52.887582 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.887563    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 21 17:08:52.887677 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.887568    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 21 17:08:52.890865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.890847    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 21 17:08:52.894988 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.894966    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-98jqh"]
Jul 21 17:08:52.896349 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.896331    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.896497 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.896401    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.896608 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.896404    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2bk7s\""
Jul 21 17:08:52.903714 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.903697    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4"]
Jul 21 17:08:52.904446 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.904411    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:52.907468 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.907440    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bn6n8\""
Jul 21 17:08:52.907750 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.907735    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 17:08:52.907989 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.907974    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 17:08:52.918829 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.918769    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8m7dl"]
Jul 21 17:08:52.919310 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.919275    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4"
Jul 21 17:08:52.923790 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.923773    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.924083 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.923891    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.924083 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.923934    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g644p\""
Jul 21 17:08:52.932477 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.932458    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-845cf5c4d4-jccm6"]
Jul 21 17:08:52.932573 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.932559    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8m7dl"
Jul 21 17:08:52.939753 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.939728    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 17:08:52.940648 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.940629    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jzcnj\""
Jul 21 17:08:52.941231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.941009    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.941830 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.941814    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.942557 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.942537    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"]
Jul 21 17:08:52.942653 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.942636    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:52.943110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943087    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8bea0c27-d9f7-4143-955b-7c983b87bb83-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:52.943224 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt7rq\" (UniqueName: \"kubernetes.io/projected/8bea0c27-d9f7-4143-955b-7c983b87bb83-kube-api-access-lt7rq\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:52.943325 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-trusted-ca\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.943325 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943262    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-bound-sa-token\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.943429 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:52.943429 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943358    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.943429 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-certificates\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.943429 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943399    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17c3db0e-96fd-4e65-981c-66e6a4084dbe-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:52.943429 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17c3db0e-96fd-4e65-981c-66e6a4084dbe-config\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:52.943647 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943506    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8d01263-b1fa-4a45-9057-8306bdc979bf-config\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:52.943647 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d01263-b1fa-4a45-9057-8306bdc979bf-serving-cert\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:52.943647 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-image-registry-private-configuration\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.943647 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-installation-pull-secrets\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.943869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bglnk\" (UniqueName: \"kubernetes.io/projected/17c3db0e-96fd-4e65-981c-66e6a4084dbe-kube-api-access-bglnk\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:52.943869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943712    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz6wm\" (UniqueName: \"kubernetes.io/projected/06f7649a-5707-4b5f-a85e-905eb0acc197-kube-api-access-bz6wm\") pod \"volume-data-source-validator-78cf4c6f6-plghv\" (UID: \"06f7649a-5707-4b5f-a85e-905eb0acc197\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv"
Jul 21 17:08:52.943869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8d01263-b1fa-4a45-9057-8306bdc979bf-trusted-ca\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:52.943869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943831    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v774m\" (UniqueName: \"kubernetes.io/projected/e8d01263-b1fa-4a45-9057-8306bdc979bf-kube-api-access-v774m\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:52.943869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943857    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/976ca309-8734-445b-8dfb-fcf6093f1bb5-ca-trust-extracted\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.944081 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.943893    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq2j8\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-kube-api-access-zq2j8\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:52.946311 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.946296    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qvtwz\""
Jul 21 17:08:52.946393 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.946371    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 17:08:52.946772 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.946754    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 17:08:52.946876 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.946837    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 17:08:52.946962 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.946944    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 17:08:52.947035 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.947019    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 17:08:52.947161 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.947143    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 17:08:52.954643 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.954625    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:52.954719 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.954626    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98jqh"]
Jul 21 17:08:52.954719 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.954689    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8m7dl"]
Jul 21 17:08:52.954719 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.954707    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"]
Jul 21 17:08:52.954828 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.954729    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4"]
Jul 21 17:08:52.954828 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.954748    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-845cf5c4d4-jccm6"]
Jul 21 17:08:52.958557 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.958535    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 21 17:08:52.958649 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.958578    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 21 17:08:52.958649 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:52.958621    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-96wcg\""
Jul 21 17:08:53.044847 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.044767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d01263-b1fa-4a45-9057-8306bdc979bf-serving-cert\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.044847 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.044809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/976ca309-8734-445b-8dfb-fcf6093f1bb5-ca-trust-extracted\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045045 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.044935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq2j8\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-kube-api-access-zq2j8\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045045 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.044979    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz6wm\" (UniqueName: \"kubernetes.io/projected/06f7649a-5707-4b5f-a85e-905eb0acc197-kube-api-access-bz6wm\") pod \"volume-data-source-validator-78cf4c6f6-plghv\" (UID: \"06f7649a-5707-4b5f-a85e-905eb0acc197\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv"
Jul 21 17:08:53.045145 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045114    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/976ca309-8734-445b-8dfb-fcf6093f1bb5-ca-trust-extracted\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045145 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045117    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045246 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17c3db0e-96fd-4e65-981c-66e6a4084dbe-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:53.045246 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.045187    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 17:08:53.045246 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045194    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-certificates\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045246 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.045205    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dc474dd6-jtqwk: secret "image-registry-tls" not found
Jul 21 17:08:53.045246 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045228    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bglnk\" (UniqueName: \"kubernetes.io/projected/17c3db0e-96fd-4e65-981c-66e6a4084dbe-kube-api-access-bglnk\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:53.045461 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.045258    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls podName:976ca309-8734-445b-8dfb-fcf6093f1bb5 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:53.545238469 +0000 UTC m=+36.090554672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls") pod "image-registry-6dc474dd6-jtqwk" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5") : secret "image-registry-tls" not found
Jul 21 17:08:53.045461 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-snapshots\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.045461 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-service-ca-bundle\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.045461 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8d01263-b1fa-4a45-9057-8306bdc979bf-trusted-ca\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.045672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v774m\" (UniqueName: \"kubernetes.io/projected/e8d01263-b1fa-4a45-9057-8306bdc979bf-kube-api-access-v774m\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.045672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chw92\" (UniqueName: \"kubernetes.io/projected/daeffe2d-d9fd-4f61-98f9-7f411b327865-kube-api-access-chw92\") pod \"network-check-source-7bc5b6bf85-nq8l4\" (UID: \"daeffe2d-d9fd-4f61-98f9-7f411b327865\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4"
Jul 21 17:08:53.045672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jshg\" (UniqueName: \"kubernetes.io/projected/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-kube-api-access-4jshg\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:53.045672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.045672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045571    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6955\" (UniqueName: \"kubernetes.io/projected/d2e057ac-8523-4d53-9cb8-ed807e1e5194-kube-api-access-w6955\") pod \"ingress-canary-8m7dl\" (UID: \"d2e057ac-8523-4d53-9cb8-ed807e1e5194\") " pod="openshift-ingress-canary/ingress-canary-8m7dl"
Jul 21 17:08:53.045672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.045672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lwlh\" (UniqueName: \"kubernetes.io/projected/def9337f-f934-459d-8b37-48fefebb839b-kube-api-access-6lwlh\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-image-registry-private-configuration\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045734    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-certificates\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8bea0c27-d9f7-4143-955b-7c983b87bb83-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045816    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt7rq\" (UniqueName: \"kubernetes.io/projected/8bea0c27-d9f7-4143-955b-7c983b87bb83-kube-api-access-lt7rq\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045848    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-trusted-ca\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-bound-sa-token\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045929    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62zzd\" (UniqueName: \"kubernetes.io/projected/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-kube-api-access-62zzd\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.045994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.045955    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8d01263-b1fa-4a45-9057-8306bdc979bf-config\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.046404 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046006    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.046404 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.046404 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046053    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.046404 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:53.046404 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17c3db0e-96fd-4e65-981c-66e6a4084dbe-config\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:53.046680 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.046435    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 17:08:53.046680 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.046479    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls podName:8bea0c27-d9f7-4143-955b-7c983b87bb83 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:53.546465798 +0000 UTC m=+36.091782005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-98dq9" (UID: "8bea0c27-d9f7-4143-955b-7c983b87bb83") : secret "cluster-monitoring-operator-tls" not found
Jul 21 17:08:53.046680 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:53.046680 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046566    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8d01263-b1fa-4a45-9057-8306bdc979bf-trusted-ca\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.046680 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046569    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:53.046680 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-serving-cert\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.046680 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8d01263-b1fa-4a45-9057-8306bdc979bf-config\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.046680 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046703    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-default-certificate\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046746    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7dw8\" (UniqueName: \"kubernetes.io/projected/5b27e994-0051-495a-b48a-5120b8015a64-kube-api-access-q7dw8\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046778    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e057ac-8523-4d53-9cb8-ed807e1e5194-cert\") pod \"ingress-canary-8m7dl\" (UID: \"d2e057ac-8523-4d53-9cb8-ed807e1e5194\") " pod="openshift-ingress-canary/ingress-canary-8m7dl"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-installation-pull-secrets\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-tmp\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b27e994-0051-495a-b48a-5120b8015a64-config-volume\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.046989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hkb9\" (UniqueName: \"kubernetes.io/projected/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-kube-api-access-7hkb9\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.047010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b27e994-0051-495a-b48a-5120b8015a64-tmp-dir\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.047034    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-stats-auth\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.047113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.047054    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:53.047527 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.047380    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-trusted-ca\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.047527 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.047464    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8bea0c27-d9f7-4143-955b-7c983b87bb83-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:53.047527 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.047516    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17c3db0e-96fd-4e65-981c-66e6a4084dbe-config\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:53.049841 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.049813    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17c3db0e-96fd-4e65-981c-66e6a4084dbe-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:53.049935 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.049869    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d01263-b1fa-4a45-9057-8306bdc979bf-serving-cert\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.049935 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.049905    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-installation-pull-secrets\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.049935 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.049916    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-image-registry-private-configuration\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.055482 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.055457    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq2j8\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-kube-api-access-zq2j8\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.055612 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.055599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:08:53.058247 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.058224    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bczc\""
Jul 21 17:08:53.060644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.059915    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v774m\" (UniqueName: \"kubernetes.io/projected/e8d01263-b1fa-4a45-9057-8306bdc979bf-kube-api-access-v774m\") pod \"console-operator-565b7b569d-q6qqz\" (UID: \"e8d01263-b1fa-4a45-9057-8306bdc979bf\") " pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.061485 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.061465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bglnk\" (UniqueName: \"kubernetes.io/projected/17c3db0e-96fd-4e65-981c-66e6a4084dbe-kube-api-access-bglnk\") pod \"service-ca-operator-5bcbc94c78-9w22x\" (UID: \"17c3db0e-96fd-4e65-981c-66e6a4084dbe\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:53.061953 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.061933    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-bound-sa-token\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.062041 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.062025    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz6wm\" (UniqueName: \"kubernetes.io/projected/06f7649a-5707-4b5f-a85e-905eb0acc197-kube-api-access-bz6wm\") pod \"volume-data-source-validator-78cf4c6f6-plghv\" (UID: \"06f7649a-5707-4b5f-a85e-905eb0acc197\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv"
Jul 21 17:08:53.062077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.062042    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt7rq\" (UniqueName: \"kubernetes.io/projected/8bea0c27-d9f7-4143-955b-7c983b87bb83-kube-api-access-lt7rq\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:53.147902 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.147869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.148039 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.147908    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62zzd\" (UniqueName: \"kubernetes.io/projected/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-kube-api-access-62zzd\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.148039 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.147943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.148039 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.147963    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.148039 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.147981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.148230 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.148094    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 17:08:53.148230 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:53.148230 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.148148    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:53.648130034 +0000 UTC m=+36.193446230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : secret "router-metrics-certs-default" not found
Jul 21 17:08:53.148230 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148181    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:53.148230 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148211    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-serving-cert\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.148230 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-default-certificate\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7dw8\" (UniqueName: \"kubernetes.io/projected/5b27e994-0051-495a-b48a-5120b8015a64-kube-api-access-q7dw8\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e057ac-8523-4d53-9cb8-ed807e1e5194-cert\") pod \"ingress-canary-8m7dl\" (UID: \"d2e057ac-8523-4d53-9cb8-ed807e1e5194\") " pod="openshift-ingress-canary/ingress-canary-8m7dl"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.148310    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148330    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-tmp\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.148368    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert podName:dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:53.64835009 +0000 UTC m=+36.193666296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nqshv" (UID: "dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386") : secret "networking-console-plugin-cert" not found
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148403    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b27e994-0051-495a-b48a-5120b8015a64-config-volume\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148459    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hkb9\" (UniqueName: \"kubernetes.io/projected/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-kube-api-access-7hkb9\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148485    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b27e994-0051-495a-b48a-5120b8015a64-tmp-dir\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148515    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-stats-auth\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148541    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:53.148587 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148581    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148603    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-snapshots\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148644    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-service-ca-bundle\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148665    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-tmp\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148676    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw92\" (UniqueName: \"kubernetes.io/projected/daeffe2d-d9fd-4f61-98f9-7f411b327865-kube-api-access-chw92\") pod \"network-check-source-7bc5b6bf85-nq8l4\" (UID: \"daeffe2d-d9fd-4f61-98f9-7f411b327865\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jshg\" (UniqueName: \"kubernetes.io/projected/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-kube-api-access-4jshg\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6955\" (UniqueName: \"kubernetes.io/projected/d2e057ac-8523-4d53-9cb8-ed807e1e5194-kube-api-access-w6955\") pod \"ingress-canary-8m7dl\" (UID: \"d2e057ac-8523-4d53-9cb8-ed807e1e5194\") " pod="openshift-ingress-canary/ingress-canary-8m7dl"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lwlh\" (UniqueName: \"kubernetes.io/projected/def9337f-f934-459d-8b37-48fefebb839b-kube-api-access-6lwlh\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148886    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.149090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.148918    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.149135    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-snapshots\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.149194    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.149254    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls podName:5b27e994-0051-495a-b48a-5120b8015a64 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:53.649238115 +0000 UTC m=+36.194554323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls") pod "dns-default-98jqh" (UID: "5b27e994-0051-495a-b48a-5120b8015a64") : secret "dns-default-metrics-tls" not found
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.149386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b27e994-0051-495a-b48a-5120b8015a64-tmp-dir\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.149427    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-service-ca-bundle\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.149497    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b27e994-0051-495a-b48a-5120b8015a64-config-volume\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.149505    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:53.649491935 +0000 UTC m=+36.194808163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : configmap references non-existent config key: service-ca.crt
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.149706    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 17:08:53.149755 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.149761    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls podName:94f27f4c-7f35-403b-8775-a0d1b06ebe1f nodeName:}" failed. No retries permitted until 2026-07-21 17:08:53.649747871 +0000 UTC m=+36.195064085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fqgs6" (UID: "94f27f4c-7f35-403b-8775-a0d1b06ebe1f") : secret "samples-operator-tls" not found
Jul 21 17:08:53.150660 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.150630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.151087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.151020    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-default-certificate\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.151868 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.151846    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-stats-auth\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.151933 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.151867    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-serving-cert\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.152133 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.152115    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e057ac-8523-4d53-9cb8-ed807e1e5194-cert\") pod \"ingress-canary-8m7dl\" (UID: \"d2e057ac-8523-4d53-9cb8-ed807e1e5194\") " pod="openshift-ingress-canary/ingress-canary-8m7dl"
Jul 21 17:08:53.159452 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.159404    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62zzd\" (UniqueName: \"kubernetes.io/projected/ec1c3e14-09d1-45aa-9a91-617d9ed3a976-kube-api-access-62zzd\") pod \"kube-storage-version-migrator-operator-7658d9b749-h8zcm\" (UID: \"ec1c3e14-09d1-45aa-9a91-617d9ed3a976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.160147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.160127    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7dw8\" (UniqueName: \"kubernetes.io/projected/5b27e994-0051-495a-b48a-5120b8015a64-kube-api-access-q7dw8\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.160907 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.160882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hkb9\" (UniqueName: \"kubernetes.io/projected/5d8a8927-d3b5-41f8-8007-bf6a84be1b2b-kube-api-access-7hkb9\") pod \"insights-operator-555d9d7885-xjsbs\" (UID: \"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b\") " pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.160986 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.160893    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lwlh\" (UniqueName: \"kubernetes.io/projected/def9337f-f934-459d-8b37-48fefebb839b-kube-api-access-6lwlh\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.161046 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.161030    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6955\" (UniqueName: \"kubernetes.io/projected/d2e057ac-8523-4d53-9cb8-ed807e1e5194-kube-api-access-w6955\") pod \"ingress-canary-8m7dl\" (UID: \"d2e057ac-8523-4d53-9cb8-ed807e1e5194\") " pod="openshift-ingress-canary/ingress-canary-8m7dl"
Jul 21 17:08:53.161110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.161090    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chw92\" (UniqueName: \"kubernetes.io/projected/daeffe2d-d9fd-4f61-98f9-7f411b327865-kube-api-access-chw92\") pod \"network-check-source-7bc5b6bf85-nq8l4\" (UID: \"daeffe2d-d9fd-4f61-98f9-7f411b327865\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4"
Jul 21 17:08:53.161167 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.161154    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jshg\" (UniqueName: \"kubernetes.io/projected/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-kube-api-access-4jshg\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:53.161705 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.161687    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"
Jul 21 17:08:53.171207 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.171190    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv"
Jul 21 17:08:53.189423 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.189399    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b83efff-645b-49a3-a4de-1097a9f5594b" containerID="b0ed971ac09f72d9f3491ae5c58f0d9761d5a1d15e5421f9108f9b9e8365159e" exitCode=0
Jul 21 17:08:53.189525 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.189453    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerDied","Data":"b0ed971ac09f72d9f3491ae5c58f0d9761d5a1d15e5421f9108f9b9e8365159e"}
Jul 21 17:08:53.194701 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.194687    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:08:53.212069 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.212047    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xjsbs"
Jul 21 17:08:53.223140 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.223118    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"
Jul 21 17:08:53.260673 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.260645    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4"
Jul 21 17:08:53.288366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.288202    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8m7dl"
Jul 21 17:08:53.382502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.380109    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:53.404051 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.403778    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x"]
Jul 21 17:08:53.415548 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.415474    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv"]
Jul 21 17:08:53.455112 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.455084    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-q6qqz"]
Jul 21 17:08:53.479332 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.479233    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:53.495101 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.495073    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm"]
Jul 21 17:08:53.514033 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.514009    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xjsbs"]
Jul 21 17:08:53.517642 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.517623    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8m7dl"]
Jul 21 17:08:53.525386 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.525367    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4"]
Jul 21 17:08:53.528639 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:53.528611    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1c3e14_09d1_45aa_9a91_617d9ed3a976.slice/crio-a1dca523bf64c8acc150bbef4ba111829332b9234ad5b2b1ce5066b648323ee5 WatchSource:0}: Error finding container a1dca523bf64c8acc150bbef4ba111829332b9234ad5b2b1ce5066b648323ee5: Status 404 returned error can't find the container with id a1dca523bf64c8acc150bbef4ba111829332b9234ad5b2b1ce5066b648323ee5
Jul 21 17:08:53.529261 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:53.529238    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e057ac_8523_4d53_9cb8_ed807e1e5194.slice/crio-34edc98be19776ef2c660ca2634badf5776742b9b901ddd5772cb01f1c217c62 WatchSource:0}: Error finding container 34edc98be19776ef2c660ca2634badf5776742b9b901ddd5772cb01f1c217c62: Status 404 returned error can't find the container with id 34edc98be19776ef2c660ca2634badf5776742b9b901ddd5772cb01f1c217c62
Jul 21 17:08:53.529956 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:53.529936    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8a8927_d3b5_41f8_8007_bf6a84be1b2b.slice/crio-fc16b1c68e5f19fd4a7133fa69149d1bc25f4909f61d3db2abc77854a294a76c WatchSource:0}: Error finding container fc16b1c68e5f19fd4a7133fa69149d1bc25f4909f61d3db2abc77854a294a76c: Status 404 returned error can't find the container with id fc16b1c68e5f19fd4a7133fa69149d1bc25f4909f61d3db2abc77854a294a76c
Jul 21 17:08:53.531136 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:53.531115    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaeffe2d_d9fd_4f61_98f9_7f411b327865.slice/crio-aa8e77ea3076c8760603de1541a13651f817d93e1d8652c4353007c4cd896dd2 WatchSource:0}: Error finding container aa8e77ea3076c8760603de1541a13651f817d93e1d8652c4353007c4cd896dd2: Status 404 returned error can't find the container with id aa8e77ea3076c8760603de1541a13651f817d93e1d8652c4353007c4cd896dd2
Jul 21 17:08:53.532898 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:53.532147    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f7649a_5707_4b5f_a85e_905eb0acc197.slice/crio-101a08a0a946a76cad7259078622b68c4b868f10756290fe1b1a7924565ceb8e WatchSource:0}: Error finding container 101a08a0a946a76cad7259078622b68c4b868f10756290fe1b1a7924565ceb8e: Status 404 returned error can't find the container with id 101a08a0a946a76cad7259078622b68c4b868f10756290fe1b1a7924565ceb8e
Jul 21 17:08:53.533141 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:53.532908    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d01263_b1fa_4a45_9057_8306bdc979bf.slice/crio-a508d805313e7a261708e045f74dafce5a8c98de882193f887bea5b661222d90 WatchSource:0}: Error finding container a508d805313e7a261708e045f74dafce5a8c98de882193f887bea5b661222d90: Status 404 returned error can't find the container with id a508d805313e7a261708e045f74dafce5a8c98de882193f887bea5b661222d90
Jul 21 17:08:53.533904 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:08:53.533770    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c3db0e_96fd_4e65_981c_66e6a4084dbe.slice/crio-310ec5ef498d0b537c0d2966f03271e2b3702955070304623e2be35a91cbbd7b WatchSource:0}: Error finding container 310ec5ef498d0b537c0d2966f03271e2b3702955070304623e2be35a91cbbd7b: Status 404 returned error can't find the container with id 310ec5ef498d0b537c0d2966f03271e2b3702955070304623e2be35a91cbbd7b
Jul 21 17:08:53.553556 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.553470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:53.553677 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.553583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:53.553677 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.553607    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 17:08:53.553677 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.553637    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dc474dd6-jtqwk: secret "image-registry-tls" not found
Jul 21 17:08:53.553808 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.553680    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls podName:976ca309-8734-445b-8dfb-fcf6093f1bb5 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:54.553667894 +0000 UTC m=+37.098984087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls") pod "image-registry-6dc474dd6-jtqwk" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5") : secret "image-registry-tls" not found
Jul 21 17:08:53.553808 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.553736    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 17:08:53.553808 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.553783    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls podName:8bea0c27-d9f7-4143-955b-7c983b87bb83 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:54.553769977 +0000 UTC m=+37.099086190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-98dq9" (UID: "8bea0c27-d9f7-4143-955b-7c983b87bb83") : secret "cluster-monitoring-operator-tls" not found
Jul 21 17:08:53.654286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.654251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.654451 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.654307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:53.654451 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.654343    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:53.654451 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.654373    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:53.654451 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:53.654390    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:53.654451 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654393    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 17:08:53.654702 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654459    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 17:08:53.654702 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654466    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 17:08:53.654702 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654481    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:08:53.654702 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654475    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:54.654455719 +0000 UTC m=+37.199771928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : secret "router-metrics-certs-default" not found
Jul 21 17:08:53.654702 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654549    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:54.654526773 +0000 UTC m=+37.199842980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : configmap references non-existent config key: service-ca.crt
Jul 21 17:08:53.654702 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654568    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls podName:94f27f4c-7f35-403b-8775-a0d1b06ebe1f nodeName:}" failed. No retries permitted until 2026-07-21 17:08:54.654557314 +0000 UTC m=+37.199873514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fqgs6" (UID: "94f27f4c-7f35-403b-8775-a0d1b06ebe1f") : secret "samples-operator-tls" not found
Jul 21 17:08:53.654702 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654590    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert podName:dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:54.654580926 +0000 UTC m=+37.199897124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nqshv" (UID: "dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386") : secret "networking-console-plugin-cert" not found
Jul 21 17:08:53.654702 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:53.654611    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls podName:5b27e994-0051-495a-b48a-5120b8015a64 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:54.654602959 +0000 UTC m=+37.199919157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls") pod "dns-default-98jqh" (UID: "5b27e994-0051-495a-b48a-5120b8015a64") : secret "dns-default-metrics-tls" not found
Jul 21 17:08:54.055904 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.055874    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:08:54.056051 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.055874    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:08:54.061258 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.059338    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk959\""
Jul 21 17:08:54.061258 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.059385    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 17:08:54.061258 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.059569    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 17:08:54.195503 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.195434    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8m7dl" event={"ID":"d2e057ac-8523-4d53-9cb8-ed807e1e5194","Type":"ContainerStarted","Data":"34edc98be19776ef2c660ca2634badf5776742b9b901ddd5772cb01f1c217c62"}
Jul 21 17:08:54.197001 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.196969    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4" event={"ID":"daeffe2d-d9fd-4f61-98f9-7f411b327865","Type":"ContainerStarted","Data":"aa8e77ea3076c8760603de1541a13651f817d93e1d8652c4353007c4cd896dd2"}
Jul 21 17:08:54.198480 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.198429    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xjsbs" event={"ID":"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b","Type":"ContainerStarted","Data":"fc16b1c68e5f19fd4a7133fa69149d1bc25f4909f61d3db2abc77854a294a76c"}
Jul 21 17:08:54.199914 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.199885    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv" event={"ID":"06f7649a-5707-4b5f-a85e-905eb0acc197","Type":"ContainerStarted","Data":"101a08a0a946a76cad7259078622b68c4b868f10756290fe1b1a7924565ceb8e"}
Jul 21 17:08:54.205072 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.205047    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b83efff-645b-49a3-a4de-1097a9f5594b" containerID="24208d0b90cb1c4383231a2f838457719b9898569224eb1d6c4202fdd6a528bb" exitCode=0
Jul 21 17:08:54.205178 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.205118    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerDied","Data":"24208d0b90cb1c4383231a2f838457719b9898569224eb1d6c4202fdd6a528bb"}
Jul 21 17:08:54.207482 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.207430    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x" event={"ID":"17c3db0e-96fd-4e65-981c-66e6a4084dbe","Type":"ContainerStarted","Data":"310ec5ef498d0b537c0d2966f03271e2b3702955070304623e2be35a91cbbd7b"}
Jul 21 17:08:54.208663 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.208637    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm" event={"ID":"ec1c3e14-09d1-45aa-9a91-617d9ed3a976","Type":"ContainerStarted","Data":"a1dca523bf64c8acc150bbef4ba111829332b9234ad5b2b1ce5066b648323ee5"}
Jul 21 17:08:54.212079 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.212025    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" event={"ID":"e8d01263-b1fa-4a45-9057-8306bdc979bf","Type":"ContainerStarted","Data":"a508d805313e7a261708e045f74dafce5a8c98de882193f887bea5b661222d90"}
Jul 21 17:08:54.563813 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.562909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:54.563813 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.563049    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:54.563813 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.563248    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 17:08:54.563813 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.563262    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dc474dd6-jtqwk: secret "image-registry-tls" not found
Jul 21 17:08:54.563813 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.563317    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls podName:976ca309-8734-445b-8dfb-fcf6093f1bb5 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:56.563298806 +0000 UTC m=+39.108615014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls") pod "image-registry-6dc474dd6-jtqwk" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5") : secret "image-registry-tls" not found
Jul 21 17:08:54.563813 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.563700    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 17:08:54.563813 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.563753    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls podName:8bea0c27-d9f7-4143-955b-7c983b87bb83 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:56.563738603 +0000 UTC m=+39.109054809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-98dq9" (UID: "8bea0c27-d9f7-4143-955b-7c983b87bb83") : secret "cluster-monitoring-operator-tls" not found
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.663656    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.663704    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.663764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.663838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:54.663901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664028    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664109    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls podName:94f27f4c-7f35-403b-8775-a0d1b06ebe1f nodeName:}" failed. No retries permitted until 2026-07-21 17:08:56.664087135 +0000 UTC m=+39.209403334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fqgs6" (UID: "94f27f4c-7f35-403b-8775-a0d1b06ebe1f") : secret "samples-operator-tls" not found
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664524    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664573    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls podName:5b27e994-0051-495a-b48a-5120b8015a64 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:56.664558069 +0000 UTC m=+39.209874274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls") pod "dns-default-98jqh" (UID: "5b27e994-0051-495a-b48a-5120b8015a64") : secret "dns-default-metrics-tls" not found
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664644    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:56.664631609 +0000 UTC m=+39.209947806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : configmap references non-existent config key: service-ca.crt
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664703    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664733    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:08:56.664723581 +0000 UTC m=+39.210039986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : secret "router-metrics-certs-default" not found
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664788    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 17:08:54.664922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:54.664841    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert podName:dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:56.66482906 +0000 UTC m=+39.210145257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nqshv" (UID: "dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386") : secret "networking-console-plugin-cert" not found
Jul 21 17:08:55.225883 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:55.225201    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgr88" event={"ID":"3b83efff-645b-49a3-a4de-1097a9f5594b","Type":"ContainerStarted","Data":"26c6f94cda1a5ed9677865c1a1509d413787d33f9dae43d137473e33a1e9f9d1"}
Jul 21 17:08:55.255466 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:55.255032    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rgr88" podStartSLOduration=11.492973572 podStartE2EDuration="37.254998408s" totalImagesPullingTime="25.762024836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:55.25339123 +0000 UTC m=+37.798707449" watchObservedRunningTime="2026-07-21 17:08:55.254998408 +0000 UTC m=+37.800314623"
Jul 21 17:08:55.390205 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:55.390099    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:55.577596 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:55.577523    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:56.230274 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.230041    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv" event={"ID":"06f7649a-5707-4b5f-a85e-905eb0acc197","Type":"ContainerStarted","Data":"0464747bff42502ef649f2e22497a87611c769a1aea1f65b717c34049b4cfb3e"}
Jul 21 17:08:56.247685 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.247627    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-plghv" podStartSLOduration=30.281782882999998 podStartE2EDuration="32.247607277s" totalImagesPullingTime="1.965824394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:56.247024217 +0000 UTC m=+38.792340432" watchObservedRunningTime="2026-07-21 17:08:56.247607277 +0000 UTC m=+38.792923493"
Jul 21 17:08:56.343442 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.343399    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:56.416454 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.416303    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:56.585055 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.585010    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:08:56.585224 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.585142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:08:56.585306 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.585253    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 17:08:56.585306 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.585293    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 17:08:56.585306 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.585307    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dc474dd6-jtqwk: secret "image-registry-tls" not found
Jul 21 17:08:56.585451 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.585336    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls podName:8bea0c27-d9f7-4143-955b-7c983b87bb83 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:00.585314445 +0000 UTC m=+43.130630664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-98dq9" (UID: "8bea0c27-d9f7-4143-955b-7c983b87bb83") : secret "cluster-monitoring-operator-tls" not found
Jul 21 17:08:56.585451 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.585377    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls podName:976ca309-8734-445b-8dfb-fcf6093f1bb5 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:00.585346221 +0000 UTC m=+43.130662435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls") pod "image-registry-6dc474dd6-jtqwk" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5") : secret "image-registry-tls" not found
Jul 21 17:08:56.686121 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.686086    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:08:56.686292 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.686137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:56.686292 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.686203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:08:56.686292 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.686260    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:08:56.686292 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686275    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:08:56.686318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686338    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls podName:5b27e994-0051-495a-b48a-5120b8015a64 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:00.686318204 +0000 UTC m=+43.231634413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls") pod "dns-default-98jqh" (UID: "5b27e994-0051-495a-b48a-5120b8015a64") : secret "dns-default-metrics-tls" not found
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686368    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:09:00.686353724 +0000 UTC m=+43.231669920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : configmap references non-existent config key: service-ca.crt
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686387    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686411    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686423    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686424    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls podName:94f27f4c-7f35-403b-8775-a0d1b06ebe1f nodeName:}" failed. No retries permitted until 2026-07-21 17:09:00.686414254 +0000 UTC m=+43.231730466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fqgs6" (UID: "94f27f4c-7f35-403b-8775-a0d1b06ebe1f") : secret "samples-operator-tls" not found
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686475    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:09:00.686460318 +0000 UTC m=+43.231776517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : secret "router-metrics-certs-default" not found
Jul 21 17:08:56.686487 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:08:56.686490    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert podName:dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:00.686481 +0000 UTC m=+43.231797199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nqshv" (UID: "dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386") : secret "networking-console-plugin-cert" not found
Jul 21 17:09:00.373086 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.373042    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:00.445923 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.445887    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:00.525317 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.525283    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:00.625629 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.625546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:09:00.625826 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.625656    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:09:00.625826 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.625705    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 17:09:00.625826 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.625771    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 17:09:00.625826 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.625783    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dc474dd6-jtqwk: secret "image-registry-tls" not found
Jul 21 17:09:00.625826 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.625773    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls podName:8bea0c27-d9f7-4143-955b-7c983b87bb83 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:08.625757147 +0000 UTC m=+51.171073364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-98dq9" (UID: "8bea0c27-d9f7-4143-955b-7c983b87bb83") : secret "cluster-monitoring-operator-tls" not found
Jul 21 17:09:00.625993 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.625847    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls podName:976ca309-8734-445b-8dfb-fcf6093f1bb5 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:08.625829448 +0000 UTC m=+51.171145648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls") pod "image-registry-6dc474dd6-jtqwk" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5") : secret "image-registry-tls" not found
Jul 21 17:09:00.726815 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.726770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:09:00.727025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.726849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:09:00.727025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.726867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:00.727025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.726904    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:00.727025 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.726927    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 17:09:00.727025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.726939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:09:00.727025 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.726990    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:09:00.727025 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.727013    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 17:09:00.727025 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.726997    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls podName:94f27f4c-7f35-403b-8775-a0d1b06ebe1f nodeName:}" failed. No retries permitted until 2026-07-21 17:09:08.726978258 +0000 UTC m=+51.272294467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fqgs6" (UID: "94f27f4c-7f35-403b-8775-a0d1b06ebe1f") : secret "samples-operator-tls" not found
Jul 21 17:09:00.727345 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.727044    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:09:08.727030841 +0000 UTC m=+51.272347038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : configmap references non-existent config key: service-ca.crt
Jul 21 17:09:00.727345 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.727050    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 17:09:00.727345 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.727060    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls podName:5b27e994-0051-495a-b48a-5120b8015a64 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:08.727050196 +0000 UTC m=+51.272366392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls") pod "dns-default-98jqh" (UID: "5b27e994-0051-495a-b48a-5120b8015a64") : secret "dns-default-metrics-tls" not found
Jul 21 17:09:00.727345 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.727135    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert podName:dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:08.727118978 +0000 UTC m=+51.272435172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nqshv" (UID: "dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386") : secret "networking-console-plugin-cert" not found
Jul 21 17:09:00.727345 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:00.727159    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:09:08.727148465 +0000 UTC m=+51.272464665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : secret "router-metrics-certs-default" not found
Jul 21 17:09:00.749834 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.749810    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:00.851055 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:00.850971    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:01.247944 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:01.247909    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xjsbs" event={"ID":"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b","Type":"ContainerStarted","Data":"93528f8cd1e6dab5a96b2f8e375ef146470d39527bfad82b2e3b30599e91ccda"}
Jul 21 17:09:01.249837 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:01.249776    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm" event={"ID":"ec1c3e14-09d1-45aa-9a91-617d9ed3a976","Type":"ContainerStarted","Data":"012632b8f8bd9cdd4761aba57bc16aae703d8a4fe847115c63bbcb4ae1ac4059"}
Jul 21 17:09:01.277237 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:01.276994    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-xjsbs" podStartSLOduration=29.74216026 podStartE2EDuration="37.276974496s" totalImagesPullingTime="7.534814236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:01.27448428 +0000 UTC m=+43.819800497" watchObservedRunningTime="2026-07-21 17:09:01.276974496 +0000 UTC m=+43.822290713"
Jul 21 17:09:01.292941 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:01.292887    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm" podStartSLOduration=29.757098128 podStartE2EDuration="37.292873724s" totalImagesPullingTime="7.535775596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:01.292170856 +0000 UTC m=+43.837487072" watchObservedRunningTime="2026-07-21 17:09:01.292873724 +0000 UTC m=+43.838189918"
Jul 21 17:09:01.977766 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:01.977685    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:02.078127 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.078095    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:02.180006 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.179969    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:02.256866 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.256774    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x" event={"ID":"17c3db0e-96fd-4e65-981c-66e6a4084dbe","Type":"ContainerStarted","Data":"27cbf386ecf76567839ab432b0b0d08f4703b4700ac3e11b8c408fc54172c145"}
Jul 21 17:09:02.258614 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.258587    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/0.log"
Jul 21 17:09:02.258744 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.258630    2557 generic.go:356] "Generic (PLEG): container finished" podID="e8d01263-b1fa-4a45-9057-8306bdc979bf" containerID="42cc390ce7ae724fc06fed3225aee69617a20d55bcbdc2eee36479088692f5f6" exitCode=255
Jul 21 17:09:02.258744 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.258677    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" event={"ID":"e8d01263-b1fa-4a45-9057-8306bdc979bf","Type":"ContainerDied","Data":"42cc390ce7ae724fc06fed3225aee69617a20d55bcbdc2eee36479088692f5f6"}
Jul 21 17:09:02.258946 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.258928    2557 scope.go:117] "RemoveContainer" containerID="42cc390ce7ae724fc06fed3225aee69617a20d55bcbdc2eee36479088692f5f6"
Jul 21 17:09:02.260350 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.260327    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8m7dl" event={"ID":"d2e057ac-8523-4d53-9cb8-ed807e1e5194","Type":"ContainerStarted","Data":"fba4d37206361607ced3c2d1438bcc2ce1e2500fa642e06275da9f43c9f6d64e"}
Jul 21 17:09:02.262294 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.262272    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4" event={"ID":"daeffe2d-d9fd-4f61-98f9-7f411b327865","Type":"ContainerStarted","Data":"57570b5b166889e286abfd32552eebd0af94011c3bba2b821edaa02c4e2bb847"}
Jul 21 17:09:02.283632 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.283584    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x" podStartSLOduration=30.750927169 podStartE2EDuration="38.283566692s" totalImagesPullingTime="7.532639523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:02.283045781 +0000 UTC m=+44.828361997" watchObservedRunningTime="2026-07-21 17:09:02.283566692 +0000 UTC m=+44.828882908"
Jul 21 17:09:02.339846 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.339769    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nq8l4" podStartSLOduration=30.793013958 podStartE2EDuration="38.339746739s" totalImagesPullingTime="7.546732781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:02.338927133 +0000 UTC m=+44.884243348" watchObservedRunningTime="2026-07-21 17:09:02.339746739 +0000 UTC m=+44.885062955"
Jul 21 17:09:02.369615 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.369565    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8m7dl" podStartSLOduration=2.833764556 podStartE2EDuration="10.369549095s" totalImagesPullingTime="7.535784539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:02.369286609 +0000 UTC m=+44.914602826" watchObservedRunningTime="2026-07-21 17:09:02.369549095 +0000 UTC m=+44.914865331"
Jul 21 17:09:02.747315 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.747271    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:02.847971 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:02.847930    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:03.111426 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.111385    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:03.112023 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.112004    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mpphq"]
Jul 21 17:09:03.133527 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.133501    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.140588 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.140544    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 17:09:03.140814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.140766    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t495x\""
Jul 21 17:09:03.141746 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.141726    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 17:09:03.143018 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.142999    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mpphq"]
Jul 21 17:09:03.195524 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.195490    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:09:03.195678 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.195544    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:09:03.223249 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.223218    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:03.250874 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.250847    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.251011 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.250904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89f1fd8f-7f73-4f5d-9a77-649051dca787-crio-socket\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.251068 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.251003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84s8s\" (UniqueName: \"kubernetes.io/projected/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-api-access-84s8s\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.251101 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.251077    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89f1fd8f-7f73-4f5d-9a77-649051dca787-data-volume\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.251143 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.251101    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.267033 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.267013    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/1.log"
Jul 21 17:09:03.267451 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.267436    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/0.log"
Jul 21 17:09:03.267570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.267473    2557 generic.go:356] "Generic (PLEG): container finished" podID="e8d01263-b1fa-4a45-9057-8306bdc979bf" containerID="4e4e70c4562377956dee634e27889ef3e825a25c35fea8bb731ad4999bbbf7c0" exitCode=255
Jul 21 17:09:03.267570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.267504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" event={"ID":"e8d01263-b1fa-4a45-9057-8306bdc979bf","Type":"ContainerDied","Data":"4e4e70c4562377956dee634e27889ef3e825a25c35fea8bb731ad4999bbbf7c0"}
Jul 21 17:09:03.267674 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.267569    2557 scope.go:117] "RemoveContainer" containerID="42cc390ce7ae724fc06fed3225aee69617a20d55bcbdc2eee36479088692f5f6"
Jul 21 17:09:03.267759 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.267743    2557 scope.go:117] "RemoveContainer" containerID="4e4e70c4562377956dee634e27889ef3e825a25c35fea8bb731ad4999bbbf7c0"
Jul 21 17:09:03.267986 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.267941    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-q6qqz_openshift-console-operator(e8d01263-b1fa-4a45-9057-8306bdc979bf)\"" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" podUID="e8d01263-b1fa-4a45-9057-8306bdc979bf"
Jul 21 17:09:03.352140 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.352111    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89f1fd8f-7f73-4f5d-9a77-649051dca787-data-volume\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.352281 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.352147    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.352281 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.352188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.352281 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.352246    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89f1fd8f-7f73-4f5d-9a77-649051dca787-crio-socket\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.352463 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.352302    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:03.352463 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.352328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84s8s\" (UniqueName: \"kubernetes.io/projected/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-api-access-84s8s\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.352463 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.352339    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:03.352463 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.352375    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:03.852352862 +0000 UTC m=+46.397669087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:03.352463 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.352401    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:03.852392829 +0000 UTC m=+46.397709030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:03.352672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.352481    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89f1fd8f-7f73-4f5d-9a77-649051dca787-data-volume\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.352672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.352543    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89f1fd8f-7f73-4f5d-9a77-649051dca787-crio-socket\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.380236 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.380173    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84s8s\" (UniqueName: \"kubernetes.io/projected/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-api-access-84s8s\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.505650 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.505618    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:03.608942 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.608909    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:03.856843 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.856793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.857038 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:03.856862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:03.857038 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.856883    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:03.857038 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.856956    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:04.856935673 +0000 UTC m=+47.402251885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:03.857038 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.857006    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:03.857189 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:03.857059    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:04.857047155 +0000 UTC m=+47.402363354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:04.272363 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:04.272339    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/1.log"
Jul 21 17:09:04.272722 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:04.272663    2557 scope.go:117] "RemoveContainer" containerID="4e4e70c4562377956dee634e27889ef3e825a25c35fea8bb731ad4999bbbf7c0"
Jul 21 17:09:04.272917 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:04.272897    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-q6qqz_openshift-console-operator(e8d01263-b1fa-4a45-9057-8306bdc979bf)\"" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" podUID="e8d01263-b1fa-4a45-9057-8306bdc979bf"
Jul 21 17:09:04.864581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:04.864547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:04.864752 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:04.864597    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:04.864752 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:04.864671    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:04.864752 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:04.864730    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:04.864752 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:04.864747    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:06.864730794 +0000 UTC m=+49.410046989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:04.864922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:04.864781    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:06.864770278 +0000 UTC m=+49.410086476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:05.086612 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:05.086574    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:05.182090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:05.182015    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:05.457460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:05.457377    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:05.532694 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:05.532665    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:05.854853 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:05.854829    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcjjl_a071c9e9-5ae5-4311-891e-c82a81a2c399/dns-node-resolver/0.log"
Jul 21 17:09:06.068611 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:06.068580    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:06.852575 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:06.852548    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q6ndw_246c4c15-60a5-4442-bb07-779b13563b24/node-ca/0.log"
Jul 21 17:09:06.881614 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:06.881585    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:06.881741 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:06.881628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:06.881741 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:06.881707    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:06.881823 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:06.881741    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:06.881823 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:06.881765    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:10.88175006 +0000 UTC m=+53.427066254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:06.881823 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:06.881784    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:10.881772492 +0000 UTC m=+53.427088685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:07.452665 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:07.452630    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8m7dl_d2e057ac-8523-4d53-9cb8-ed807e1e5194/serve-healthcheck-canary/0.log"
Jul 21 17:09:08.454928 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:08.454891    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-h8zcm_ec1c3e14-09d1-45aa-9a91-617d9ed3a976/kube-storage-version-migrator-operator/0.log"
Jul 21 17:09:08.697555 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:08.697513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:09:08.697731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:08.697637    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:09:08.697731 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.697661    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 17:09:08.697731 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.697678    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dc474dd6-jtqwk: secret "image-registry-tls" not found
Jul 21 17:09:08.697731 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.697728    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls podName:976ca309-8734-445b-8dfb-fcf6093f1bb5 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:24.697713437 +0000 UTC m=+67.243029631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls") pod "image-registry-6dc474dd6-jtqwk" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5") : secret "image-registry-tls" not found
Jul 21 17:09:08.697929 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.697819    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 17:09:08.697929 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.697885    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls podName:8bea0c27-d9f7-4143-955b-7c983b87bb83 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:24.697870261 +0000 UTC m=+67.243186476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-98dq9" (UID: "8bea0c27-d9f7-4143-955b-7c983b87bb83") : secret "cluster-monitoring-operator-tls" not found
Jul 21 17:09:08.798320 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:08.798289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:09:08.798498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:08.798360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:09:08.798498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:08.798412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:09:08.798498 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798429    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 17:09:08.798498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:08.798440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798494    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798507    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798500    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert podName:dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:24.798482486 +0000 UTC m=+67.343798714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nqshv" (UID: "dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386") : secret "networking-console-plugin-cert" not found
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798549    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls podName:5b27e994-0051-495a-b48a-5120b8015a64 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:24.798536345 +0000 UTC m=+67.343852539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls") pod "dns-default-98jqh" (UID: "5b27e994-0051-495a-b48a-5120b8015a64") : secret "dns-default-metrics-tls" not found
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:08.798568    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798614    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798619    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls podName:94f27f4c-7f35-403b-8775-a0d1b06ebe1f nodeName:}" failed. No retries permitted until 2026-07-21 17:09:24.798611107 +0000 UTC m=+67.343927301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fqgs6" (UID: "94f27f4c-7f35-403b-8775-a0d1b06ebe1f") : secret "samples-operator-tls" not found
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798633    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:09:24.798627861 +0000 UTC m=+67.343944055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : configmap references non-existent config key: service-ca.crt
Jul 21 17:09:08.798717 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:08.798652    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs podName:def9337f-f934-459d-8b37-48fefebb839b nodeName:}" failed. No retries permitted until 2026-07-21 17:09:24.798638847 +0000 UTC m=+67.343955050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs") pod "router-default-845cf5c4d4-jccm6" (UID: "def9337f-f934-459d-8b37-48fefebb839b") : secret "router-metrics-certs-default" not found
Jul 21 17:09:09.156334 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:09.156223    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:09.375176 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:09.375138    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:09.784920 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:09.784871    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:10.916719 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:10.916682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:10.917238 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:10.916731    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:10.917238 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:10.916830    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:10.917238 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:10.916878    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:10.917238 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:10.916945    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:18.916929975 +0000 UTC m=+61.462246181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:10.917238 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:10.916961    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:18.916955204 +0000 UTC m=+61.462271411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:12.192898 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:12.192864    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:12.872641 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:12.872604    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:13.068327 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.068288    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:13.195286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.195201    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:09:13.195286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.195251    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:09:13.195768 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.195696    2557 scope.go:117] "RemoveContainer" containerID="4e4e70c4562377956dee634e27889ef3e825a25c35fea8bb731ad4999bbbf7c0"
Jul 21 17:09:13.226321 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.226272    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:13.302149 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.302127    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/1.log"
Jul 21 17:09:13.302309 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.302187    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" event={"ID":"e8d01263-b1fa-4a45-9057-8306bdc979bf","Type":"ContainerStarted","Data":"166b1c8ff0fe8fa771288b89f56a205a23081aa9b1716bb7cb15533fba3a43be"}
Jul 21 17:09:13.302463 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.302440    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:09:13.303714 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.303692    2557 patch_prober.go:28] interesting pod/console-operator-565b7b569d-q6qqz container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body=
Jul 21 17:09:13.303814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.303731    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" podUID="e8d01263-b1fa-4a45-9057-8306bdc979bf" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused"
Jul 21 17:09:13.328120 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.328078    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" podStartSLOduration=41.794268275 podStartE2EDuration="49.328063625s" totalImagesPullingTime="7.53379535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:13.3266713 +0000 UTC m=+55.871987516" watchObservedRunningTime="2026-07-21 17:09:13.328063625 +0000 UTC m=+55.873379839"
Jul 21 17:09:13.461553 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.461475    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:13.622425 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.622391    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:13.888788 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.888751    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:13.986857 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:13.986826    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:14.200848 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.200749    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:14.306125 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.306100    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:09:14.306504 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.306491    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/1.log"
Jul 21 17:09:14.306584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.306523    2557 generic.go:356] "Generic (PLEG): container finished" podID="e8d01263-b1fa-4a45-9057-8306bdc979bf" containerID="166b1c8ff0fe8fa771288b89f56a205a23081aa9b1716bb7cb15533fba3a43be" exitCode=255
Jul 21 17:09:14.306584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.306550    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" event={"ID":"e8d01263-b1fa-4a45-9057-8306bdc979bf","Type":"ContainerDied","Data":"166b1c8ff0fe8fa771288b89f56a205a23081aa9b1716bb7cb15533fba3a43be"}
Jul 21 17:09:14.306682 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.306604    2557 scope.go:117] "RemoveContainer" containerID="4e4e70c4562377956dee634e27889ef3e825a25c35fea8bb731ad4999bbbf7c0"
Jul 21 17:09:14.306872 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.306858    2557 scope.go:117] "RemoveContainer" containerID="166b1c8ff0fe8fa771288b89f56a205a23081aa9b1716bb7cb15533fba3a43be"
Jul 21 17:09:14.307053 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:14.307036    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-q6qqz_openshift-console-operator(e8d01263-b1fa-4a45-9057-8306bdc979bf)\"" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" podUID="e8d01263-b1fa-4a45-9057-8306bdc979bf"
Jul 21 17:09:14.588601 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.588562    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:14.987786 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:14.987688    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:15.311128 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:15.311102    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:09:15.311475 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:15.311415    2557 scope.go:117] "RemoveContainer" containerID="166b1c8ff0fe8fa771288b89f56a205a23081aa9b1716bb7cb15533fba3a43be"
Jul 21 17:09:15.311588 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:15.311569    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-q6qqz_openshift-console-operator(e8d01263-b1fa-4a45-9057-8306bdc979bf)\"" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" podUID="e8d01263-b1fa-4a45-9057-8306bdc979bf"
Jul 21 17:09:15.597100 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:15.597012    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:16.050550 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:16.050509    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:16.168619 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:16.168577    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:16.368994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:16.368904    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:16.568034 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:16.567994    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:16.636505 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:16.636377    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:16.970780 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:16.970702    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:17.078241 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:17.078208    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:17.570625 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:17.570583    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:18.233264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:18.233223    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:18.345758 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:18.345729    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:18.447165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:18.447133    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:18.834737 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:18.834705    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:18.989237 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:18.989201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:18.989433 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:18.989348    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:18.989433 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:18.989389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:18.989433 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:18.989416    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls podName:89f1fd8f-7f73-4f5d-9a77-649051dca787 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:34.989400359 +0000 UTC m=+77.534716552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mpphq" (UID: "89f1fd8f-7f73-4f5d-9a77-649051dca787") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:18.989950 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:18.989930    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89f1fd8f-7f73-4f5d-9a77-649051dca787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:19.004232 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:19.004209    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:19.207574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:19.207493    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:19.606243 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:19.606211    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:20.005284 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:20.005203    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:20.102227 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:20.102196    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:20.191396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:20.191372    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtjql"
Jul 21 17:09:20.201836 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:20.201793    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:20.410699 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:20.410666    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:20.567642 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:20.567601    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:21.185639 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:21.185580    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:21.583868 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:21.583822    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:21.973496 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:21.973404    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:22.171900 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:22.171863    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:22.837515 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:22.837480    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:23.165829 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.165736    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:23.195041 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.195020    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:09:23.195401 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.195388    2557 scope.go:117] "RemoveContainer" containerID="166b1c8ff0fe8fa771288b89f56a205a23081aa9b1716bb7cb15533fba3a43be"
Jul 21 17:09:23.195558 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:23.195541    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-q6qqz_openshift-console-operator(e8d01263-b1fa-4a45-9057-8306bdc979bf)\"" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" podUID="e8d01263-b1fa-4a45-9057-8306bdc979bf"
Jul 21 17:09:23.365940 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.365909    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:23.573084 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.573044    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:23.731763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.731729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:09:23.731945 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.731840    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:09:23.734754 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.734733    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 17:09:23.734918 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.734898    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwzln\" (UniqueName: \"kubernetes.io/projected/6805355f-023f-4ffe-8634-37c5a67c7ae8-kube-api-access-pwzln\") pod \"network-check-target-p58wr\" (UID: \"6805355f-023f-4ffe-8634-37c5a67c7ae8\") " pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:09:23.744202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.744169    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f972653-5525-4d5e-9224-9909fce9fd2b-original-pull-secret\") pod \"global-pull-secret-syncer-qgrwt\" (UID: \"2f972653-5525-4d5e-9224-9909fce9fd2b\") " pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:09:23.775433 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.775413    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgrwt"
Jul 21 17:09:23.833138 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.833110    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:09:23.836055 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.836034    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 17:09:23.845647 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.845624    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f8bef54-e3ac-4056-9f92-6a0dd382d2c7-metrics-certs\") pod \"network-metrics-daemon-rlz7d\" (UID: \"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7\") " pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:09:23.934866 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.934832    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qgrwt"]
Jul 21 17:09:23.937706 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:23.937684    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f972653_5525_4d5e_9224_9909fce9fd2b.slice/crio-6a481d151284220663e5e5f5c4add7183bb2f12b82ef0d55543d0298aeadd573 WatchSource:0}: Error finding container 6a481d151284220663e5e5f5c4add7183bb2f12b82ef0d55543d0298aeadd573: Status 404 returned error can't find the container with id 6a481d151284220663e5e5f5c4add7183bb2f12b82ef0d55543d0298aeadd573
Jul 21 17:09:23.986372 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.986346    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bczc\""
Jul 21 17:09:23.994092 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:23.994069    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:09:24.072531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.072509    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk959\""
Jul 21 17:09:24.079983 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.079924    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlz7d"
Jul 21 17:09:24.139182 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.139151    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p58wr"]
Jul 21 17:09:24.142285 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:24.142239    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6805355f_023f_4ffe_8634_37c5a67c7ae8.slice/crio-3856ed4ba698ceb5d7cadba3b265a11f88ae749afc1491389428b452ed1ed1b1 WatchSource:0}: Error finding container 3856ed4ba698ceb5d7cadba3b265a11f88ae749afc1491389428b452ed1ed1b1: Status 404 returned error can't find the container with id 3856ed4ba698ceb5d7cadba3b265a11f88ae749afc1491389428b452ed1ed1b1
Jul 21 17:09:24.233662 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.233638    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlz7d"]
Jul 21 17:09:24.236153 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:24.236129    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8bef54_e3ac_4056_9f92_6a0dd382d2c7.slice/crio-2b238674fc11d56b5bc8bfa1196da9a159b8703c0fbfb7403a5e9926818f03b4 WatchSource:0}: Error finding container 2b238674fc11d56b5bc8bfa1196da9a159b8703c0fbfb7403a5e9926818f03b4: Status 404 returned error can't find the container with id 2b238674fc11d56b5bc8bfa1196da9a159b8703c0fbfb7403a5e9926818f03b4
Jul 21 17:09:24.343569 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.343496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p58wr" event={"ID":"6805355f-023f-4ffe-8634-37c5a67c7ae8","Type":"ContainerStarted","Data":"3d3ca3e1f86bbdc1925563df78bc64b95f274fb9a1ce4caf865484f2749d2a0f"}
Jul 21 17:09:24.343718 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.343659    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:09:24.343718 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.343701    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p58wr" event={"ID":"6805355f-023f-4ffe-8634-37c5a67c7ae8","Type":"ContainerStarted","Data":"3856ed4ba698ceb5d7cadba3b265a11f88ae749afc1491389428b452ed1ed1b1"}
Jul 21 17:09:24.344713 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.344682    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qgrwt" event={"ID":"2f972653-5525-4d5e-9224-9909fce9fd2b","Type":"ContainerStarted","Data":"6a481d151284220663e5e5f5c4add7183bb2f12b82ef0d55543d0298aeadd573"}
Jul 21 17:09:24.345702 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.345684    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlz7d" event={"ID":"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7","Type":"ContainerStarted","Data":"2b238674fc11d56b5bc8bfa1196da9a159b8703c0fbfb7403a5e9926818f03b4"}
Jul 21 17:09:24.362941 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.362904    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p58wr" podStartSLOduration=66.362891961 podStartE2EDuration="1m6.362891961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:24.361683947 +0000 UTC m=+66.907000163" watchObservedRunningTime="2026-07-21 17:09:24.362891961 +0000 UTC m=+66.908208176"
Jul 21 17:09:24.741728 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.741649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:09:24.741910 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.741772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:09:24.744372 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.744339    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"image-registry-6dc474dd6-jtqwk\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") " pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:09:24.744496 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.744406    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bea0c27-d9f7-4143-955b-7c983b87bb83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-98dq9\" (UID: \"8bea0c27-d9f7-4143-955b-7c983b87bb83\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:09:24.843061 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.843028    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:24.843210 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.843080    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:09:24.843210 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.843115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:09:24.843210 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.843145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:09:24.843210 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.843175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:24.843845 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.843817    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/def9337f-f934-459d-8b37-48fefebb839b-service-ca-bundle\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:24.845467 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.845441    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b27e994-0051-495a-b48a-5120b8015a64-metrics-tls\") pod \"dns-default-98jqh\" (UID: \"5b27e994-0051-495a-b48a-5120b8015a64\") " pod="openshift-dns/dns-default-98jqh"
Jul 21 17:09:24.845467 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.845457    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94f27f4c-7f35-403b-8775-a0d1b06ebe1f-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fqgs6\" (UID: \"94f27f4c-7f35-403b-8775-a0d1b06ebe1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:09:24.845640 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.845510    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/def9337f-f934-459d-8b37-48fefebb839b-metrics-certs\") pod \"router-default-845cf5c4d4-jccm6\" (UID: \"def9337f-f934-459d-8b37-48fefebb839b\") " pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:24.845640 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.845534    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nqshv\" (UID: \"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:09:24.956744 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.956711    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h5krw\""
Jul 21 17:09:24.964573 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.964550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:09:24.989592 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.989559    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dw2sz\""
Jul 21 17:09:24.997245 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:24.997179    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"
Jul 21 17:09:25.005605 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.005578    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zl8qj\""
Jul 21 17:09:25.013065 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.013006    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"
Jul 21 17:09:25.047823 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.047376    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bn6n8\""
Jul 21 17:09:25.055199 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.055156    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98jqh"
Jul 21 17:09:25.095328 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.095141    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qvtwz\""
Jul 21 17:09:25.100622 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.100425    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-96wcg\""
Jul 21 17:09:25.102878 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.102668    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:25.113812 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.113769    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"
Jul 21 17:09:25.165387 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.161164    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dc474dd6-jtqwk"]
Jul 21 17:09:25.225625 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.221113    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9"]
Jul 21 17:09:25.282041 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.281699    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6"]
Jul 21 17:09:25.311200 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.310866    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98jqh"]
Jul 21 17:09:25.334150 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.334122    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-845cf5c4d4-jccm6"]
Jul 21 17:09:25.337600 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:25.337565    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef9337f_f934_459d_8b37_48fefebb839b.slice/crio-19d47ed05b50c859047f6e08341dff959d6b3e12f8a90b22d2fe56ef7e45c40b WatchSource:0}: Error finding container 19d47ed05b50c859047f6e08341dff959d6b3e12f8a90b22d2fe56ef7e45c40b: Status 404 returned error can't find the container with id 19d47ed05b50c859047f6e08341dff959d6b3e12f8a90b22d2fe56ef7e45c40b
Jul 21 17:09:25.354478 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.354450    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98jqh" event={"ID":"5b27e994-0051-495a-b48a-5120b8015a64","Type":"ContainerStarted","Data":"423a5109a3b70e01ff3bc1c70604ccae4aea38152ad50624e19e1176bf954372"}
Jul 21 17:09:25.356782 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.356755    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-845cf5c4d4-jccm6" event={"ID":"def9337f-f934-459d-8b37-48fefebb839b","Type":"ContainerStarted","Data":"19d47ed05b50c859047f6e08341dff959d6b3e12f8a90b22d2fe56ef7e45c40b"}
Jul 21 17:09:25.358941 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.358876    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9" event={"ID":"8bea0c27-d9f7-4143-955b-7c983b87bb83","Type":"ContainerStarted","Data":"3bb71446c481990835cae9c398b511121726bcbfb490b57bf0e0e8aad45d2320"}
Jul 21 17:09:25.362151 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.361922    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk" event={"ID":"976ca309-8734-445b-8dfb-fcf6093f1bb5","Type":"ContainerStarted","Data":"6af0b4523bf98669b800848c3c618b088f410f975b47e58d36d76f25a0b446cd"}
Jul 21 17:09:25.373127 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.372874    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv"]
Jul 21 17:09:25.375746 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:25.375716    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc70ee41_4830_4a4b_aa7f_c7ec6c9f1386.slice/crio-980c910f09bbb4a7e41befe3dfb0101e2d254df760ae5e25331e7022aea39e98 WatchSource:0}: Error finding container 980c910f09bbb4a7e41befe3dfb0101e2d254df760ae5e25331e7022aea39e98: Status 404 returned error can't find the container with id 980c910f09bbb4a7e41befe3dfb0101e2d254df760ae5e25331e7022aea39e98
Jul 21 17:09:25.845784 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.845749    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:25.942973 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:25.942918    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:26.040131 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.040042    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:26.371306 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.371221    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-845cf5c4d4-jccm6" event={"ID":"def9337f-f934-459d-8b37-48fefebb839b","Type":"ContainerStarted","Data":"9f17218515dca622693095b745df78179cf4a057c0798db98a2f083e1ec7a773"}
Jul 21 17:09:26.378249 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.378217    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk" event={"ID":"976ca309-8734-445b-8dfb-fcf6093f1bb5","Type":"ContainerStarted","Data":"66c9fcee4e0ecd7e165f10a11cd3233713e834d03df64c90f7e38a69d7cf8718"}
Jul 21 17:09:26.378827 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.378760    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:09:26.382991 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.382966    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlz7d" event={"ID":"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7","Type":"ContainerStarted","Data":"323d62a8192b352b32777a782d8333851282aa40cec3b41cf35c5ce70189988e"}
Jul 21 17:09:26.383098 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.383017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlz7d" event={"ID":"3f8bef54-e3ac-4056-9f92-6a0dd382d2c7","Type":"ContainerStarted","Data":"27cae705405eee5ba448106665c9c67560bb6d5277a251b850e5193391769bb4"}
Jul 21 17:09:26.385044 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.385003    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv" event={"ID":"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386","Type":"ContainerStarted","Data":"980c910f09bbb4a7e41befe3dfb0101e2d254df760ae5e25331e7022aea39e98"}
Jul 21 17:09:26.386441 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.386398    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6" event={"ID":"94f27f4c-7f35-403b-8775-a0d1b06ebe1f","Type":"ContainerStarted","Data":"e3db8b795265b9514343b008ef18e9b2cb135a9360a2f6ba061fbda81669aeab"}
Jul 21 17:09:26.394678 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.394634    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-845cf5c4d4-jccm6" podStartSLOduration=62.394616443 podStartE2EDuration="1m2.394616443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:26.392844003 +0000 UTC m=+68.938160225" watchObservedRunningTime="2026-07-21 17:09:26.394616443 +0000 UTC m=+68.939932661"
Jul 21 17:09:26.419591 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.419385    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk" podStartSLOduration=68.419368809 podStartE2EDuration="1m8.419368809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:26.41731136 +0000 UTC m=+68.962627593" watchObservedRunningTime="2026-07-21 17:09:26.419368809 +0000 UTC m=+68.964685008"
Jul 21 17:09:26.433665 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.433616    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rlz7d" podStartSLOduration=66.677890636 podStartE2EDuration="1m8.433598755s" totalImagesPullingTime="1.755708119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:26.432708112 +0000 UTC m=+68.978024366" watchObservedRunningTime="2026-07-21 17:09:26.433598755 +0000 UTC m=+68.978914972"
Jul 21 17:09:26.565251 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.565197    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:26.664322 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:26.664213    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:27.103980 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:27.103948    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:27.107302 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:27.107276    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:27.390208 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:27.390119    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:27.391271 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:27.391250    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-845cf5c4d4-jccm6"
Jul 21 17:09:29.488759 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:29.488728    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:29.588474 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:29.588410    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:29.688656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:29.688627    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:29.768431 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:29.768374    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:31.678535 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:31.678431    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:31.773393 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:31.773319    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:31.973153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:31.973019    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:32.171659 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.171631    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:32.272599 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.272566    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:32.409708 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.409671    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv" event={"ID":"dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386","Type":"ContainerStarted","Data":"9ae75ea6843aa412e850ea7caba758dabacd2a91248fa817e9d127d91c88281d"}
Jul 21 17:09:32.411482 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.411455    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6" event={"ID":"94f27f4c-7f35-403b-8775-a0d1b06ebe1f","Type":"ContainerStarted","Data":"40df4bf8eeb00dfb174e200319502c918a0d1ce62e47785daf0e73053e08785b"}
Jul 21 17:09:32.411624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.411508    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6" event={"ID":"94f27f4c-7f35-403b-8775-a0d1b06ebe1f","Type":"ContainerStarted","Data":"3bff5534263268d39acf1225d05c164ae2f926282401a2b8a8b52fef915a5a97"}
Jul 21 17:09:32.412954 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.412934    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9" event={"ID":"8bea0c27-d9f7-4143-955b-7c983b87bb83","Type":"ContainerStarted","Data":"29e7d7bff81afeaa149728e72452f5a37af439c584473585bc0366151b327df0"}
Jul 21 17:09:32.414334 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.414309    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qgrwt" event={"ID":"2f972653-5525-4d5e-9224-9909fce9fd2b","Type":"ContainerStarted","Data":"a8744211378a60c7fac03a02b2b8ed46c63893c950dbaa16e2c2538307cbb92c"}
Jul 21 17:09:32.416177 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.416154    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98jqh" event={"ID":"5b27e994-0051-495a-b48a-5120b8015a64","Type":"ContainerStarted","Data":"2fd76a5d9cbdd7a4e3e9bca5516c2c0c1cfa1a9a67f7c365f213f7fb6f2f1cea"}
Jul 21 17:09:32.416273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.416200    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98jqh" event={"ID":"5b27e994-0051-495a-b48a-5120b8015a64","Type":"ContainerStarted","Data":"757d0aef9229f513fc73128bbbb8dd0432ad638680563f8e0e86b2037e130ef7"}
Jul 21 17:09:32.416330 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.416319    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-98jqh"
Jul 21 17:09:32.434495 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.434442    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nqshv" podStartSLOduration=51.384749255 podStartE2EDuration="57.434424803s" totalImagesPullingTime="6.049675548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:32.433963902 +0000 UTC m=+74.979280117" watchObservedRunningTime="2026-07-21 17:09:32.434424803 +0000 UTC m=+74.979741021"
Jul 21 17:09:32.486677 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.486627    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-98dq9" podStartSLOduration=62.290042915 podStartE2EDuration="1m8.48660842s" totalImagesPullingTime="6.196565505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:32.460429393 +0000 UTC m=+75.005745608" watchObservedRunningTime="2026-07-21 17:09:32.48660842 +0000 UTC m=+75.031924644"
Jul 21 17:09:32.520189 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.520132    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fqgs6" podStartSLOduration=62.446599417 podStartE2EDuration="1m8.52011137s" totalImagesPullingTime="6.073511953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:32.489420169 +0000 UTC m=+75.034736384" watchObservedRunningTime="2026-07-21 17:09:32.52011137 +0000 UTC m=+75.065427587"
Jul 21 17:09:32.520370 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.520302    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qgrwt" podStartSLOduration=67.030305695 podStartE2EDuration="1m14.5202957s" totalImagesPullingTime="7.489990005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:32.519680256 +0000 UTC m=+75.064996470" watchObservedRunningTime="2026-07-21 17:09:32.5202957 +0000 UTC m=+75.065611917"
Jul 21 17:09:32.557341 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.557242    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-98jqh" podStartSLOduration=34.445035743 podStartE2EDuration="40.557226596s" totalImagesPullingTime="6.112190853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:32.556618368 +0000 UTC m=+75.101934585" watchObservedRunningTime="2026-07-21 17:09:32.557226596 +0000 UTC m=+75.102542811"
Jul 21 17:09:32.569518 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.569481    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:32.669536 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.669484    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:32.748024 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:32.747991    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:35.034692 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.034643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:35.037083 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.037057    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89f1fd8f-7f73-4f5d-9a77-649051dca787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpphq\" (UID: \"89f1fd8f-7f73-4f5d-9a77-649051dca787\") " pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:35.096949 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.096917    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:35.182857 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.182793    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:35.245716 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.245687    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t495x\""
Jul 21 17:09:35.252897 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.252876    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mpphq"
Jul 21 17:09:35.380595 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.380571    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mpphq"]
Jul 21 17:09:35.382873 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:35.382850    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f1fd8f_7f73_4f5d_9a77_649051dca787.slice/crio-d06292d26616123c1843a5ca6aef8457d0966c5f726a40b84c25902c331e70b6 WatchSource:0}: Error finding container d06292d26616123c1843a5ca6aef8457d0966c5f726a40b84c25902c331e70b6: Status 404 returned error can't find the container with id d06292d26616123c1843a5ca6aef8457d0966c5f726a40b84c25902c331e70b6
Jul 21 17:09:35.429374 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.429342    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mpphq" event={"ID":"89f1fd8f-7f73-4f5d-9a77-649051dca787","Type":"ContainerStarted","Data":"d06292d26616123c1843a5ca6aef8457d0966c5f726a40b84c25902c331e70b6"}
Jul 21 17:09:35.571703 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.571607    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:35.669182 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.669144    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:35.729066 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:35.729032    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:36.056754 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:36.056720    2557 scope.go:117] "RemoveContainer" containerID="166b1c8ff0fe8fa771288b89f56a205a23081aa9b1716bb7cb15533fba3a43be"
Jul 21 17:09:36.165115 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:36.165018    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:36.238042 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:36.238004    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:36.436577 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:36.436509    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:09:36.436743 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:36.436625    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz" event={"ID":"e8d01263-b1fa-4a45-9057-8306bdc979bf","Type":"ContainerStarted","Data":"fb91183b7789508b61a0dbce3489b07639a86e078734ffb4c436bfcee1889925"}
Jul 21 17:09:36.437072 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:36.437044    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:09:36.804499 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:36.804256    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-q6qqz"
Jul 21 17:09:37.011788 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.011749    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-7rvqh"]
Jul 21 17:09:37.014339 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.014314    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7rvqh"
Jul 21 17:09:37.017663 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.017642    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7rrp9\""
Jul 21 17:09:37.018208 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.017998    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 17:09:37.018308 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.018245    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 17:09:37.028640 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.027521    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7rvqh"]
Jul 21 17:09:37.032996 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.032967    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:37.136512 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.136396    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:37.153401 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.153370    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rkgv\" (UniqueName: \"kubernetes.io/projected/a268cceb-162a-4e0f-8f07-5c24e5852c0b-kube-api-access-8rkgv\") pod \"downloads-5bc67dcd46-7rvqh\" (UID: \"a268cceb-162a-4e0f-8f07-5c24e5852c0b\") " pod="openshift-console/downloads-5bc67dcd46-7rvqh"
Jul 21 17:09:37.254703 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.254665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rkgv\" (UniqueName: \"kubernetes.io/projected/a268cceb-162a-4e0f-8f07-5c24e5852c0b-kube-api-access-8rkgv\") pod \"downloads-5bc67dcd46-7rvqh\" (UID: \"a268cceb-162a-4e0f-8f07-5c24e5852c0b\") " pod="openshift-console/downloads-5bc67dcd46-7rvqh"
Jul 21 17:09:37.270233 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.270202    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rkgv\" (UniqueName: \"kubernetes.io/projected/a268cceb-162a-4e0f-8f07-5c24e5852c0b-kube-api-access-8rkgv\") pod \"downloads-5bc67dcd46-7rvqh\" (UID: \"a268cceb-162a-4e0f-8f07-5c24e5852c0b\") " pod="openshift-console/downloads-5bc67dcd46-7rvqh"
Jul 21 17:09:37.315022 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.314986    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:37.326787 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.326754    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7rvqh"
Jul 21 17:09:37.469731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.469697    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7rvqh"]
Jul 21 17:09:37.476183 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:37.476153    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda268cceb_162a_4e0f_8f07_5c24e5852c0b.slice/crio-a3c053d3e281ab769a8a6e051f2bbe1a7b84e2dab5c52d48e5c15c49f7578682 WatchSource:0}: Error finding container a3c053d3e281ab769a8a6e051f2bbe1a7b84e2dab5c52d48e5c15c49f7578682: Status 404 returned error can't find the container with id a3c053d3e281ab769a8a6e051f2bbe1a7b84e2dab5c52d48e5c15c49f7578682
Jul 21 17:09:37.664293 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.664257    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:37.724674 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.724601    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:37.979383 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:37.979297    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:38.081851 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:38.081815    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:38.180491 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:38.180455    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:38.447851 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:38.447815    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7rvqh" event={"ID":"a268cceb-162a-4e0f-8f07-5c24e5852c0b","Type":"ContainerStarted","Data":"a3c053d3e281ab769a8a6e051f2bbe1a7b84e2dab5c52d48e5c15c49f7578682"}
Jul 21 17:09:38.893760 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:38.893726    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:39.199401 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:39.199244    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:39.401837 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:39.401787    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:39.923712 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:39.923676    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:40.025151 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:40.025072    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:40.571359 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:40.571333    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:40.676100 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:40.676016    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:41.464925 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:41.464778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mpphq" event={"ID":"89f1fd8f-7f73-4f5d-9a77-649051dca787","Type":"ContainerStarted","Data":"6cee862f7e32cd8c73f56cf34c2d43ec0db6c1dc3ebabd6d449670873e3b4234"}
Jul 21 17:09:42.080144 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:42.080106    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:42.423214 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:42.423134    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-98jqh"
Jul 21 17:09:44.141306 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.141261    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:44.211974 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.211941    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:44.360278 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.360239    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:44.616356 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.616318    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:44.663616 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.663585    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"]
Jul 21 17:09:44.666830 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.666810    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.671743 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.671598    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 17:09:44.672157 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.672133    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 17:09:44.672854 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.672834    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-twggp\""
Jul 21 17:09:44.672854 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.672844    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 17:09:44.685859 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.685832    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"]
Jul 21 17:09:44.720957 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.720925    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6slht"]
Jul 21 17:09:44.727490 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.727463    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.736493 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.736452    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rx78m\""
Jul 21 17:09:44.736606 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.736542    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 17:09:44.736606 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.736593    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 17:09:44.736734 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.736542    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 17:09:44.750094 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.750068    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:44.824888 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.824852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-wtmp\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.825087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.824910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.825087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.824939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-sys\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.825087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.824963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dfe3f99-704d-446a-9c96-2ac817ac8862-metrics-client-ca\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.825087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.824984    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.825087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.825015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x25gl\" (UniqueName: \"kubernetes.io/projected/3dfe3f99-704d-446a-9c96-2ac817ac8862-kube-api-access-x25gl\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.825087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.825036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d727275-ef70-410c-a2b8-fe2a8e33b314-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.825087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.825069    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7cj\" (UniqueName: \"kubernetes.io/projected/2d727275-ef70-410c-a2b8-fe2a8e33b314-kube-api-access-rj7cj\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.825087 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.825090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-root\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.825498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.825105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.825498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.825122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-textfile\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.825498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.825144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.825498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.825168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-accelerators-collector-config\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.846341 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.846307    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:44.926531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926459    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-wtmp\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.926531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926499    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.926531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-sys\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.926838 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dfe3f99-704d-446a-9c96-2ac817ac8862-metrics-client-ca\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.926838 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926588    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.926838 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926631    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x25gl\" (UniqueName: \"kubernetes.io/projected/3dfe3f99-704d-446a-9c96-2ac817ac8862-kube-api-access-x25gl\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.926838 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926660    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d727275-ef70-410c-a2b8-fe2a8e33b314-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.926838 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926668    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-wtmp\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.926838 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-sys\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.926838 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926694    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7cj\" (UniqueName: \"kubernetes.io/projected/2d727275-ef70-410c-a2b8-fe2a8e33b314-kube-api-access-rj7cj\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-root\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926971    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-textfile\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.926988    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dfe3f99-704d-446a-9c96-2ac817ac8862-root\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.927007    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.927033    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-accelerators-collector-config\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:44.927085    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:44.927119    2557 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:44.927143    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls podName:3dfe3f99-704d-446a-9c96-2ac817ac8862 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:45.427122875 +0000 UTC m=+87.972439074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls") pod "node-exporter-6slht" (UID: "3dfe3f99-704d-446a-9c96-2ac817ac8862") : secret "node-exporter-tls" not found
Jul 21 17:09:44.927205 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:44.927172    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-tls podName:2d727275-ef70-410c-a2b8-fe2a8e33b314 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:45.427152998 +0000 UTC m=+87.972469215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-2n8gd" (UID: "2d727275-ef70-410c-a2b8-fe2a8e33b314") : secret "openshift-state-metrics-tls" not found
Jul 21 17:09:44.927697 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.927315    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-textfile\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.927697 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.927422    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d727275-ef70-410c-a2b8-fe2a8e33b314-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.927697 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.927635    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-accelerators-collector-config\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.927886 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.927710    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dfe3f99-704d-446a-9c96-2ac817ac8862-metrics-client-ca\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.929258 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.929239    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.929395 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.929379    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.940596 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.940575    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x25gl\" (UniqueName: \"kubernetes.io/projected/3dfe3f99-704d-446a-9c96-2ac817ac8862-kube-api-access-x25gl\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:44.941047 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.941024    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7cj\" (UniqueName: \"kubernetes.io/projected/2d727275-ef70-410c-a2b8-fe2a8e33b314-kube-api-access-rj7cj\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:44.991193 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:44.991158    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:45.090771 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.090706    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:45.301419 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.301382    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:45.402280 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.402234    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:45.432815 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.432769    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:45.433004 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.432846    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:45.433004 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:45.432919    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 17:09:45.433004 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:09:45.432995    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls podName:3dfe3f99-704d-446a-9c96-2ac817ac8862 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:46.432975294 +0000 UTC m=+88.978291491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls") pod "node-exporter-6slht" (UID: "3dfe3f99-704d-446a-9c96-2ac817ac8862") : secret "node-exporter-tls" not found
Jul 21 17:09:45.435892 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.435859    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d727275-ef70-410c-a2b8-fe2a8e33b314-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2n8gd\" (UID: \"2d727275-ef70-410c-a2b8-fe2a8e33b314\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:45.487750 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.487715    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mpphq" event={"ID":"89f1fd8f-7f73-4f5d-9a77-649051dca787","Type":"ContainerStarted","Data":"32c7ffe968a6b237bd62123a75768507ee39111bc038f85515d870dd913b8772"}
Jul 21 17:09:45.579016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.578937    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"
Jul 21 17:09:45.658359 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.658197    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:45.746917 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.746098    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd"]
Jul 21 17:09:45.749932 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.749904    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:45.878239 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:45.878134    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:46.175881 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:46.175757    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:46.442965 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:46.442878    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:46.445743 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:46.445717    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dfe3f99-704d-446a-9c96-2ac817ac8862-node-exporter-tls\") pod \"node-exporter-6slht\" (UID: \"3dfe3f99-704d-446a-9c96-2ac817ac8862\") " pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:46.496116 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:46.496080    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd" event={"ID":"2d727275-ef70-410c-a2b8-fe2a8e33b314","Type":"ContainerStarted","Data":"657417024eee7d025bd2e187a8546f11ffae0414dee07940068864aa96a8caf0"}
Jul 21 17:09:46.496310 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:46.496155    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd" event={"ID":"2d727275-ef70-410c-a2b8-fe2a8e33b314","Type":"ContainerStarted","Data":"f588910c90fe7b204451e37110ab71437dd2593d9b3df36a16fc7e5a1b573eef"}
Jul 21 17:09:46.496310 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:46.496183    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd" event={"ID":"2d727275-ef70-410c-a2b8-fe2a8e33b314","Type":"ContainerStarted","Data":"58ba7829860d618822ad2844653c79499c8cb41f82a0a6f99fc223edc0f721e7"}
Jul 21 17:09:46.539418 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:46.539388    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6slht"
Jul 21 17:09:46.556122 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:46.556092    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dfe3f99_704d_446a_9c96_2ac817ac8862.slice/crio-93f4c674a698cead583842041b2c87fcad1098dd7802e8df203b7bfceea7e04f WatchSource:0}: Error finding container 93f4c674a698cead583842041b2c87fcad1098dd7802e8df203b7bfceea7e04f: Status 404 returned error can't find the container with id 93f4c674a698cead583842041b2c87fcad1098dd7802e8df203b7bfceea7e04f
Jul 21 17:09:47.154608 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.154574    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c94ffd8d4-b8ghl"]
Jul 21 17:09:47.159943 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.159856    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.168286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.168226    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 17:09:47.168286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.168257    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 17:09:47.169410 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.169387    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 17:09:47.169410 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.169396    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 17:09:47.169586 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.169390    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 17:09:47.169586 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.169494    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ds9rq\""
Jul 21 17:09:47.177784 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.177755    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c94ffd8d4-b8ghl"]
Jul 21 17:09:47.250292 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.250248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-oauth-config\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.250486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.250334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-console-config\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.250486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.250372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-service-ca\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.250486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.250411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-oauth-serving-cert\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.250486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.250441    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-serving-cert\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.250486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.250470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hlpg\" (UniqueName: \"kubernetes.io/projected/a61f0a91-6339-46c7-91de-90593ba43ad5-kube-api-access-8hlpg\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.351931 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.351395    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-oauth-serving-cert\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.351931 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.351453    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-serving-cert\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.351931 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.351498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hlpg\" (UniqueName: \"kubernetes.io/projected/a61f0a91-6339-46c7-91de-90593ba43ad5-kube-api-access-8hlpg\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.351931 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.351853    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-oauth-config\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.351931 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.351928    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-console-config\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.352318 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.351959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-service-ca\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.352378 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.352366    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-oauth-serving-cert\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.352583 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.352541    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-service-ca\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.353021 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.352992    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-console-config\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.355400 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.355374    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-oauth-config\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.355623 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.355582    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-serving-cert\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.361514 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.361464    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hlpg\" (UniqueName: \"kubernetes.io/projected/a61f0a91-6339-46c7-91de-90593ba43ad5-kube-api-access-8hlpg\") pod \"console-6c94ffd8d4-b8ghl\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") " pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.472216 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.472097    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:09:47.487273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.487186    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dc474dd6-jtqwk"]
Jul 21 17:09:47.493440 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.493414    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:09:47.502771 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.502736    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6slht" event={"ID":"3dfe3f99-704d-446a-9c96-2ac817ac8862","Type":"ContainerStarted","Data":"93f4c674a698cead583842041b2c87fcad1098dd7802e8df203b7bfceea7e04f"}
Jul 21 17:09:47.595457 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.595405    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:47.677851 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.677786    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64df46c956-w4vxp"]
Jul 21 17:09:47.680969 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.680939    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:47.683035 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.683010    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.686052 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.685792    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 17:09:47.686052 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.685837    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 17:09:47.686052 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.685964    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 17:09:47.686052 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.686052    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c57v3ebe45ki8\""
Jul 21 17:09:47.686381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.686195    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zwfwg\""
Jul 21 17:09:47.686381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.686225    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 17:09:47.686381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.686285    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 17:09:47.698066 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.698041    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64df46c956-w4vxp"]
Jul 21 17:09:47.818757 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.818673    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:47.856295 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.856254    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.856464 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.856309    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpjhc\" (UniqueName: \"kubernetes.io/projected/caf085d5-373d-4a00-a157-ec5894037b19-kube-api-access-lpjhc\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.856464 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.856368    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.856464 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.856415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf085d5-373d-4a00-a157-ec5894037b19-metrics-client-ca\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.856464 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.856445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-tls\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.856778 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.856475    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.856778 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.856534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-grpc-tls\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.856778 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.856582    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.919448 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.919328    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:47.959299 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.958444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.959299 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.958493    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjhc\" (UniqueName: \"kubernetes.io/projected/caf085d5-373d-4a00-a157-ec5894037b19-kube-api-access-lpjhc\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.959299 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.959135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.959299 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.959195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf085d5-373d-4a00-a157-ec5894037b19-metrics-client-ca\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.959299 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.959231    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-tls\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.959299 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.959268    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.960294 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.959771    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-grpc-tls\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.960294 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.959862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.960294 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.960144    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf085d5-373d-4a00-a157-ec5894037b19-metrics-client-ca\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.964791 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.964759    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.966111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.965697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-tls\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.966111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.965906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.966111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.966042    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-grpc-tls\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.966318 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.966101    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.966840 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.966817    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caf085d5-373d-4a00-a157-ec5894037b19-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.972212 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.972185    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpjhc\" (UniqueName: \"kubernetes.io/projected/caf085d5-373d-4a00-a157-ec5894037b19-kube-api-access-lpjhc\") pod \"thanos-querier-64df46c956-w4vxp\" (UID: \"caf085d5-373d-4a00-a157-ec5894037b19\") " pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:47.994326 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:47.994177    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:09:48.221149 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:48.221067    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:48.325857 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:48.325824    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:49.249067 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.248965    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64df46c956-w4vxp"]
Jul 21 17:09:49.267224 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.267181    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c94ffd8d4-b8ghl"]
Jul 21 17:09:49.357381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.357276    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:49.424563 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.424437    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:49.429891 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:49.429860    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61f0a91_6339_46c7_91de_90593ba43ad5.slice/crio-a5a4d761c6c7e76797d5c9dc4e906d244e239f07df2732cf5189eac09e0f7e7d WatchSource:0}: Error finding container a5a4d761c6c7e76797d5c9dc4e906d244e239f07df2732cf5189eac09e0f7e7d: Status 404 returned error can't find the container with id a5a4d761c6c7e76797d5c9dc4e906d244e239f07df2732cf5189eac09e0f7e7d
Jul 21 17:09:49.430602 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:09:49.430574    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf085d5_373d_4a00_a157_ec5894037b19.slice/crio-f9dff47e1bc62a02064df0f32e139ff997a54029f82aec53e1f7164b879d8dcc WatchSource:0}: Error finding container f9dff47e1bc62a02064df0f32e139ff997a54029f82aec53e1f7164b879d8dcc: Status 404 returned error can't find the container with id f9dff47e1bc62a02064df0f32e139ff997a54029f82aec53e1f7164b879d8dcc
Jul 21 17:09:49.512757 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.512726    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp" event={"ID":"caf085d5-373d-4a00-a157-ec5894037b19","Type":"ContainerStarted","Data":"f9dff47e1bc62a02064df0f32e139ff997a54029f82aec53e1f7164b879d8dcc"}
Jul 21 17:09:49.514152 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.514113    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c94ffd8d4-b8ghl" event={"ID":"a61f0a91-6339-46c7-91de-90593ba43ad5","Type":"ContainerStarted","Data":"a5a4d761c6c7e76797d5c9dc4e906d244e239f07df2732cf5189eac09e0f7e7d"}
Jul 21 17:09:49.517430 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.517370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mpphq" event={"ID":"89f1fd8f-7f73-4f5d-9a77-649051dca787","Type":"ContainerStarted","Data":"b6aacf487d9976ba621f8643f917476f865dc8132cd98a25f9e0e4ead545fe9d"}
Jul 21 17:09:49.519913 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.519883    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd" event={"ID":"2d727275-ef70-410c-a2b8-fe2a8e33b314","Type":"ContainerStarted","Data":"3205217b34a6e6dd3bbd31e48fc5508d8b07c80d087e46d43fa18b5882aa57df"}
Jul 21 17:09:49.543875 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.543816    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mpphq" podStartSLOduration=33.003023321 podStartE2EDuration="46.543781671s" totalImagesPullingTime="13.54075835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:09:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:49.541686096 +0000 UTC m=+92.087002315" watchObservedRunningTime="2026-07-21 17:09:49.543781671 +0000 UTC m=+92.089097888"
Jul 21 17:09:49.564161 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:49.564111    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2n8gd" podStartSLOduration=2.420629312 podStartE2EDuration="5.564094832s" totalImagesPullingTime="3.14346552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:49.563619156 +0000 UTC m=+92.108935374" watchObservedRunningTime="2026-07-21 17:09:49.564094832 +0000 UTC m=+92.109411046"
Jul 21 17:09:50.054733 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:50.054650    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:50.155677 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:50.155614    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:50.528829 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:50.528257    2557 generic.go:356] "Generic (PLEG): container finished" podID="3dfe3f99-704d-446a-9c96-2ac817ac8862" containerID="083807e528044ff98dc98d0d168d5e642414f5eb05866de650884132691143ce" exitCode=0
Jul 21 17:09:50.528829 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:50.528399    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6slht" event={"ID":"3dfe3f99-704d-446a-9c96-2ac817ac8862","Type":"ContainerDied","Data":"083807e528044ff98dc98d0d168d5e642414f5eb05866de650884132691143ce"}
Jul 21 17:09:51.009192 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.009064    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:51.534476 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.534445    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6slht" event={"ID":"3dfe3f99-704d-446a-9c96-2ac817ac8862","Type":"ContainerStarted","Data":"2da26d789c7d96bc3aa1a9c26e1ebe05d3739db70e53e59bca376a07d8ceba63"}
Jul 21 17:09:51.534902 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.534502    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6slht" event={"ID":"3dfe3f99-704d-446a-9c96-2ac817ac8862","Type":"ContainerStarted","Data":"bf72b934cfbec96895a4cb1a743f167a6480d1c5ed8855fe992e873bf6db518d"}
Jul 21 17:09:51.559809 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.559743    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6slht" podStartSLOduration=4.564177061 podStartE2EDuration="7.55972403s" totalImagesPullingTime="2.918843151s" totalInitContainerRuntime="76.703818ms" isStatefulPod=true podCreationTimestamp="2026-07-21 17:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:51.558218489 +0000 UTC m=+94.103534705" watchObservedRunningTime="2026-07-21 17:09:51.55972403 +0000 UTC m=+94.105040246"
Jul 21 17:09:51.579211 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.579172    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:51.681153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.681116    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:51.740910 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.740879    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-776578bc4-bqcm5"]
Jul 21 17:09:51.744615 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.744593    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.756899 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.756879    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 17:09:51.767577 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.767551    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776578bc4-bqcm5"]
Jul 21 17:09:51.798502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.798411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-config\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.798502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.798453    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-trusted-ca-bundle\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.798502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.798495    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-oauth-serving-cert\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.798740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.798541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-serving-cert\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.798740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.798608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59zk4\" (UniqueName: \"kubernetes.io/projected/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-kube-api-access-59zk4\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.798740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.798650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-service-ca\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.798740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.798676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-oauth-config\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.799607 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.799545    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:51.899119 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.899083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59zk4\" (UniqueName: \"kubernetes.io/projected/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-kube-api-access-59zk4\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.899311 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.899142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-service-ca\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.899311 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.899172    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-oauth-config\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.899311 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.899201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-config\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.899311 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.899223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-trusted-ca-bundle\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.899311 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.899258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-oauth-serving-cert\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.899311 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.899289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-serving-cert\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.899991 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.899933    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-service-ca\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.900125 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.900049    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-config\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.900256 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.900227    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-oauth-serving-cert\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.900374 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.900267    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-trusted-ca-bundle\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.902033 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.902012    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-serving-cert\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.902134 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.902060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-oauth-config\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:51.907319 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:51.907299    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59zk4\" (UniqueName: \"kubernetes.io/projected/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-kube-api-access-59zk4\") pod \"console-776578bc4-bqcm5\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") " pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:52.056476 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:52.055372    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:09:52.166084 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:52.165989    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:52.268372 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:52.268338    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:55.373699 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:55.373661    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p58wr"
Jul 21 17:09:56.310118 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:56.310080    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:56.409686 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:56.409653    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:57.149306 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:57.149265    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:57.249853 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:09:57.249779    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:00.545540 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.545509    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776578bc4-bqcm5"]
Jul 21 17:10:00.551524 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:10:00.551494    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38741f2c_1ec9_4caa_bb24_8ceb95ba6e06.slice/crio-a0fb968fdd4132b2cae53722ea278f91d220afed2dff31575e5ddfa69fd03622 WatchSource:0}: Error finding container a0fb968fdd4132b2cae53722ea278f91d220afed2dff31575e5ddfa69fd03622: Status 404 returned error can't find the container with id a0fb968fdd4132b2cae53722ea278f91d220afed2dff31575e5ddfa69fd03622
Jul 21 17:10:00.577214 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.577106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp" event={"ID":"caf085d5-373d-4a00-a157-ec5894037b19","Type":"ContainerStarted","Data":"00ec46d310c21d577d8544778efc848067b897ada6043afe7ba89bc55de3281b"}
Jul 21 17:10:00.580237 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.579363    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c94ffd8d4-b8ghl" event={"ID":"a61f0a91-6339-46c7-91de-90593ba43ad5","Type":"ContainerStarted","Data":"02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4"}
Jul 21 17:10:00.582296 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.582268    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7rvqh" event={"ID":"a268cceb-162a-4e0f-8f07-5c24e5852c0b","Type":"ContainerStarted","Data":"67b497d1997d30b3c8820df34f39ba4ca584daea15c9c49cf7ed88a0472c8ca9"}
Jul 21 17:10:00.582479 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.582462    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-7rvqh"
Jul 21 17:10:00.584001 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.583588    2557 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-7rvqh container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" start-of-body=
Jul 21 17:10:00.584001 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.583630    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-7rvqh" podUID="a268cceb-162a-4e0f-8f07-5c24e5852c0b" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused"
Jul 21 17:10:00.585159 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.585137    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776578bc4-bqcm5" event={"ID":"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06","Type":"ContainerStarted","Data":"a0fb968fdd4132b2cae53722ea278f91d220afed2dff31575e5ddfa69fd03622"}
Jul 21 17:10:00.587574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.587542    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:00.602152 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.601919    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c94ffd8d4-b8ghl" podStartSLOduration=2.622026348 podStartE2EDuration="13.601900365s" totalImagesPullingTime="10.979874017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:00.601764196 +0000 UTC m=+103.147080409" watchObservedRunningTime="2026-07-21 17:10:00.601900365 +0000 UTC m=+103.147216584"
Jul 21 17:10:00.623145 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.623082    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-7rvqh" podStartSLOduration=1.662068578 podStartE2EDuration="24.623062053s" totalImagesPullingTime="22.960993475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:00.620398899 +0000 UTC m=+103.165715129" watchObservedRunningTime="2026-07-21 17:10:00.623062053 +0000 UTC m=+103.168378270"
Jul 21 17:10:00.688403 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:00.688049    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:01.595218 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:01.595156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp" event={"ID":"caf085d5-373d-4a00-a157-ec5894037b19","Type":"ContainerStarted","Data":"9ae8ced476fcf4c96625bf8f86dc6358d128282067ccac568450b30b0b951d8c"}
Jul 21 17:10:01.595709 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:01.595244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp" event={"ID":"caf085d5-373d-4a00-a157-ec5894037b19","Type":"ContainerStarted","Data":"b7ad950f82f21b16aa060913da7de1a681b56e83dc279f7250046b54d680e05d"}
Jul 21 17:10:01.598226 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:01.598189    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776578bc4-bqcm5" event={"ID":"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06","Type":"ContainerStarted","Data":"d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae"}
Jul 21 17:10:01.611296 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:01.611264    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-7rvqh"
Jul 21 17:10:01.621127 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:01.620653    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-776578bc4-bqcm5" podStartSLOduration=10.620632701 podStartE2EDuration="10.620632701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:01.617846583 +0000 UTC m=+104.163162802" watchObservedRunningTime="2026-07-21 17:10:01.620632701 +0000 UTC m=+104.165948918"
Jul 21 17:10:02.064006 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.063970    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:10:02.064170 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.064086    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:10:02.064170 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.064116    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:10:02.606519 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.606432    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp" event={"ID":"caf085d5-373d-4a00-a157-ec5894037b19","Type":"ContainerStarted","Data":"b4fa6f87f36cd649cb0125a81191b92acaa784aa9223288cb933b0224a736083"}
Jul 21 17:10:02.607091 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.607065    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp" event={"ID":"caf085d5-373d-4a00-a157-ec5894037b19","Type":"ContainerStarted","Data":"08830cb8cb28c70e349e1a094509bcac212fda31ccb3d828bfd62d4a54785d80"}
Jul 21 17:10:02.607231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.607215    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp" event={"ID":"caf085d5-373d-4a00-a157-ec5894037b19","Type":"ContainerStarted","Data":"c28a4652cb4d497b7a85c73921be8c9109accc522dbbfffd8362e2fb3dd717d1"}
Jul 21 17:10:02.611511 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.611485    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:10:02.632165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.632110    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp" podStartSLOduration=3.267230252 podStartE2EDuration="15.63208984s" totalImagesPullingTime="12.364859588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:02.630686178 +0000 UTC m=+105.176002395" watchObservedRunningTime="2026-07-21 17:10:02.63208984 +0000 UTC m=+105.177406057"
Jul 21 17:10:02.685695 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:02.685662    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c94ffd8d4-b8ghl"]
Jul 21 17:10:03.611300 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:03.611268    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:10:04.324239 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:04.324195    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:04.425486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:04.425450    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:05.066951 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:05.066911    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:05.166065 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:05.166026    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:07.126527 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:07.126497    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:07.231672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:07.231632    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:07.473117 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:07.473038    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:10:07.632496 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:07.632464    2557 generic.go:356] "Generic (PLEG): container finished" podID="17c3db0e-96fd-4e65-981c-66e6a4084dbe" containerID="27cbf386ecf76567839ab432b0b0d08f4703b4700ac3e11b8c408fc54172c145" exitCode=0
Jul 21 17:10:07.632676 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:07.632558    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x" event={"ID":"17c3db0e-96fd-4e65-981c-66e6a4084dbe","Type":"ContainerDied","Data":"27cbf386ecf76567839ab432b0b0d08f4703b4700ac3e11b8c408fc54172c145"}
Jul 21 17:10:07.632984 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:07.632960    2557 scope.go:117] "RemoveContainer" containerID="27cbf386ecf76567839ab432b0b0d08f4703b4700ac3e11b8c408fc54172c145"
Jul 21 17:10:07.722221 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:07.722188    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:07.822203 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:07.822168    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:08.116500 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:08.116462    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:08.174988 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:08.174953    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:08.639877 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:08.639834    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9w22x" event={"ID":"17c3db0e-96fd-4e65-981c-66e6a4084dbe","Type":"ContainerStarted","Data":"c16fba95d42ecb1623142b459135dfed5661750394ab145bd80ed4ee544345df"}
Jul 21 17:10:09.626152 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:09.626120    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64df46c956-w4vxp"
Jul 21 17:10:12.520439 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.520400    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk" podUID="976ca309-8734-445b-8dfb-fcf6093f1bb5" containerName="registry" containerID="cri-o://66c9fcee4e0ecd7e165f10a11cd3233713e834d03df64c90f7e38a69d7cf8718" gracePeriod=30
Jul 21 17:10:12.658530 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.658499    2557 generic.go:356] "Generic (PLEG): container finished" podID="976ca309-8734-445b-8dfb-fcf6093f1bb5" containerID="66c9fcee4e0ecd7e165f10a11cd3233713e834d03df64c90f7e38a69d7cf8718" exitCode=0
Jul 21 17:10:12.658651 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.658557    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk" event={"ID":"976ca309-8734-445b-8dfb-fcf6093f1bb5","Type":"ContainerDied","Data":"66c9fcee4e0ecd7e165f10a11cd3233713e834d03df64c90f7e38a69d7cf8718"}
Jul 21 17:10:12.799566 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.799498    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:10:12.897507 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.897471    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-image-registry-private-configuration\") pod \"976ca309-8734-445b-8dfb-fcf6093f1bb5\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") "
Jul 21 17:10:12.897507 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.897514    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-installation-pull-secrets\") pod \"976ca309-8734-445b-8dfb-fcf6093f1bb5\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") "
Jul 21 17:10:12.897763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.897545    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq2j8\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-kube-api-access-zq2j8\") pod \"976ca309-8734-445b-8dfb-fcf6093f1bb5\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") "
Jul 21 17:10:12.897763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.897574    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") pod \"976ca309-8734-445b-8dfb-fcf6093f1bb5\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") "
Jul 21 17:10:12.897763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.897599    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-trusted-ca\") pod \"976ca309-8734-445b-8dfb-fcf6093f1bb5\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") "
Jul 21 17:10:12.897763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.897622    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/976ca309-8734-445b-8dfb-fcf6093f1bb5-ca-trust-extracted\") pod \"976ca309-8734-445b-8dfb-fcf6093f1bb5\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") "
Jul 21 17:10:12.897763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.897690    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-certificates\") pod \"976ca309-8734-445b-8dfb-fcf6093f1bb5\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") "
Jul 21 17:10:12.898051 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.897763    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-bound-sa-token\") pod \"976ca309-8734-445b-8dfb-fcf6093f1bb5\" (UID: \"976ca309-8734-445b-8dfb-fcf6093f1bb5\") "
Jul 21 17:10:12.898225 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.898182    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "976ca309-8734-445b-8dfb-fcf6093f1bb5" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:10:12.898225 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.898208    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "976ca309-8734-445b-8dfb-fcf6093f1bb5" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:10:12.900469 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.900432    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "976ca309-8734-445b-8dfb-fcf6093f1bb5" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:10:12.900602 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.900469    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "976ca309-8734-445b-8dfb-fcf6093f1bb5" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:10:12.900602 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.900566    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-kube-api-access-zq2j8" (OuterVolumeSpecName: "kube-api-access-zq2j8") pod "976ca309-8734-445b-8dfb-fcf6093f1bb5" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5"). InnerVolumeSpecName "kube-api-access-zq2j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:10:12.900602 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.900568    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "976ca309-8734-445b-8dfb-fcf6093f1bb5" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:10:12.900718 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.900602    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "976ca309-8734-445b-8dfb-fcf6093f1bb5" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:10:12.907034 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.907010    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976ca309-8734-445b-8dfb-fcf6093f1bb5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "976ca309-8734-445b-8dfb-fcf6093f1bb5" (UID: "976ca309-8734-445b-8dfb-fcf6093f1bb5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:12.999158 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.999115    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-image-registry-private-configuration\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:12.999158 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.999150    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/976ca309-8734-445b-8dfb-fcf6093f1bb5-installation-pull-secrets\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:12.999158 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.999163    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq2j8\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-kube-api-access-zq2j8\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:12.999408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.999176    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-tls\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:12.999408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.999188    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-trusted-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:12.999408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.999199    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/976ca309-8734-445b-8dfb-fcf6093f1bb5-ca-trust-extracted\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:12.999408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.999212    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/976ca309-8734-445b-8dfb-fcf6093f1bb5-registry-certificates\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:12.999408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:12.999223    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/976ca309-8734-445b-8dfb-fcf6093f1bb5-bound-sa-token\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:13.664002 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:13.663963    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk" event={"ID":"976ca309-8734-445b-8dfb-fcf6093f1bb5","Type":"ContainerDied","Data":"6af0b4523bf98669b800848c3c618b088f410f975b47e58d36d76f25a0b446cd"}
Jul 21 17:10:13.664542 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:13.664027    2557 scope.go:117] "RemoveContainer" containerID="66c9fcee4e0ecd7e165f10a11cd3233713e834d03df64c90f7e38a69d7cf8718"
Jul 21 17:10:13.664542 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:13.663978    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc474dd6-jtqwk"
Jul 21 17:10:13.684651 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:13.684625    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dc474dd6-jtqwk"]
Jul 21 17:10:13.688454 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:13.688432    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dc474dd6-jtqwk"]
Jul 21 17:10:14.061491 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:14.061456    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="976ca309-8734-445b-8dfb-fcf6093f1bb5" path="/var/lib/kubelet/pods/976ca309-8734-445b-8dfb-fcf6093f1bb5/volumes"
Jul 21 17:10:17.682091 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:17.682055    2557 generic.go:356] "Generic (PLEG): container finished" podID="5d8a8927-d3b5-41f8-8007-bf6a84be1b2b" containerID="93528f8cd1e6dab5a96b2f8e375ef146470d39527bfad82b2e3b30599e91ccda" exitCode=0
Jul 21 17:10:17.682492 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:17.682127    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xjsbs" event={"ID":"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b","Type":"ContainerDied","Data":"93528f8cd1e6dab5a96b2f8e375ef146470d39527bfad82b2e3b30599e91ccda"}
Jul 21 17:10:17.682492 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:17.682480    2557 scope.go:117] "RemoveContainer" containerID="93528f8cd1e6dab5a96b2f8e375ef146470d39527bfad82b2e3b30599e91ccda"
Jul 21 17:10:18.688231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:18.688185    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xjsbs" event={"ID":"5d8a8927-d3b5-41f8-8007-bf6a84be1b2b","Type":"ContainerStarted","Data":"6fd64a9b97b5568427366dcba07689a51bffb4915ee2b59eb45abdba6c2c6aaf"}
Jul 21 17:10:20.091636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:20.091573    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:20.180049 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:20.180011    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:21.702656 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:21.702625    2557 generic.go:356] "Generic (PLEG): container finished" podID="ec1c3e14-09d1-45aa-9a91-617d9ed3a976" containerID="012632b8f8bd9cdd4761aba57bc16aae703d8a4fe847115c63bbcb4ae1ac4059" exitCode=0
Jul 21 17:10:21.703040 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:21.702683    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm" event={"ID":"ec1c3e14-09d1-45aa-9a91-617d9ed3a976","Type":"ContainerDied","Data":"012632b8f8bd9cdd4761aba57bc16aae703d8a4fe847115c63bbcb4ae1ac4059"}
Jul 21 17:10:21.703040 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:21.703024    2557 scope.go:117] "RemoveContainer" containerID="012632b8f8bd9cdd4761aba57bc16aae703d8a4fe847115c63bbcb4ae1ac4059"
Jul 21 17:10:22.708152 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:22.708113    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h8zcm" event={"ID":"ec1c3e14-09d1-45aa-9a91-617d9ed3a976","Type":"ContainerStarted","Data":"ac2e1115076836600a4111c6b91fddd24aab0c70a12cbc773d5c60e23ee89776"}
Jul 21 17:10:26.755507 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:26.755476    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:26.854122 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:26.854072    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:26.914785 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:26.914750    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:27.713912 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:27.713879    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c94ffd8d4-b8ghl" podUID="a61f0a91-6339-46c7-91de-90593ba43ad5" containerName="console" containerID="cri-o://02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4" gracePeriod=15
Jul 21 17:10:27.993862 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:27.993778    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:10:28.131422 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.131386    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-oauth-config\") pod \"a61f0a91-6339-46c7-91de-90593ba43ad5\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") "
Jul 21 17:10:28.131617 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.131447    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-oauth-serving-cert\") pod \"a61f0a91-6339-46c7-91de-90593ba43ad5\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") "
Jul 21 17:10:28.131617 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.131579    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-service-ca\") pod \"a61f0a91-6339-46c7-91de-90593ba43ad5\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") "
Jul 21 17:10:28.131740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.131654    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-serving-cert\") pod \"a61f0a91-6339-46c7-91de-90593ba43ad5\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") "
Jul 21 17:10:28.131740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.131690    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hlpg\" (UniqueName: \"kubernetes.io/projected/a61f0a91-6339-46c7-91de-90593ba43ad5-kube-api-access-8hlpg\") pod \"a61f0a91-6339-46c7-91de-90593ba43ad5\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") "
Jul 21 17:10:28.131740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.131727    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-console-config\") pod \"a61f0a91-6339-46c7-91de-90593ba43ad5\" (UID: \"a61f0a91-6339-46c7-91de-90593ba43ad5\") "
Jul 21 17:10:28.131929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.131843    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a61f0a91-6339-46c7-91de-90593ba43ad5" (UID: "a61f0a91-6339-46c7-91de-90593ba43ad5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:10:28.131986 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.131929    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-service-ca" (OuterVolumeSpecName: "service-ca") pod "a61f0a91-6339-46c7-91de-90593ba43ad5" (UID: "a61f0a91-6339-46c7-91de-90593ba43ad5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:10:28.132165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.132140    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-oauth-serving-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:28.132165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.132166    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:28.132285 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.132159    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-console-config" (OuterVolumeSpecName: "console-config") pod "a61f0a91-6339-46c7-91de-90593ba43ad5" (UID: "a61f0a91-6339-46c7-91de-90593ba43ad5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:10:28.133722 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.133694    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a61f0a91-6339-46c7-91de-90593ba43ad5" (UID: "a61f0a91-6339-46c7-91de-90593ba43ad5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:10:28.133841 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.133749    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a61f0a91-6339-46c7-91de-90593ba43ad5" (UID: "a61f0a91-6339-46c7-91de-90593ba43ad5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:10:28.133841 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.133750    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a61f0a91-6339-46c7-91de-90593ba43ad5-kube-api-access-8hlpg" (OuterVolumeSpecName: "kube-api-access-8hlpg") pod "a61f0a91-6339-46c7-91de-90593ba43ad5" (UID: "a61f0a91-6339-46c7-91de-90593ba43ad5"). InnerVolumeSpecName "kube-api-access-8hlpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:10:28.232757 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.232727    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hlpg\" (UniqueName: \"kubernetes.io/projected/a61f0a91-6339-46c7-91de-90593ba43ad5-kube-api-access-8hlpg\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:28.232757 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.232754    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a61f0a91-6339-46c7-91de-90593ba43ad5-console-config\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:28.232757 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.232763    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-oauth-config\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:28.233007 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.232771    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a61f0a91-6339-46c7-91de-90593ba43ad5-console-serving-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:10:28.731836 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.731777    2557 generic.go:356] "Generic (PLEG): container finished" podID="a61f0a91-6339-46c7-91de-90593ba43ad5" containerID="02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4" exitCode=0
Jul 21 17:10:28.731982 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.731843    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c94ffd8d4-b8ghl"
Jul 21 17:10:28.731982 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.731864    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c94ffd8d4-b8ghl" event={"ID":"a61f0a91-6339-46c7-91de-90593ba43ad5","Type":"ContainerDied","Data":"02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4"}
Jul 21 17:10:28.731982 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.731917    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c94ffd8d4-b8ghl" event={"ID":"a61f0a91-6339-46c7-91de-90593ba43ad5","Type":"ContainerDied","Data":"a5a4d761c6c7e76797d5c9dc4e906d244e239f07df2732cf5189eac09e0f7e7d"}
Jul 21 17:10:28.731982 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.731936    2557 scope.go:117] "RemoveContainer" containerID="02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4"
Jul 21 17:10:28.741218 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.741198    2557 scope.go:117] "RemoveContainer" containerID="02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4"
Jul 21 17:10:28.741500 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:10:28.741481    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4\": container with ID starting with 02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4 not found: ID does not exist" containerID="02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4"
Jul 21 17:10:28.741553 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.741511    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4"} err="failed to get container status \"02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4\": rpc error: code = NotFound desc = could not find container \"02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4\": container with ID starting with 02519b7a182ad4dd103b83780ec1511177377bfafac35b135aa002bd847c30c4 not found: ID does not exist"
Jul 21 17:10:28.755141 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.755120    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c94ffd8d4-b8ghl"]
Jul 21 17:10:28.757987 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:28.757969    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c94ffd8d4-b8ghl"]
Jul 21 17:10:30.060644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:30.060609    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a61f0a91-6339-46c7-91de-90593ba43ad5" path="/var/lib/kubelet/pods/a61f0a91-6339-46c7-91de-90593ba43ad5/volumes"
Jul 21 17:10:35.069269 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:35.069236    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:35.133072 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:35.133039    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:36.246471 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:10:36.246427    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:01.212636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:01.212596    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:01.441997 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:01.441947    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:04.043360 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:04.043331    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:04.145315 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:04.145275    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:06.923017 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.922985    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:11:06.923373 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.923287    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="976ca309-8734-445b-8dfb-fcf6093f1bb5" containerName="registry"
Jul 21 17:11:06.923373 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.923297    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="976ca309-8734-445b-8dfb-fcf6093f1bb5" containerName="registry"
Jul 21 17:11:06.923373 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.923307    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a61f0a91-6339-46c7-91de-90593ba43ad5" containerName="console"
Jul 21 17:11:06.923373 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.923312    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a61f0a91-6339-46c7-91de-90593ba43ad5" containerName="console"
Jul 21 17:11:06.923373 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.923374    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a61f0a91-6339-46c7-91de-90593ba43ad5" containerName="console"
Jul 21 17:11:06.923530 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.923382    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="976ca309-8734-445b-8dfb-fcf6093f1bb5" containerName="registry"
Jul 21 17:11:06.926693 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.926675    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:06.929277 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929251    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 17:11:06.929277 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929272    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 17:11:06.929520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929502    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 17:11:06.929668 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929585    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 17:11:06.929668 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929541    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 17:11:06.929668 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929577    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6dgjm\""
Jul 21 17:11:06.929844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929585    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 17:11:06.929844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929534    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 17:11:06.929844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.929613    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 17:11:06.935515 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.935495    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 17:11:06.945014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:06.944991    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:11:07.045000 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.044966    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045000 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045002    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045211 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045211 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045211 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-web-config\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045211 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045113    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52e85ff2-7bf2-48fa-bded-192ec43001b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045211 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52e85ff2-7bf2-48fa-bded-192ec43001b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045211 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045180    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045246    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vxzh\" (UniqueName: \"kubernetes.io/projected/52e85ff2-7bf2-48fa-bded-192ec43001b7-kube-api-access-2vxzh\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52e85ff2-7bf2-48fa-bded-192ec43001b7-config-out\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045331    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52e85ff2-7bf2-48fa-bded-192ec43001b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.045394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.045350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52e85ff2-7bf2-48fa-bded-192ec43001b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146526 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146487    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-web-config\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146526 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146525    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52e85ff2-7bf2-48fa-bded-192ec43001b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52e85ff2-7bf2-48fa-bded-192ec43001b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146578    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146602    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146625    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vxzh\" (UniqueName: \"kubernetes.io/projected/52e85ff2-7bf2-48fa-bded-192ec43001b7-kube-api-access-2vxzh\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146645    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52e85ff2-7bf2-48fa-bded-192ec43001b7-config-out\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146660    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52e85ff2-7bf2-48fa-bded-192ec43001b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52e85ff2-7bf2-48fa-bded-192ec43001b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.146775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.147264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.147264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.146828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.147377 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.147316    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52e85ff2-7bf2-48fa-bded-192ec43001b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.147377 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.147364    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52e85ff2-7bf2-48fa-bded-192ec43001b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.149839 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.149690    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.149839 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.149701    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.149839 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.149771    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.149839 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.149789    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-web-config\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.149839 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.149771    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52e85ff2-7bf2-48fa-bded-192ec43001b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.150228 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.150116    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.150281 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.150224    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.150421 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.150398    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52e85ff2-7bf2-48fa-bded-192ec43001b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.150546 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.150460    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52e85ff2-7bf2-48fa-bded-192ec43001b7-config-out\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.151697 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.151677    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52e85ff2-7bf2-48fa-bded-192ec43001b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.156231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.156207    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vxzh\" (UniqueName: \"kubernetes.io/projected/52e85ff2-7bf2-48fa-bded-192ec43001b7-kube-api-access-2vxzh\") pod \"alertmanager-main-0\" (UID: \"52e85ff2-7bf2-48fa-bded-192ec43001b7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.237190 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.237113    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:07.384520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.384486    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:11:07.388327 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:11:07.388294    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e85ff2_7bf2_48fa_bded_192ec43001b7.slice/crio-2a3c3430627734b66e4a2a2f966f23bb667d6124d4f27c8a84b0fe050a8bb592 WatchSource:0}: Error finding container 2a3c3430627734b66e4a2a2f966f23bb667d6124d4f27c8a84b0fe050a8bb592: Status 404 returned error can't find the container with id 2a3c3430627734b66e4a2a2f966f23bb667d6124d4f27c8a84b0fe050a8bb592
Jul 21 17:11:07.886646 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:07.886611    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52e85ff2-7bf2-48fa-bded-192ec43001b7","Type":"ContainerStarted","Data":"2a3c3430627734b66e4a2a2f966f23bb667d6124d4f27c8a84b0fe050a8bb592"}
Jul 21 17:11:08.892109 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:08.892075    2557 generic.go:356] "Generic (PLEG): container finished" podID="52e85ff2-7bf2-48fa-bded-192ec43001b7" containerID="612adb1d2fdff5c60d091d866cb3a36cc816d01d17e2bf44815f4c13f1446fa0" exitCode=0
Jul 21 17:11:08.892609 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:08.892169    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52e85ff2-7bf2-48fa-bded-192ec43001b7","Type":"ContainerDied","Data":"612adb1d2fdff5c60d091d866cb3a36cc816d01d17e2bf44815f4c13f1446fa0"}
Jul 21 17:11:09.063028 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.062990    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86c85674fb-w42w8"]
Jul 21 17:11:09.065477 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.065456    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.068425 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.068394    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 17:11:09.068550 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.068452    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 17:11:09.068550 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.068505    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 17:11:09.068550 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.068509    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 17:11:09.068824 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.068810    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9g4x9\""
Jul 21 17:11:09.069110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.069094    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 17:11:09.073580 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.073556    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 17:11:09.081995 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.081972    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86c85674fb-w42w8"]
Jul 21 17:11:09.167105 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.167024    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-telemeter-client-tls\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.167105 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.167057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.167105 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.167098    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-secret-telemeter-client\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.167328 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.167165    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvps4\" (UniqueName: \"kubernetes.io/projected/7cec437a-5761-4a17-a410-c5781d307c82-kube-api-access-cvps4\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.167328 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.167233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-serving-certs-ca-bundle\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.167328 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.167272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-metrics-client-ca\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.167328 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.167305    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-federate-client-tls\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.167448 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.167347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268100 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268020    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-serving-certs-ca-bundle\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268100 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268072    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-metrics-client-ca\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268100 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-federate-client-tls\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268172    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-telemeter-client-tls\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268196    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-secret-telemeter-client\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvps4\" (UniqueName: \"kubernetes.io/projected/7cec437a-5761-4a17-a410-c5781d307c82-kube-api-access-cvps4\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.268934 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.268905    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-serving-certs-ca-bundle\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.269090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.269067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.269202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.269149    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cec437a-5761-4a17-a410-c5781d307c82-metrics-client-ca\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.270875 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.270850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-secret-telemeter-client\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.270985 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.270965    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-federate-client-tls\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.271026 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.271008    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.271098 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.271080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7cec437a-5761-4a17-a410-c5781d307c82-telemeter-client-tls\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.277663 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.277642    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvps4\" (UniqueName: \"kubernetes.io/projected/7cec437a-5761-4a17-a410-c5781d307c82-kube-api-access-cvps4\") pod \"telemeter-client-86c85674fb-w42w8\" (UID: \"7cec437a-5761-4a17-a410-c5781d307c82\") " pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.376716 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.376683    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8"
Jul 21 17:11:09.528019 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.527992    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86c85674fb-w42w8"]
Jul 21 17:11:09.529215 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:11:09.529185    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cec437a_5761_4a17_a410_c5781d307c82.slice/crio-d16e5771f086f80dec45d22aaff621175a7a69fd9f7b1912020a8191509f9a06 WatchSource:0}: Error finding container d16e5771f086f80dec45d22aaff621175a7a69fd9f7b1912020a8191509f9a06: Status 404 returned error can't find the container with id d16e5771f086f80dec45d22aaff621175a7a69fd9f7b1912020a8191509f9a06
Jul 21 17:11:09.898004 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:09.897970    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8" event={"ID":"7cec437a-5761-4a17-a410-c5781d307c82","Type":"ContainerStarted","Data":"d16e5771f086f80dec45d22aaff621175a7a69fd9f7b1912020a8191509f9a06"}
Jul 21 17:11:10.906764 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:10.906677    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52e85ff2-7bf2-48fa-bded-192ec43001b7","Type":"ContainerStarted","Data":"4f9b86ffbfda57a7dc02d549b3f459e3dba2aa0db3386519f28fe6b94c7c888b"}
Jul 21 17:11:10.906764 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:10.906756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52e85ff2-7bf2-48fa-bded-192ec43001b7","Type":"ContainerStarted","Data":"34693e3ac9070a1405d4fd073ddfa3dcd254e1835a2371082a2c8c47344ec506"}
Jul 21 17:11:10.907254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:10.906826    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52e85ff2-7bf2-48fa-bded-192ec43001b7","Type":"ContainerStarted","Data":"70564e849ad0b5f7a209ec3bb308dc88ec28a0b4dfe4fbb443997b96ddedf0fd"}
Jul 21 17:11:10.907254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:10.906867    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52e85ff2-7bf2-48fa-bded-192ec43001b7","Type":"ContainerStarted","Data":"671841f3061e392415c3e2da21a06bf3faf8924f2c6467b0e8ff35c5cc35af6c"}
Jul 21 17:11:10.907254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:10.906893    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52e85ff2-7bf2-48fa-bded-192ec43001b7","Type":"ContainerStarted","Data":"ff4bd4328ec7e0613044545105a5075a2869af5760e213102da7893689d69778"}
Jul 21 17:11:10.907254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:10.906920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52e85ff2-7bf2-48fa-bded-192ec43001b7","Type":"ContainerStarted","Data":"56d675391b43a8879b8e84954b01c64a2155a44aeb02b395aa88eaba41330092"}
Jul 21 17:11:10.940700 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:10.940644    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4790174130000002 podStartE2EDuration="4.940626278s" totalImagesPullingTime="2.440936421s" totalInitContainerRuntime="20.672444ms" isStatefulPod=false podCreationTimestamp="2026-07-21 17:11:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:11:10.939456433 +0000 UTC m=+173.484772674" watchObservedRunningTime="2026-07-21 17:11:10.940626278 +0000 UTC m=+173.485942494"
Jul 21 17:11:12.917331 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:12.917297    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8" event={"ID":"7cec437a-5761-4a17-a410-c5781d307c82","Type":"ContainerStarted","Data":"a03ea3ddac4339fc27d7159810067880ee1b0c812c40817a52f4c6a6a0e717b6"}
Jul 21 17:11:12.917714 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:12.917359    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8" event={"ID":"7cec437a-5761-4a17-a410-c5781d307c82","Type":"ContainerStarted","Data":"bde828fd9cbcb3d340772f173276ab46e964463a5da10bbc08b453c9a3b0038b"}
Jul 21 17:11:12.917714 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:12.917377    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8" event={"ID":"7cec437a-5761-4a17-a410-c5781d307c82","Type":"ContainerStarted","Data":"4553a88dacb2f0eb94a06a0cf355a6864dbfb69c00e1637419d9b3a3d5089126"}
Jul 21 17:11:12.943016 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:12.942972    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86c85674fb-w42w8" podStartSLOduration=1.540976776 podStartE2EDuration="3.942957678s" totalImagesPullingTime="2.401980902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:11:12.942687456 +0000 UTC m=+175.488003673" watchObservedRunningTime="2026-07-21 17:11:12.942957678 +0000 UTC m=+175.488273893"
Jul 21 17:11:13.662949 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.662907    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fbd8f9656-6fhgw"]
Jul 21 17:11:13.665576 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.665555    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.682939 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.682915    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbd8f9656-6fhgw"]
Jul 21 17:11:13.737869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.737840    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:13.808822 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.808765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-serving-cert\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.808984 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.808835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-service-ca\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.808984 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.808860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjsbz\" (UniqueName: \"kubernetes.io/projected/41a55adb-a655-4d65-83fa-0cb906c470c9-kube-api-access-hjsbz\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.808984 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.808888    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-oauth-serving-cert\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.809090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.809038    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-trusted-ca-bundle\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.809090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.809083    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-console-config\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.809153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.809107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-oauth-config\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.910212 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.910168    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-oauth-serving-cert\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.910392 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.910256    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-trusted-ca-bundle\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.910392 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.910291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-console-config\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.910392 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.910317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-oauth-config\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.910392 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.910351    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-serving-cert\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.910392 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.910372    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-service-ca\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.910639 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.910393    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjsbz\" (UniqueName: \"kubernetes.io/projected/41a55adb-a655-4d65-83fa-0cb906c470c9-kube-api-access-hjsbz\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.911111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.911082    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-console-config\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.911111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.911109    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-service-ca\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.911278 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.911128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-oauth-serving-cert\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.911278 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.911156    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-trusted-ca-bundle\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.913287 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.913247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-oauth-config\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.913472 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.913450    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-serving-cert\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.919530 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.919509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjsbz\" (UniqueName: \"kubernetes.io/projected/41a55adb-a655-4d65-83fa-0cb906c470c9-kube-api-access-hjsbz\") pod \"console-fbd8f9656-6fhgw\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") " pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:13.974636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:13.974604    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:14.102998 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:14.102970    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbd8f9656-6fhgw"]
Jul 21 17:11:14.105148 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:11:14.105124    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a55adb_a655_4d65_83fa_0cb906c470c9.slice/crio-dab26a043f00650441c4a76ed0aa9a9a00992c8c959d7f0b378cb6967076f759 WatchSource:0}: Error finding container dab26a043f00650441c4a76ed0aa9a9a00992c8c959d7f0b378cb6967076f759: Status 404 returned error can't find the container with id dab26a043f00650441c4a76ed0aa9a9a00992c8c959d7f0b378cb6967076f759
Jul 21 17:11:14.933231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:14.933196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbd8f9656-6fhgw" event={"ID":"41a55adb-a655-4d65-83fa-0cb906c470c9","Type":"ContainerStarted","Data":"6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7"}
Jul 21 17:11:14.933598 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:14.933269    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbd8f9656-6fhgw" event={"ID":"41a55adb-a655-4d65-83fa-0cb906c470c9","Type":"ContainerStarted","Data":"dab26a043f00650441c4a76ed0aa9a9a00992c8c959d7f0b378cb6967076f759"}
Jul 21 17:11:14.956439 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:14.956376    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fbd8f9656-6fhgw" podStartSLOduration=1.956360549 podStartE2EDuration="1.956360549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:11:14.954867643 +0000 UTC m=+177.500183861" watchObservedRunningTime="2026-07-21 17:11:14.956360549 +0000 UTC m=+177.501676764"
Jul 21 17:11:23.975624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:23.975587    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:23.976027 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:23.975650    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:23.980543 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:23.980519    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:24.979541 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:24.979515    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:11:25.042293 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:25.042259    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776578bc4-bqcm5"]
Jul 21 17:11:25.172238 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:25.172204    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:25.273139 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:25.273107    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:25.339380 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:25.339355    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:49.028183 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:49.028135    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:50.071719 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.071650    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-776578bc4-bqcm5" podUID="38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" containerName="console" containerID="cri-o://d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae" gracePeriod=15
Jul 21 17:11:50.318630 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.318606    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:11:50.401147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401066    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-config\") pod \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") "
Jul 21 17:11:50.401147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401100    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-oauth-serving-cert\") pod \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") "
Jul 21 17:11:50.401147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401126    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-service-ca\") pod \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") "
Jul 21 17:11:50.401365 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401168    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-oauth-config\") pod \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") "
Jul 21 17:11:50.401365 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401201    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59zk4\" (UniqueName: \"kubernetes.io/projected/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-kube-api-access-59zk4\") pod \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") "
Jul 21 17:11:50.401457 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401363    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-trusted-ca-bundle\") pod \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") "
Jul 21 17:11:50.401457 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401408    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-serving-cert\") pod \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\" (UID: \"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06\") "
Jul 21 17:11:50.401559 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401506    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" (UID: "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:50.401618 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401554    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-config" (OuterVolumeSpecName: "console-config") pod "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" (UID: "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:50.401618 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401562    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-service-ca" (OuterVolumeSpecName: "service-ca") pod "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" (UID: "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:50.401871 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401849    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-config\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:11:50.401871 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401873    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-oauth-serving-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:11:50.402041 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401883    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:11:50.402041 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.401832    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" (UID: "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:50.403330 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.403297    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-kube-api-access-59zk4" (OuterVolumeSpecName: "kube-api-access-59zk4") pod "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" (UID: "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06"). InnerVolumeSpecName "kube-api-access-59zk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:50.403420 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.403408    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" (UID: "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:50.403461 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.403437    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" (UID: "38741f2c-1ec9-4caa-bb24-8ceb95ba6e06"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:50.503075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.503036    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-oauth-config\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:11:50.503075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.503069    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59zk4\" (UniqueName: \"kubernetes.io/projected/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-kube-api-access-59zk4\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:11:50.503075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.503078    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-trusted-ca-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:11:50.503312 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:50.503088    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06-console-serving-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:11:51.086888 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.086855    2557 generic.go:356] "Generic (PLEG): container finished" podID="38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" containerID="d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae" exitCode=0
Jul 21 17:11:51.087332 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.086901    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776578bc4-bqcm5"
Jul 21 17:11:51.087332 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.086905    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776578bc4-bqcm5" event={"ID":"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06","Type":"ContainerDied","Data":"d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae"}
Jul 21 17:11:51.087332 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.086952    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776578bc4-bqcm5" event={"ID":"38741f2c-1ec9-4caa-bb24-8ceb95ba6e06","Type":"ContainerDied","Data":"a0fb968fdd4132b2cae53722ea278f91d220afed2dff31575e5ddfa69fd03622"}
Jul 21 17:11:51.087332 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.086979    2557 scope.go:117] "RemoveContainer" containerID="d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae"
Jul 21 17:11:51.095970 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.095950    2557 scope.go:117] "RemoveContainer" containerID="d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae"
Jul 21 17:11:51.096221 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:11:51.096200    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae\": container with ID starting with d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae not found: ID does not exist" containerID="d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae"
Jul 21 17:11:51.096283 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.096230    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae"} err="failed to get container status \"d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae\": rpc error: code = NotFound desc = could not find container \"d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae\": container with ID starting with d74ab526d8a929d146b6dc97d1dd813eace86368993367d2fabdee14170ffdae not found: ID does not exist"
Jul 21 17:11:51.109844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.109819    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776578bc4-bqcm5"]
Jul 21 17:11:51.115884 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:51.115865    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-776578bc4-bqcm5"]
Jul 21 17:11:52.061234 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:11:52.061200    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" path="/var/lib/kubelet/pods/38741f2c-1ec9-4caa-bb24-8ceb95ba6e06/volumes"
Jul 21 17:12:19.206882 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:19.206853    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:19.264277 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:19.264247    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:23.743440 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.743406    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9d95fbfb-x9ftd"]
Jul 21 17:12:23.744023 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.744001    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" containerName="console"
Jul 21 17:12:23.744100 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.744025    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" containerName="console"
Jul 21 17:12:23.744153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.744138    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="38741f2c-1ec9-4caa-bb24-8ceb95ba6e06" containerName="console"
Jul 21 17:12:23.748531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.748511    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.758529 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.758504    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9d95fbfb-x9ftd"]
Jul 21 17:12:23.802059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.802018    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:23.863686 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.863656    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:23.886836 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.886776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-oauth-config\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.886950 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.886844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-service-ca\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.886950 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.886870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwkrz\" (UniqueName: \"kubernetes.io/projected/14fa0420-e041-4970-b2bb-73b017ac107c-kube-api-access-fwkrz\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.886950 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.886911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-serving-cert\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.887043 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.886987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-trusted-ca-bundle\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.887073 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.887054    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-console-config\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.887114 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.887076    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-oauth-serving-cert\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.988468 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.988422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-trusted-ca-bundle\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.988782 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.988750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-console-config\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.988890 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.988828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-oauth-serving-cert\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.988947 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.988899    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-oauth-config\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.988947 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.988938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-service-ca\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.989053 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.988963    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwkrz\" (UniqueName: \"kubernetes.io/projected/14fa0420-e041-4970-b2bb-73b017ac107c-kube-api-access-fwkrz\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.989053 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.989011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-serving-cert\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.991589 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.990604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-console-config\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.991589 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.991530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-oauth-serving-cert\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.994929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.992172    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-serving-cert\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.994929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.992447    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-trusted-ca-bundle\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.995435 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.995357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-oauth-config\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.995740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.995721    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-service-ca\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:23.999082 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:23.999059    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwkrz\" (UniqueName: \"kubernetes.io/projected/14fa0420-e041-4970-b2bb-73b017ac107c-kube-api-access-fwkrz\") pod \"console-6f9d95fbfb-x9ftd\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") " pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:24.058921 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:24.058896    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:24.185909 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:24.185710    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9d95fbfb-x9ftd"]
Jul 21 17:12:24.188547 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:12:24.188511    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fa0420_e041_4970_b2bb_73b017ac107c.slice/crio-4094a580b63b243828d25acd359c151da471ee7f0e105cced900aec9466655cd WatchSource:0}: Error finding container 4094a580b63b243828d25acd359c151da471ee7f0e105cced900aec9466655cd: Status 404 returned error can't find the container with id 4094a580b63b243828d25acd359c151da471ee7f0e105cced900aec9466655cd
Jul 21 17:12:24.227547 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:24.227518    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9d95fbfb-x9ftd" event={"ID":"14fa0420-e041-4970-b2bb-73b017ac107c","Type":"ContainerStarted","Data":"4094a580b63b243828d25acd359c151da471ee7f0e105cced900aec9466655cd"}
Jul 21 17:12:25.232610 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:25.232578    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9d95fbfb-x9ftd" event={"ID":"14fa0420-e041-4970-b2bb-73b017ac107c","Type":"ContainerStarted","Data":"e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719"}
Jul 21 17:12:25.254060 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:25.254016    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9d95fbfb-x9ftd" podStartSLOduration=2.254000296 podStartE2EDuration="2.254000296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:12:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:12:25.253098812 +0000 UTC m=+247.798415044" watchObservedRunningTime="2026-07-21 17:12:25.254000296 +0000 UTC m=+247.799316519"
Jul 21 17:12:31.276149 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:31.276116    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:31.373720 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:31.373687    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:34.061270 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:34.061239    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:34.061640 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:34.061286    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:34.063911 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:34.063894    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:34.273584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:34.273544    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:12:34.328078 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:34.328001    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fbd8f9656-6fhgw"]
Jul 21 17:12:34.438752 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:34.438719    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:34.492188 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:34.492153    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:34.561661 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:34.561629    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:35.087316 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:35.087270    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:35.187153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:35.187109    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:59.357685 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.357646    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fbd8f9656-6fhgw" podUID="41a55adb-a655-4d65-83fa-0cb906c470c9" containerName="console" containerID="cri-o://6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7" gracePeriod=15
Jul 21 17:12:59.600849 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.600826    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:12:59.701934 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.701843    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-trusted-ca-bundle\") pod \"41a55adb-a655-4d65-83fa-0cb906c470c9\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") "
Jul 21 17:12:59.701934 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.701893    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-serving-cert\") pod \"41a55adb-a655-4d65-83fa-0cb906c470c9\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") "
Jul 21 17:12:59.701934 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.701911    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-oauth-serving-cert\") pod \"41a55adb-a655-4d65-83fa-0cb906c470c9\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") "
Jul 21 17:12:59.702209 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702027    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-oauth-config\") pod \"41a55adb-a655-4d65-83fa-0cb906c470c9\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") "
Jul 21 17:12:59.702209 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702144    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-service-ca\") pod \"41a55adb-a655-4d65-83fa-0cb906c470c9\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") "
Jul 21 17:12:59.702209 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702177    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjsbz\" (UniqueName: \"kubernetes.io/projected/41a55adb-a655-4d65-83fa-0cb906c470c9-kube-api-access-hjsbz\") pod \"41a55adb-a655-4d65-83fa-0cb906c470c9\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") "
Jul 21 17:12:59.702209 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702200    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-console-config\") pod \"41a55adb-a655-4d65-83fa-0cb906c470c9\" (UID: \"41a55adb-a655-4d65-83fa-0cb906c470c9\") "
Jul 21 17:12:59.702417 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702286    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "41a55adb-a655-4d65-83fa-0cb906c470c9" (UID: "41a55adb-a655-4d65-83fa-0cb906c470c9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:12:59.702469 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702440    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41a55adb-a655-4d65-83fa-0cb906c470c9" (UID: "41a55adb-a655-4d65-83fa-0cb906c470c9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:12:59.702522 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702498    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-service-ca" (OuterVolumeSpecName: "service-ca") pod "41a55adb-a655-4d65-83fa-0cb906c470c9" (UID: "41a55adb-a655-4d65-83fa-0cb906c470c9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:12:59.702581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702556    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-console-config" (OuterVolumeSpecName: "console-config") pod "41a55adb-a655-4d65-83fa-0cb906c470c9" (UID: "41a55adb-a655-4d65-83fa-0cb906c470c9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:12:59.702635 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702599    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:12:59.702635 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702612    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-trusted-ca-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:12:59.702635 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.702622    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-oauth-serving-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:12:59.704202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.704175    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41a55adb-a655-4d65-83fa-0cb906c470c9" (UID: "41a55adb-a655-4d65-83fa-0cb906c470c9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:12:59.704202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.704190    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41a55adb-a655-4d65-83fa-0cb906c470c9" (UID: "41a55adb-a655-4d65-83fa-0cb906c470c9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:12:59.704355 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.704224    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a55adb-a655-4d65-83fa-0cb906c470c9-kube-api-access-hjsbz" (OuterVolumeSpecName: "kube-api-access-hjsbz") pod "41a55adb-a655-4d65-83fa-0cb906c470c9" (UID: "41a55adb-a655-4d65-83fa-0cb906c470c9"). InnerVolumeSpecName "kube-api-access-hjsbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:12:59.803264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.803228    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-oauth-config\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:12:59.803264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.803255    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjsbz\" (UniqueName: \"kubernetes.io/projected/41a55adb-a655-4d65-83fa-0cb906c470c9-kube-api-access-hjsbz\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:12:59.803264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.803265    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41a55adb-a655-4d65-83fa-0cb906c470c9-console-config\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:12:59.803481 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:12:59.803274    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41a55adb-a655-4d65-83fa-0cb906c470c9-console-serving-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:13:00.376957 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.376864    2557 generic.go:356] "Generic (PLEG): container finished" podID="41a55adb-a655-4d65-83fa-0cb906c470c9" containerID="6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7" exitCode=0
Jul 21 17:13:00.376957 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.376910    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbd8f9656-6fhgw"
Jul 21 17:13:00.377396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.376950    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbd8f9656-6fhgw" event={"ID":"41a55adb-a655-4d65-83fa-0cb906c470c9","Type":"ContainerDied","Data":"6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7"}
Jul 21 17:13:00.377396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.377001    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbd8f9656-6fhgw" event={"ID":"41a55adb-a655-4d65-83fa-0cb906c470c9","Type":"ContainerDied","Data":"dab26a043f00650441c4a76ed0aa9a9a00992c8c959d7f0b378cb6967076f759"}
Jul 21 17:13:00.377396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.377021    2557 scope.go:117] "RemoveContainer" containerID="6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7"
Jul 21 17:13:00.385337 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.385322    2557 scope.go:117] "RemoveContainer" containerID="6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7"
Jul 21 17:13:00.385593 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:13:00.385576    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7\": container with ID starting with 6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7 not found: ID does not exist" containerID="6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7"
Jul 21 17:13:00.385658 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.385606    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7"} err="failed to get container status \"6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7\": rpc error: code = NotFound desc = could not find container \"6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7\": container with ID starting with 6256ea33333ae925e77cddbde4886ebcdf6d565d0df5589b1cc63efa874535a7 not found: ID does not exist"
Jul 21 17:13:00.393633 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.393611    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fbd8f9656-6fhgw"]
Jul 21 17:13:00.397359 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:00.397339    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fbd8f9656-6fhgw"]
Jul 21 17:13:02.061870 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:02.061838    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41a55adb-a655-4d65-83fa-0cb906c470c9" path="/var/lib/kubelet/pods/41a55adb-a655-4d65-83fa-0cb906c470c9/volumes"
Jul 21 17:13:17.874082 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:17.874056    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:13:17.884357 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:17.884328    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 17:13:17.887034 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:17.887014    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:13:20.995442 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:20.995404    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:22.821548 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:22.821508    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:30.322685 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:30.322641    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:30.423072 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:13:30.423031    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:07.080041 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.080005    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"]
Jul 21 17:15:07.080530 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.080346    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a55adb-a655-4d65-83fa-0cb906c470c9" containerName="console"
Jul 21 17:15:07.080530 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.080357    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a55adb-a655-4d65-83fa-0cb906c470c9" containerName="console"
Jul 21 17:15:07.080530 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.080428    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="41a55adb-a655-4d65-83fa-0cb906c470c9" containerName="console"
Jul 21 17:15:07.083510 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.083494    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.086090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.086066    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzt5p\""
Jul 21 17:15:07.086195 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.086157    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 17:15:07.087017 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.087000    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 17:15:07.095526 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.095503    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkchp\" (UniqueName: \"kubernetes.io/projected/56c1717b-6d62-45be-8b61-50f8241fe9bc-kube-api-access-nkchp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.095643 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.095628    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.095684 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.095653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.101707 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.101684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"]
Jul 21 17:15:07.196882 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.196849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkchp\" (UniqueName: \"kubernetes.io/projected/56c1717b-6d62-45be-8b61-50f8241fe9bc-kube-api-access-nkchp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.197071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.196898    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.197071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.196930    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.197244 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.197223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.197297 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.197250    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.207341 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.207315    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkchp\" (UniqueName: \"kubernetes.io/projected/56c1717b-6d62-45be-8b61-50f8241fe9bc-kube-api-access-nkchp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.393572 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.393490    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:07.529323 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.529296    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"]
Jul 21 17:15:07.530878 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:15:07.530854    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c1717b_6d62_45be_8b61_50f8241fe9bc.slice/crio-677d565312b949af5ec3b6ce02d77550b248fbb889e84abe810af3ae8a8be682 WatchSource:0}: Error finding container 677d565312b949af5ec3b6ce02d77550b248fbb889e84abe810af3ae8a8be682: Status 404 returned error can't find the container with id 677d565312b949af5ec3b6ce02d77550b248fbb889e84abe810af3ae8a8be682
Jul 21 17:15:07.532866 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.532849    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:15:07.899193 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:07.899156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86" event={"ID":"56c1717b-6d62-45be-8b61-50f8241fe9bc","Type":"ContainerStarted","Data":"677d565312b949af5ec3b6ce02d77550b248fbb889e84abe810af3ae8a8be682"}
Jul 21 17:15:15.943347 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:15.943308    2557 generic.go:356] "Generic (PLEG): container finished" podID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerID="49498508ac15d326ee5e9925881796d7f9f627f67700919ef367ff04ffb17843" exitCode=0
Jul 21 17:15:15.943823 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:15.943358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86" event={"ID":"56c1717b-6d62-45be-8b61-50f8241fe9bc","Type":"ContainerDied","Data":"49498508ac15d326ee5e9925881796d7f9f627f67700919ef367ff04ffb17843"}
Jul 21 17:15:18.958995 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:18.958911    2557 generic.go:356] "Generic (PLEG): container finished" podID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerID="c175186d1bce0f4547ad83571fb565bdc89f25644f1186e6227c5f1784f08453" exitCode=0
Jul 21 17:15:18.959332 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:18.958999    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86" event={"ID":"56c1717b-6d62-45be-8b61-50f8241fe9bc","Type":"ContainerDied","Data":"c175186d1bce0f4547ad83571fb565bdc89f25644f1186e6227c5f1784f08453"}
Jul 21 17:15:27.004080 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:27.004046    2557 generic.go:356] "Generic (PLEG): container finished" podID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerID="fdc7525377cc3eebd52aca719c4095ca6c7f5fb79c777071ba91254961c0d746" exitCode=0
Jul 21 17:15:27.004434 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:27.004120    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86" event={"ID":"56c1717b-6d62-45be-8b61-50f8241fe9bc","Type":"ContainerDied","Data":"fdc7525377cc3eebd52aca719c4095ca6c7f5fb79c777071ba91254961c0d746"}
Jul 21 17:15:28.144570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.144548    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:28.292435 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.292357    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-util\") pod \"56c1717b-6d62-45be-8b61-50f8241fe9bc\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") "
Jul 21 17:15:28.292435 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.292434    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-bundle\") pod \"56c1717b-6d62-45be-8b61-50f8241fe9bc\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") "
Jul 21 17:15:28.292677 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.292484    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkchp\" (UniqueName: \"kubernetes.io/projected/56c1717b-6d62-45be-8b61-50f8241fe9bc-kube-api-access-nkchp\") pod \"56c1717b-6d62-45be-8b61-50f8241fe9bc\" (UID: \"56c1717b-6d62-45be-8b61-50f8241fe9bc\") "
Jul 21 17:15:28.293158 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.293134    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-bundle" (OuterVolumeSpecName: "bundle") pod "56c1717b-6d62-45be-8b61-50f8241fe9bc" (UID: "56c1717b-6d62-45be-8b61-50f8241fe9bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:15:28.294771 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.294746    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56c1717b-6d62-45be-8b61-50f8241fe9bc-kube-api-access-nkchp" (OuterVolumeSpecName: "kube-api-access-nkchp") pod "56c1717b-6d62-45be-8b61-50f8241fe9bc" (UID: "56c1717b-6d62-45be-8b61-50f8241fe9bc"). InnerVolumeSpecName "kube-api-access-nkchp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:15:28.296648 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.296628    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-util" (OuterVolumeSpecName: "util") pod "56c1717b-6d62-45be-8b61-50f8241fe9bc" (UID: "56c1717b-6d62-45be-8b61-50f8241fe9bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:15:28.393555 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.393519    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:15:28.393555 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.393552    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkchp\" (UniqueName: \"kubernetes.io/projected/56c1717b-6d62-45be-8b61-50f8241fe9bc-kube-api-access-nkchp\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:15:28.393555 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:28.393562    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c1717b-6d62-45be-8b61-50f8241fe9bc-util\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:15:29.014635 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:29.014595    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86" event={"ID":"56c1717b-6d62-45be-8b61-50f8241fe9bc","Type":"ContainerDied","Data":"677d565312b949af5ec3b6ce02d77550b248fbb889e84abe810af3ae8a8be682"}
Jul 21 17:15:29.014814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:29.014641    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tc86"
Jul 21 17:15:29.014814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:29.014667    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="677d565312b949af5ec3b6ce02d77550b248fbb889e84abe810af3ae8a8be682"
Jul 21 17:15:33.579474 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:33.579443    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:34.693896 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:34.693864    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:35.585911 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.585882    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"]
Jul 21 17:15:35.586255 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.586245    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerName="extract"
Jul 21 17:15:35.586298 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.586258    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerName="extract"
Jul 21 17:15:35.586298 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.586280    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerName="util"
Jul 21 17:15:35.586298 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.586287    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerName="util"
Jul 21 17:15:35.586298 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.586297    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerName="pull"
Jul 21 17:15:35.586432 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.586302    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerName="pull"
Jul 21 17:15:35.586432 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.586353    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="56c1717b-6d62-45be-8b61-50f8241fe9bc" containerName="extract"
Jul 21 17:15:35.591110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.591094    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"
Jul 21 17:15:35.594819 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.594786    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:15:35.595944 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.595921    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wrj6t\""
Jul 21 17:15:35.595944 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.595924    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 17:15:35.618443 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.618422    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"]
Jul 21 17:15:35.760164 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.760130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5b4h\" (UniqueName: \"kubernetes.io/projected/badb0ab3-a057-45f4-80d8-163e754d5a42-kube-api-access-s5b4h\") pod \"cert-manager-operator-controller-manager-55c444bf86-l67mw\" (UID: \"badb0ab3-a057-45f4-80d8-163e754d5a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"
Jul 21 17:15:35.760524 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.760203    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/badb0ab3-a057-45f4-80d8-163e754d5a42-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l67mw\" (UID: \"badb0ab3-a057-45f4-80d8-163e754d5a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"
Jul 21 17:15:35.861663 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.861581    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/badb0ab3-a057-45f4-80d8-163e754d5a42-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l67mw\" (UID: \"badb0ab3-a057-45f4-80d8-163e754d5a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"
Jul 21 17:15:35.861663 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.861645    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5b4h\" (UniqueName: \"kubernetes.io/projected/badb0ab3-a057-45f4-80d8-163e754d5a42-kube-api-access-s5b4h\") pod \"cert-manager-operator-controller-manager-55c444bf86-l67mw\" (UID: \"badb0ab3-a057-45f4-80d8-163e754d5a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"
Jul 21 17:15:35.862019 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.861998    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/badb0ab3-a057-45f4-80d8-163e754d5a42-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l67mw\" (UID: \"badb0ab3-a057-45f4-80d8-163e754d5a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"
Jul 21 17:15:35.871165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.871143    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5b4h\" (UniqueName: \"kubernetes.io/projected/badb0ab3-a057-45f4-80d8-163e754d5a42-kube-api-access-s5b4h\") pod \"cert-manager-operator-controller-manager-55c444bf86-l67mw\" (UID: \"badb0ab3-a057-45f4-80d8-163e754d5a42\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"
Jul 21 17:15:35.900695 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:35.900674    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"
Jul 21 17:15:36.054685 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:36.054656    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw"]
Jul 21 17:15:36.057428 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:15:36.057397    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadb0ab3_a057_45f4_80d8_163e754d5a42.slice/crio-9cd5955e2497538cee746f113d54327ac2c4383d9dac489ce71e156213766cf8 WatchSource:0}: Error finding container 9cd5955e2497538cee746f113d54327ac2c4383d9dac489ce71e156213766cf8: Status 404 returned error can't find the container with id 9cd5955e2497538cee746f113d54327ac2c4383d9dac489ce71e156213766cf8
Jul 21 17:15:37.049702 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:37.049664    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw" event={"ID":"badb0ab3-a057-45f4-80d8-163e754d5a42","Type":"ContainerStarted","Data":"9cd5955e2497538cee746f113d54327ac2c4383d9dac489ce71e156213766cf8"}
Jul 21 17:15:37.420010 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:37.419928    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:37.519871 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:37.519842    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:41.075328 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:41.075293    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw" event={"ID":"badb0ab3-a057-45f4-80d8-163e754d5a42","Type":"ContainerStarted","Data":"a04973554718901a8b629a07ef6119c743b95a38f7e881ff30b61029176bb530"}
Jul 21 17:15:41.099832 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:41.099771    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l67mw" podStartSLOduration=1.292888266 podStartE2EDuration="6.099752744s" totalImagesPullingTime="4.806864478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:41.097353648 +0000 UTC m=+443.642669865" watchObservedRunningTime="2026-07-21 17:15:41.099752744 +0000 UTC m=+443.645068963"
Jul 21 17:15:41.635233 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:41.635200    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:41.820400 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:41.820367    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:41.963790 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:41.963701    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:42.053369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.053334    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:42.657507 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.657475    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"]
Jul 21 17:15:42.661238 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.661215    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.664110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.664089    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 17:15:42.664239 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.664089    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 17:15:42.664972 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.664958    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzt5p\""
Jul 21 17:15:42.670638 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.670616    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"]
Jul 21 17:15:42.824737 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.824705    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.824930 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.824750    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.824930 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.824782    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl78j\" (UniqueName: \"kubernetes.io/projected/9fa57b1a-4cc9-4859-8812-59f4584557df-kube-api-access-tl78j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.926263 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.926165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.926263 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.926223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.926495 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.926267    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl78j\" (UniqueName: \"kubernetes.io/projected/9fa57b1a-4cc9-4859-8812-59f4584557df-kube-api-access-tl78j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.926646 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.926621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.926705 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.926634    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.938519 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.938489    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl78j\" (UniqueName: \"kubernetes.io/projected/9fa57b1a-4cc9-4859-8812-59f4584557df-kube-api-access-tl78j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:42.971066 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:42.971039    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:43.101388 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:43.101366    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"]
Jul 21 17:15:43.103184 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:15:43.103159    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa57b1a_4cc9_4859_8812_59f4584557df.slice/crio-cf84052150c3a74872f30614145ccafd369a5a74c806114011c03d0919932cb6 WatchSource:0}: Error finding container cf84052150c3a74872f30614145ccafd369a5a74c806114011c03d0919932cb6: Status 404 returned error can't find the container with id cf84052150c3a74872f30614145ccafd369a5a74c806114011c03d0919932cb6
Jul 21 17:15:43.200968 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:43.200943    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:43.260048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:43.260009    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:44.094872 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:44.094839    2557 generic.go:356] "Generic (PLEG): container finished" podID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerID="fcddded648b6aa5090c80ce2665a04a5cefc05a61f07c6c0452314e6141c94c7" exitCode=0
Jul 21 17:15:44.095339 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:44.094923    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss" event={"ID":"9fa57b1a-4cc9-4859-8812-59f4584557df","Type":"ContainerDied","Data":"fcddded648b6aa5090c80ce2665a04a5cefc05a61f07c6c0452314e6141c94c7"}
Jul 21 17:15:44.095339 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:44.095018    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss" event={"ID":"9fa57b1a-4cc9-4859-8812-59f4584557df","Type":"ContainerStarted","Data":"cf84052150c3a74872f30614145ccafd369a5a74c806114011c03d0919932cb6"}
Jul 21 17:15:44.300272 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:44.300245    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:44.527026 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:44.526980    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:47.112448 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:47.112412    2557 generic.go:356] "Generic (PLEG): container finished" podID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerID="642c025d2ac1230ae65b65fbc9807a32cf02e391543b8a1ea220a1e72be531fb" exitCode=0
Jul 21 17:15:47.112853 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:47.112501    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss" event={"ID":"9fa57b1a-4cc9-4859-8812-59f4584557df","Type":"ContainerDied","Data":"642c025d2ac1230ae65b65fbc9807a32cf02e391543b8a1ea220a1e72be531fb"}
Jul 21 17:15:48.118304 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.118269    2557 generic.go:356] "Generic (PLEG): container finished" podID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerID="01679968c2cf7969bc01768c25642c910ca5aeb133687afe4220dd854259e922" exitCode=0
Jul 21 17:15:48.118675 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.118313    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss" event={"ID":"9fa57b1a-4cc9-4859-8812-59f4584557df","Type":"ContainerDied","Data":"01679968c2cf7969bc01768c25642c910ca5aeb133687afe4220dd854259e922"}
Jul 21 17:15:48.146942 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.146916    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xqfzq"]
Jul 21 17:15:48.150038 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.150024    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:48.155962 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.155941    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 17:15:48.156151 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.156137    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 17:15:48.157151 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.157132    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bm2v6\""
Jul 21 17:15:48.168760 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.168740    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xqfzq"]
Jul 21 17:15:48.172435 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.172413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c045be33-cf45-43e1-af1d-785ba5876c2a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xqfzq\" (UID: \"c045be33-cf45-43e1-af1d-785ba5876c2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:48.172535 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.172467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sswjj\" (UniqueName: \"kubernetes.io/projected/c045be33-cf45-43e1-af1d-785ba5876c2a-kube-api-access-sswjj\") pod \"cert-manager-webhook-6486ffd997-xqfzq\" (UID: \"c045be33-cf45-43e1-af1d-785ba5876c2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:48.273043 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.273013    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sswjj\" (UniqueName: \"kubernetes.io/projected/c045be33-cf45-43e1-af1d-785ba5876c2a-kube-api-access-sswjj\") pod \"cert-manager-webhook-6486ffd997-xqfzq\" (UID: \"c045be33-cf45-43e1-af1d-785ba5876c2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:48.273252 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.273080    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c045be33-cf45-43e1-af1d-785ba5876c2a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xqfzq\" (UID: \"c045be33-cf45-43e1-af1d-785ba5876c2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:48.281210 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.281169    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c045be33-cf45-43e1-af1d-785ba5876c2a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xqfzq\" (UID: \"c045be33-cf45-43e1-af1d-785ba5876c2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:48.281434 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.281415    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sswjj\" (UniqueName: \"kubernetes.io/projected/c045be33-cf45-43e1-af1d-785ba5876c2a-kube-api-access-sswjj\") pod \"cert-manager-webhook-6486ffd997-xqfzq\" (UID: \"c045be33-cf45-43e1-af1d-785ba5876c2a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:48.473868 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.473769    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:48.605202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:48.605180    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xqfzq"]
Jul 21 17:15:48.607522 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:15:48.607496    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc045be33_cf45_43e1_af1d_785ba5876c2a.slice/crio-0d387696d0c5cb8214ee68f1f7ba7150f554a23b10f0ae8d3d72e967a19b5135 WatchSource:0}: Error finding container 0d387696d0c5cb8214ee68f1f7ba7150f554a23b10f0ae8d3d72e967a19b5135: Status 404 returned error can't find the container with id 0d387696d0c5cb8214ee68f1f7ba7150f554a23b10f0ae8d3d72e967a19b5135
Jul 21 17:15:49.123627 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.123593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq" event={"ID":"c045be33-cf45-43e1-af1d-785ba5876c2a","Type":"ContainerStarted","Data":"0d387696d0c5cb8214ee68f1f7ba7150f554a23b10f0ae8d3d72e967a19b5135"}
Jul 21 17:15:49.238848 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.238823    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:49.282025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.281994    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-util\") pod \"9fa57b1a-4cc9-4859-8812-59f4584557df\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") "
Jul 21 17:15:49.282193 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.282088    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tl78j\" (UniqueName: \"kubernetes.io/projected/9fa57b1a-4cc9-4859-8812-59f4584557df-kube-api-access-tl78j\") pod \"9fa57b1a-4cc9-4859-8812-59f4584557df\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") "
Jul 21 17:15:49.282193 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.282124    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-bundle\") pod \"9fa57b1a-4cc9-4859-8812-59f4584557df\" (UID: \"9fa57b1a-4cc9-4859-8812-59f4584557df\") "
Jul 21 17:15:49.282865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.282838    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-bundle" (OuterVolumeSpecName: "bundle") pod "9fa57b1a-4cc9-4859-8812-59f4584557df" (UID: "9fa57b1a-4cc9-4859-8812-59f4584557df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:15:49.285189 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.285144    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa57b1a-4cc9-4859-8812-59f4584557df-kube-api-access-tl78j" (OuterVolumeSpecName: "kube-api-access-tl78j") pod "9fa57b1a-4cc9-4859-8812-59f4584557df" (UID: "9fa57b1a-4cc9-4859-8812-59f4584557df"). InnerVolumeSpecName "kube-api-access-tl78j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:15:49.288871 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.288828    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-util" (OuterVolumeSpecName: "util") pod "9fa57b1a-4cc9-4859-8812-59f4584557df" (UID: "9fa57b1a-4cc9-4859-8812-59f4584557df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:15:49.382997 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.382918    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-util\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:15:49.382997 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.382951    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl78j\" (UniqueName: \"kubernetes.io/projected/9fa57b1a-4cc9-4859-8812-59f4584557df-kube-api-access-tl78j\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:15:49.382997 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:49.382961    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa57b1a-4cc9-4859-8812-59f4584557df-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:15:50.132190 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:50.132145    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss" event={"ID":"9fa57b1a-4cc9-4859-8812-59f4584557df","Type":"ContainerDied","Data":"cf84052150c3a74872f30614145ccafd369a5a74c806114011c03d0919932cb6"}
Jul 21 17:15:50.132612 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:50.132207    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf84052150c3a74872f30614145ccafd369a5a74c806114011c03d0919932cb6"
Jul 21 17:15:50.132612 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:50.132288    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdhjss"
Jul 21 17:15:51.816492 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:51.816460    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:51.920250 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:51.920215    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:52.146060 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:52.145983    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq" event={"ID":"c045be33-cf45-43e1-af1d-785ba5876c2a","Type":"ContainerStarted","Data":"94534029f3d1a18a63c5deacadc06d52ba077548255f58dcc674483e745406e0"}
Jul 21 17:15:52.146225 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:52.146107    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:52.166039 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:52.165996    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq" podStartSLOduration=1.550994444 podStartE2EDuration="4.16598195s" totalImagesPullingTime="2.614987506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:52.16399014 +0000 UTC m=+454.709306357" watchObservedRunningTime="2026-07-21 17:15:52.16598195 +0000 UTC m=+454.711298166"
Jul 21 17:15:53.140487 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.140449    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9fpts"]
Jul 21 17:15:53.140998 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.140979    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerName="extract"
Jul 21 17:15:53.141066 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.141001    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerName="extract"
Jul 21 17:15:53.141066 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.141024    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerName="util"
Jul 21 17:15:53.141066 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.141033    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerName="util"
Jul 21 17:15:53.141066 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.141058    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerName="pull"
Jul 21 17:15:53.141066 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.141066    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerName="pull"
Jul 21 17:15:53.141308 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.141162    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa57b1a-4cc9-4859-8812-59f4584557df" containerName="extract"
Jul 21 17:15:53.145406 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.145384    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9fpts"
Jul 21 17:15:53.147904 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.147886    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hcds5\""
Jul 21 17:15:53.157390 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.157367    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9fpts"]
Jul 21 17:15:53.217567 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.217538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96366b24-6d6a-4c8b-bf37-4bae584d7194-bound-sa-token\") pod \"cert-manager-55b4d954d5-9fpts\" (UID: \"96366b24-6d6a-4c8b-bf37-4bae584d7194\") " pod="cert-manager/cert-manager-55b4d954d5-9fpts"
Jul 21 17:15:53.217688 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.217590    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsb5g\" (UniqueName: \"kubernetes.io/projected/96366b24-6d6a-4c8b-bf37-4bae584d7194-kube-api-access-qsb5g\") pod \"cert-manager-55b4d954d5-9fpts\" (UID: \"96366b24-6d6a-4c8b-bf37-4bae584d7194\") " pod="cert-manager/cert-manager-55b4d954d5-9fpts"
Jul 21 17:15:53.232863 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.232836    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"]
Jul 21 17:15:53.237067 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.237052    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"
Jul 21 17:15:53.239539 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.239521    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 17:15:53.239633 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.239619    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ntfqw\""
Jul 21 17:15:53.239709 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.239661    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:15:53.244814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.244784    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"]
Jul 21 17:15:53.318453 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.318422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsb5g\" (UniqueName: \"kubernetes.io/projected/96366b24-6d6a-4c8b-bf37-4bae584d7194-kube-api-access-qsb5g\") pod \"cert-manager-55b4d954d5-9fpts\" (UID: \"96366b24-6d6a-4c8b-bf37-4bae584d7194\") " pod="cert-manager/cert-manager-55b4d954d5-9fpts"
Jul 21 17:15:53.318600 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.318462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ncvcp\" (UID: \"fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"
Jul 21 17:15:53.318600 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.318509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjpd8\" (UniqueName: \"kubernetes.io/projected/fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898-kube-api-access-fjpd8\") pod \"openshift-lws-operator-fd8ccff4c-ncvcp\" (UID: \"fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"
Jul 21 17:15:53.318600 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.318547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96366b24-6d6a-4c8b-bf37-4bae584d7194-bound-sa-token\") pod \"cert-manager-55b4d954d5-9fpts\" (UID: \"96366b24-6d6a-4c8b-bf37-4bae584d7194\") " pod="cert-manager/cert-manager-55b4d954d5-9fpts"
Jul 21 17:15:53.327653 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.327629    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96366b24-6d6a-4c8b-bf37-4bae584d7194-bound-sa-token\") pod \"cert-manager-55b4d954d5-9fpts\" (UID: \"96366b24-6d6a-4c8b-bf37-4bae584d7194\") " pod="cert-manager/cert-manager-55b4d954d5-9fpts"
Jul 21 17:15:53.327869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.327850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsb5g\" (UniqueName: \"kubernetes.io/projected/96366b24-6d6a-4c8b-bf37-4bae584d7194-kube-api-access-qsb5g\") pod \"cert-manager-55b4d954d5-9fpts\" (UID: \"96366b24-6d6a-4c8b-bf37-4bae584d7194\") " pod="cert-manager/cert-manager-55b4d954d5-9fpts"
Jul 21 17:15:53.419659 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.419547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ncvcp\" (UID: \"fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"
Jul 21 17:15:53.419832 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.419662    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjpd8\" (UniqueName: \"kubernetes.io/projected/fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898-kube-api-access-fjpd8\") pod \"openshift-lws-operator-fd8ccff4c-ncvcp\" (UID: \"fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"
Jul 21 17:15:53.419992 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.419972    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ncvcp\" (UID: \"fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"
Jul 21 17:15:53.428932 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.428904    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjpd8\" (UniqueName: \"kubernetes.io/projected/fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898-kube-api-access-fjpd8\") pod \"openshift-lws-operator-fd8ccff4c-ncvcp\" (UID: \"fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"
Jul 21 17:15:53.454664 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.454638    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9fpts"
Jul 21 17:15:53.547142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.547102    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"
Jul 21 17:15:53.583676 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.583649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9fpts"]
Jul 21 17:15:53.585409 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:15:53.585382    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96366b24_6d6a_4c8b_bf37_4bae584d7194.slice/crio-9685cfaa5998a8a041e68f1775c39cd070c27ddc35eeceda8ca82c8646408dd0 WatchSource:0}: Error finding container 9685cfaa5998a8a041e68f1775c39cd070c27ddc35eeceda8ca82c8646408dd0: Status 404 returned error can't find the container with id 9685cfaa5998a8a041e68f1775c39cd070c27ddc35eeceda8ca82c8646408dd0
Jul 21 17:15:53.688942 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:53.688914    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp"]
Jul 21 17:15:53.690814 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:15:53.690774    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc4cb18c_4c3d_4eba_ab51_df9ab3e0e898.slice/crio-2e6320b7d2bd31967175b61fc7f61db23d87fbbc6ae6b4f39f04c7778eacdf0e WatchSource:0}: Error finding container 2e6320b7d2bd31967175b61fc7f61db23d87fbbc6ae6b4f39f04c7778eacdf0e: Status 404 returned error can't find the container with id 2e6320b7d2bd31967175b61fc7f61db23d87fbbc6ae6b4f39f04c7778eacdf0e
Jul 21 17:15:54.156601 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:54.156564    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp" event={"ID":"fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898","Type":"ContainerStarted","Data":"2e6320b7d2bd31967175b61fc7f61db23d87fbbc6ae6b4f39f04c7778eacdf0e"}
Jul 21 17:15:54.158046 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:54.158023    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9fpts" event={"ID":"96366b24-6d6a-4c8b-bf37-4bae584d7194","Type":"ContainerStarted","Data":"a494355dd6db1b8501dbfbebb7ef0286cd78646063900f0fa0803615b43659d5"}
Jul 21 17:15:54.158144 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:54.158055    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9fpts" event={"ID":"96366b24-6d6a-4c8b-bf37-4bae584d7194","Type":"ContainerStarted","Data":"9685cfaa5998a8a041e68f1775c39cd070c27ddc35eeceda8ca82c8646408dd0"}
Jul 21 17:15:54.174786 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:54.174743    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9fpts" podStartSLOduration=1.174727885 podStartE2EDuration="1.174727885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:54.17420586 +0000 UTC m=+456.719522077" watchObservedRunningTime="2026-07-21 17:15:54.174727885 +0000 UTC m=+456.720044100"
Jul 21 17:15:56.170346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:56.170312    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp" event={"ID":"fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898","Type":"ContainerStarted","Data":"f8798d13fd0cff93f429e9cdaae9791adaf57970e4810348a35289f995306b47"}
Jul 21 17:15:56.187978 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:56.187923    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ncvcp" podStartSLOduration=1.3994246000000001 podStartE2EDuration="3.187903636s" totalImagesPullingTime="1.788479036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:56.185988833 +0000 UTC m=+458.731305049" watchObservedRunningTime="2026-07-21 17:15:56.187903636 +0000 UTC m=+458.733219850"
Jul 21 17:15:56.887252 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:56.887223    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:56.987443 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:56.987403    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:58.152830 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.152793    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xqfzq"
Jul 21 17:15:58.512418 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.512385    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"]
Jul 21 17:15:58.559201 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.559172    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"]
Jul 21 17:15:58.559334 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.559269    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.562052 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.562024    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 17:15:58.562191 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.562066    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 17:15:58.562191 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.562075    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzt5p\""
Jul 21 17:15:58.665167 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.665127    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbqw\" (UniqueName: \"kubernetes.io/projected/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-kube-api-access-2nbqw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.665307 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.665179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.665342 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.665296    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.766486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.766409    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.766486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.766465    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbqw\" (UniqueName: \"kubernetes.io/projected/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-kube-api-access-2nbqw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.766645 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.766500    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.766820 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.766776    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.766881 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.766861    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.775071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.775042    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbqw\" (UniqueName: \"kubernetes.io/projected/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-kube-api-access-2nbqw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:58.869348 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:58.869312    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:15:59.021566 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:59.021491    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"]
Jul 21 17:15:59.024596 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:15:59.024571    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c4d258_3bfa_4dbc_b33e_42bfd9d63003.slice/crio-10adf1b82b41c0fce97b7e31d34dd74303ca836505e9aac6b33e880b0db041d8 WatchSource:0}: Error finding container 10adf1b82b41c0fce97b7e31d34dd74303ca836505e9aac6b33e880b0db041d8: Status 404 returned error can't find the container with id 10adf1b82b41c0fce97b7e31d34dd74303ca836505e9aac6b33e880b0db041d8
Jul 21 17:15:59.186940 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:59.186910    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd" event={"ID":"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003","Type":"ContainerStarted","Data":"10798dcd469c9c1a0d1d4c7d99ca602a2da3556f00a7e918313c04a552ef95a8"}
Jul 21 17:15:59.187265 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:59.186959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd" event={"ID":"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003","Type":"ContainerStarted","Data":"10adf1b82b41c0fce97b7e31d34dd74303ca836505e9aac6b33e880b0db041d8"}
Jul 21 17:15:59.236304 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:15:59.236274    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:00.193514 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:00.193431    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerID="10798dcd469c9c1a0d1d4c7d99ca602a2da3556f00a7e918313c04a552ef95a8" exitCode=0
Jul 21 17:16:00.193514 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:00.193500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd" event={"ID":"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003","Type":"ContainerDied","Data":"10798dcd469c9c1a0d1d4c7d99ca602a2da3556f00a7e918313c04a552ef95a8"}
Jul 21 17:16:02.207189 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:02.207158    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd" event={"ID":"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003","Type":"ContainerStarted","Data":"3d3f6fa8fe7e093de4276d10f01cc5e70a0b91475beab8991bbbaf6a4dc27de6"}
Jul 21 17:16:03.219886 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:03.219851    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerID="3d3f6fa8fe7e093de4276d10f01cc5e70a0b91475beab8991bbbaf6a4dc27de6" exitCode=0
Jul 21 17:16:03.219886 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:03.219882    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerID="28bb45045712152a924a86c655c37b497b4be9a1cd0dc8c0aa6d7fb16bfd6396" exitCode=0
Jul 21 17:16:03.220289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:03.219922    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd" event={"ID":"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003","Type":"ContainerDied","Data":"3d3f6fa8fe7e093de4276d10f01cc5e70a0b91475beab8991bbbaf6a4dc27de6"}
Jul 21 17:16:03.220289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:03.220011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd" event={"ID":"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003","Type":"ContainerDied","Data":"28bb45045712152a924a86c655c37b497b4be9a1cd0dc8c0aa6d7fb16bfd6396"}
Jul 21 17:16:04.353474 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.353452    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:16:04.416732 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.416698    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-util\") pod \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") "
Jul 21 17:16:04.416732 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.416735    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nbqw\" (UniqueName: \"kubernetes.io/projected/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-kube-api-access-2nbqw\") pod \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") "
Jul 21 17:16:04.416942 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.416772    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-bundle\") pod \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\" (UID: \"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003\") "
Jul 21 17:16:04.417501 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.417471    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-bundle" (OuterVolumeSpecName: "bundle") pod "c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" (UID: "c5c4d258-3bfa-4dbc-b33e-42bfd9d63003"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:16:04.418841 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.418814    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-kube-api-access-2nbqw" (OuterVolumeSpecName: "kube-api-access-2nbqw") pod "c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" (UID: "c5c4d258-3bfa-4dbc-b33e-42bfd9d63003"). InnerVolumeSpecName "kube-api-access-2nbqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:16:04.488132 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.488056    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-util" (OuterVolumeSpecName: "util") pod "c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" (UID: "c5c4d258-3bfa-4dbc-b33e-42bfd9d63003"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:16:04.518409 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.518382    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-util\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:04.518409 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.518407    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nbqw\" (UniqueName: \"kubernetes.io/projected/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-kube-api-access-2nbqw\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:04.518620 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:04.518418    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c4d258-3bfa-4dbc-b33e-42bfd9d63003-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:05.230972 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:05.230941    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd"
Jul 21 17:16:05.231167 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:05.230936    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw44jd" event={"ID":"c5c4d258-3bfa-4dbc-b33e-42bfd9d63003","Type":"ContainerDied","Data":"10adf1b82b41c0fce97b7e31d34dd74303ca836505e9aac6b33e880b0db041d8"}
Jul 21 17:16:05.231167 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:05.231058    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10adf1b82b41c0fce97b7e31d34dd74303ca836505e9aac6b33e880b0db041d8"
Jul 21 17:16:09.918220 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:09.918178    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:10.020382 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:10.020338    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:15.499581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:15.499549    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:15.636188 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:15.636157    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:15.792041 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:15.791979    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:16.478996 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.478963    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:16.729768 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.729687    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:16.845524 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.845465    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:16.946458 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.946431    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"]
Jul 21 17:16:16.946832 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.946818    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerName="extract"
Jul 21 17:16:16.946888 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.946834    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerName="extract"
Jul 21 17:16:16.946888 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.946843    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerName="util"
Jul 21 17:16:16.946888 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.946848    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerName="util"
Jul 21 17:16:16.946888 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.946863    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerName="pull"
Jul 21 17:16:16.946888 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.946868    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerName="pull"
Jul 21 17:16:16.947054 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.946931    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5c4d258-3bfa-4dbc-b33e-42bfd9d63003" containerName="extract"
Jul 21 17:16:16.950090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.950074    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:16.954636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.954610    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 17:16:16.954789 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.954652    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 17:16:16.954789 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.954686    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 17:16:16.962264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.962243    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 17:16:16.963157 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.963134    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m8pfx\""
Jul 21 17:16:16.975282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:16.975250    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"]
Jul 21 17:16:17.027243 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.027216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l452\" (UniqueName: \"kubernetes.io/projected/c9ae3577-b618-4eaa-abe2-2121f4f72b93-kube-api-access-5l452\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.027416 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.027275    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ae3577-b618-4eaa-abe2-2121f4f72b93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.027416 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.027336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ae3577-b618-4eaa-abe2-2121f4f72b93-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.027541 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.027421    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ae3577-b618-4eaa-abe2-2121f4f72b93-manifests\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.027541 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.027467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ae3577-b618-4eaa-abe2-2121f4f72b93-tmp\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.128591 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.128557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l452\" (UniqueName: \"kubernetes.io/projected/c9ae3577-b618-4eaa-abe2-2121f4f72b93-kube-api-access-5l452\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.128770 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.128631    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ae3577-b618-4eaa-abe2-2121f4f72b93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.128770 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.128667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ae3577-b618-4eaa-abe2-2121f4f72b93-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.128770 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.128706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ae3577-b618-4eaa-abe2-2121f4f72b93-manifests\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.128770 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.128733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ae3577-b618-4eaa-abe2-2121f4f72b93-tmp\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.129192 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.129171    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ae3577-b618-4eaa-abe2-2121f4f72b93-manifests\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.130917 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.130895    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ae3577-b618-4eaa-abe2-2121f4f72b93-tmp\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.131151 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.131133    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ae3577-b618-4eaa-abe2-2121f4f72b93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.131216 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.131150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ae3577-b618-4eaa-abe2-2121f4f72b93-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.148657 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.148629    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l452\" (UniqueName: \"kubernetes.io/projected/c9ae3577-b618-4eaa-abe2-2121f4f72b93-kube-api-access-5l452\") pod \"opendatahub-operator-controller-manager-65b498688-jbqh9\" (UID: \"c9ae3577-b618-4eaa-abe2-2121f4f72b93\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.229811 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.229769    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:17.260963 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.260936    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:17.332409 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.332376    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:17.412389 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.412364    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"]
Jul 21 17:16:17.413828 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:16:17.413784    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ae3577_b618_4eaa_abe2_2121f4f72b93.slice/crio-eb389438bad4145444c048ee70542de5f3b6b0e04c3b5d2d7cb5bd8e1d0a5a98 WatchSource:0}: Error finding container eb389438bad4145444c048ee70542de5f3b6b0e04c3b5d2d7cb5bd8e1d0a5a98: Status 404 returned error can't find the container with id eb389438bad4145444c048ee70542de5f3b6b0e04c3b5d2d7cb5bd8e1d0a5a98
Jul 21 17:16:17.425605 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:17.425578    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:18.042850 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:18.042791    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:18.152642 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:18.152612    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:18.295384 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:18.295300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9" event={"ID":"c9ae3577-b618-4eaa-abe2-2121f4f72b93","Type":"ContainerStarted","Data":"eb389438bad4145444c048ee70542de5f3b6b0e04c3b5d2d7cb5bd8e1d0a5a98"}
Jul 21 17:16:18.866658 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:18.866109    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f9b57567d-fn7kb"]
Jul 21 17:16:18.870225 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:18.870202    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:18.883613 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:18.883558    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9b57567d-fn7kb"]
Jul 21 17:16:18.928574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:18.928542    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:19.017256 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.017212    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:19.046509 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.046474    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-trusted-ca-bundle\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.047014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.046541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-oauth-serving-cert\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.047014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.046586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-console-config\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.047014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.046612    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-service-ca\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.047014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.046682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd31a091-7984-4f50-8898-8cfc030e5366-console-oauth-config\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.047014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.046759    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd31a091-7984-4f50-8898-8cfc030e5366-console-serving-cert\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.047014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.046783    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wctrf\" (UniqueName: \"kubernetes.io/projected/cd31a091-7984-4f50-8898-8cfc030e5366-kube-api-access-wctrf\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.148214 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.148128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-oauth-serving-cert\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.148214 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.148180    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-console-config\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.148214 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.148205    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-service-ca\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.148500 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.148261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd31a091-7984-4f50-8898-8cfc030e5366-console-oauth-config\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.148500 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.148367    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd31a091-7984-4f50-8898-8cfc030e5366-console-serving-cert\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.148500 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.148391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wctrf\" (UniqueName: \"kubernetes.io/projected/cd31a091-7984-4f50-8898-8cfc030e5366-kube-api-access-wctrf\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.148500 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.148433    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-trusted-ca-bundle\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.149065 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.149005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-console-config\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.149065 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.149005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-oauth-serving-cert\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.149255 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.149182    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-service-ca\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.149330 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.149310    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd31a091-7984-4f50-8898-8cfc030e5366-trusted-ca-bundle\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.151386 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.151359    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd31a091-7984-4f50-8898-8cfc030e5366-console-serving-cert\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.151495 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.151424    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd31a091-7984-4f50-8898-8cfc030e5366-console-oauth-config\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.166228 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.166198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wctrf\" (UniqueName: \"kubernetes.io/projected/cd31a091-7984-4f50-8898-8cfc030e5366-kube-api-access-wctrf\") pod \"console-f9b57567d-fn7kb\" (UID: \"cd31a091-7984-4f50-8898-8cfc030e5366\") " pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.184755 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.184733    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:19.376555 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:19.376526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9b57567d-fn7kb"]
Jul 21 17:16:19.378791 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:16:19.378756    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd31a091_7984_4f50_8898_8cfc030e5366.slice/crio-e744c9c9b09db288b90e2db4e7a5e80c52d10deb3279f6a59928bfc2d727034c WatchSource:0}: Error finding container e744c9c9b09db288b90e2db4e7a5e80c52d10deb3279f6a59928bfc2d727034c: Status 404 returned error can't find the container with id e744c9c9b09db288b90e2db4e7a5e80c52d10deb3279f6a59928bfc2d727034c
Jul 21 17:16:20.313165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:20.313125    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b57567d-fn7kb" event={"ID":"cd31a091-7984-4f50-8898-8cfc030e5366","Type":"ContainerStarted","Data":"0354840d784bbb1ed130e32531958f8db6161c4fd582f27eb789f31ada2a0d50"}
Jul 21 17:16:20.313581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:20.313204    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b57567d-fn7kb" event={"ID":"cd31a091-7984-4f50-8898-8cfc030e5366","Type":"ContainerStarted","Data":"e744c9c9b09db288b90e2db4e7a5e80c52d10deb3279f6a59928bfc2d727034c"}
Jul 21 17:16:20.342099 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:20.341928    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f9b57567d-fn7kb" podStartSLOduration=2.341908958 podStartE2EDuration="2.341908958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:20.341380465 +0000 UTC m=+482.886696682" watchObservedRunningTime="2026-07-21 17:16:20.341908958 +0000 UTC m=+482.887225176"
Jul 21 17:16:21.475409 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:21.475378    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:21.575992 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:21.575947    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:22.325244 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:22.325207    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9" event={"ID":"c9ae3577-b618-4eaa-abe2-2121f4f72b93","Type":"ContainerStarted","Data":"b662bb86f3e09616ad6ac898c1a5a55deade6ea3763a86484b7963eee625402e"}
Jul 21 17:16:23.332095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:23.332061    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9ae3577-b618-4eaa-abe2-2121f4f72b93" containerID="b662bb86f3e09616ad6ac898c1a5a55deade6ea3763a86484b7963eee625402e" exitCode=0
Jul 21 17:16:23.332577 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:23.332199    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9" event={"ID":"c9ae3577-b618-4eaa-abe2-2121f4f72b93","Type":"ContainerDied","Data":"b662bb86f3e09616ad6ac898c1a5a55deade6ea3763a86484b7963eee625402e"}
Jul 21 17:16:24.339006 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:24.338973    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9" event={"ID":"c9ae3577-b618-4eaa-abe2-2121f4f72b93","Type":"ContainerStarted","Data":"9cc59264f2a4f9077a2038400bc9dcd614e93b1259eb15305df825a21ead0277"}
Jul 21 17:16:24.339684 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:24.339056    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:24.367337 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:24.367291    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9" podStartSLOduration=3.056813935 podStartE2EDuration="8.367274898s" totalImagesPullingTime="4.258165133s" totalInitContainerRuntime="1.05229583s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:24.366418042 +0000 UTC m=+486.911734258" watchObservedRunningTime="2026-07-21 17:16:24.367274898 +0000 UTC m=+486.912591111"
Jul 21 17:16:28.407264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:28.407226    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:28.508619 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:28.508558    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:29.185271 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:29.185239    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:29.185474 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:29.185304    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:29.189879 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:29.189855    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:29.366860 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:29.366833    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f9b57567d-fn7kb"
Jul 21 17:16:29.422864 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:29.422835    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9d95fbfb-x9ftd"]
Jul 21 17:16:29.556754 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:29.556718    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:29.662268 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:29.662240    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:29.755772 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:29.755740    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:35.346167 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:35.346138    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-jbqh9"
Jul 21 17:16:38.550947 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.550911    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:38.650750 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.650689    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:38.799531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.799493    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-589694fdcc-g598v"]
Jul 21 17:16:38.802604 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.802540    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:38.808108 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.808093    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.811308 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.811288    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 17:16:38.811916 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.811902    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 17:16:38.834428 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.834405    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-665zv\" (UniqueName: \"kubernetes.io/projected/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-kube-api-access-665zv\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.834533 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.834514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-tmp\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.834620 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.834595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-tls-certs\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.867540 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.867509    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-589694fdcc-g598v"]
Jul 21 17:16:38.935589 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.935554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-665zv\" (UniqueName: \"kubernetes.io/projected/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-kube-api-access-665zv\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.935740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.935608    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-tmp\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.935740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.935650    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-tls-certs\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.938048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.938012    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-tmp\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.938154 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.938091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-tls-certs\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:38.948907 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:38.948882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-665zv\" (UniqueName: \"kubernetes.io/projected/a5b33372-5b1a-4b1f-84c5-a0b859f57c0f-kube-api-access-665zv\") pod \"kube-auth-proxy-589694fdcc-g598v\" (UID: \"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:39.021860 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.021831    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:39.117546 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.117463    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v"
Jul 21 17:16:39.269225 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.269199    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-589694fdcc-g598v"]
Jul 21 17:16:39.270448 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:16:39.270423    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b33372_5b1a_4b1f_84c5_a0b859f57c0f.slice/crio-49abfa3abc87bff6af1715fcc277512251789140528331af4941a595b4a8a5aa WatchSource:0}: Error finding container 49abfa3abc87bff6af1715fcc277512251789140528331af4941a595b4a8a5aa: Status 404 returned error can't find the container with id 49abfa3abc87bff6af1715fcc277512251789140528331af4941a595b4a8a5aa
Jul 21 17:16:39.408084 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.407993    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-grs4z"]
Jul 21 17:16:39.412844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.412813    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:39.415484 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.415458    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 21 17:16:39.415639 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.415542    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zhq26\""
Jul 21 17:16:39.418200 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.418177    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v" event={"ID":"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f","Type":"ContainerStarted","Data":"49abfa3abc87bff6af1715fcc277512251789140528331af4941a595b4a8a5aa"}
Jul 21 17:16:39.423865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.423845    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-grs4z"]
Jul 21 17:16:39.440448 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.440422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pglx8\" (UniqueName: \"kubernetes.io/projected/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-kube-api-access-pglx8\") pod \"odh-model-controller-7998c67dc4-grs4z\" (UID: \"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268\") " pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:39.440566 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.440549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-cert\") pod \"odh-model-controller-7998c67dc4-grs4z\" (UID: \"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268\") " pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:39.462075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.462050    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:39.541789 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.541739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pglx8\" (UniqueName: \"kubernetes.io/projected/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-kube-api-access-pglx8\") pod \"odh-model-controller-7998c67dc4-grs4z\" (UID: \"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268\") " pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:39.541998 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.541897    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-cert\") pod \"odh-model-controller-7998c67dc4-grs4z\" (UID: \"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268\") " pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:39.541998 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:16:39.541987    2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 21 17:16:39.542117 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:16:39.542036    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-cert podName:a5d0173d-18d7-4c2a-8fd4-d4d5cacea268 nodeName:}" failed. No retries permitted until 2026-07-21 17:16:40.042020107 +0000 UTC m=+502.587336300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-cert") pod "odh-model-controller-7998c67dc4-grs4z" (UID: "a5d0173d-18d7-4c2a-8fd4-d4d5cacea268") : secret "odh-model-controller-webhook-cert" not found
Jul 21 17:16:39.557688 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.557662    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pglx8\" (UniqueName: \"kubernetes.io/projected/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-kube-api-access-pglx8\") pod \"odh-model-controller-7998c67dc4-grs4z\" (UID: \"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268\") " pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:39.572344 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.572309    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:39.691965 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.691874    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:39.833977 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:39.833945    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:40.047772 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.047733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-cert\") pod \"odh-model-controller-7998c67dc4-grs4z\" (UID: \"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268\") " pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:40.050634 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.050611    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5d0173d-18d7-4c2a-8fd4-d4d5cacea268-cert\") pod \"odh-model-controller-7998c67dc4-grs4z\" (UID: \"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268\") " pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:40.324918 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.324838    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:40.466570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.466542    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-grs4z"]
Jul 21 17:16:40.468609 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:16:40.468571    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d0173d_18d7_4c2a_8fd4_d4d5cacea268.slice/crio-23b30ace18212dad4099af38756209db136984dd935e5be259e15bce7ba53181 WatchSource:0}: Error finding container 23b30ace18212dad4099af38756209db136984dd935e5be259e15bce7ba53181: Status 404 returned error can't find the container with id 23b30ace18212dad4099af38756209db136984dd935e5be259e15bce7ba53181
Jul 21 17:16:40.504472 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.504448    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"]
Jul 21 17:16:40.509058 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.509041    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.511530 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.511508    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 17:16:40.511636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.511514    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 17:16:40.511636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.511556    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 17:16:40.511636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.511607    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 17:16:40.511833 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.511817    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kzszl\""
Jul 21 17:16:40.517585 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.517565    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:40.521702 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.521683    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"]
Jul 21 17:16:40.551673 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.551650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb5t9\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-kube-api-access-cb5t9\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.551777 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.551699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.551777 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.551762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.551924 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.551832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.551924 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.551862    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.552005 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.551922    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.552005 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.551948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.617640 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.617563    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:40.653088 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.653054    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.653088 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.653097    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.653344 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.653304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.653403 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.653345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.653459 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.653443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb5t9\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-kube-api-access-cb5t9\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.653834 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.653522    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.653834 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.653569    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.653834 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.653752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.656353 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.656293    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.656353 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.656309    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.656551 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.656500    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.656605 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.656574    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.669374 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.669347    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.669576 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.669560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb5t9\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-kube-api-access-cb5t9\") pod \"istiod-openshift-gateway-7574459656-bzmpb\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.718644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.718610    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:40.818630 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.818601    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:40.860169 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.860135    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:40.957495 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:40.957464    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"]
Jul 21 17:16:40.958673 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:16:40.958644    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2718bb1a_277b_4ddb_9e88_fc995eb4f76a.slice/crio-6463159359ae3cc375c658c883643fabb62e37a13005fca76d123b39202f1ea7 WatchSource:0}: Error finding container 6463159359ae3cc375c658c883643fabb62e37a13005fca76d123b39202f1ea7: Status 404 returned error can't find the container with id 6463159359ae3cc375c658c883643fabb62e37a13005fca76d123b39202f1ea7
Jul 21 17:16:41.432325 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:41.432291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb" event={"ID":"2718bb1a-277b-4ddb-9e88-fc995eb4f76a","Type":"ContainerStarted","Data":"6463159359ae3cc375c658c883643fabb62e37a13005fca76d123b39202f1ea7"}
Jul 21 17:16:41.433466 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:41.433442    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-grs4z" event={"ID":"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268","Type":"ContainerStarted","Data":"23b30ace18212dad4099af38756209db136984dd935e5be259e15bce7ba53181"}
Jul 21 17:16:41.716823 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:41.716681    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:43.634185 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:43.634155    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:43.717744 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:43.717713    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:45.075541 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.075503    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:16:45.075836 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.075584    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:16:45.459718 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.459608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v" event={"ID":"a5b33372-5b1a-4b1f-84c5-a0b859f57c0f","Type":"ContainerStarted","Data":"00d49ac5fd5a1958c4a8310d45f7845ddc2c413ae453246fad9327ec26342fdf"}
Jul 21 17:16:45.461872 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.461839    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb" event={"ID":"2718bb1a-277b-4ddb-9e88-fc995eb4f76a","Type":"ContainerStarted","Data":"f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73"}
Jul 21 17:16:45.462031 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.461917    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:45.463644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.463611    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-grs4z" event={"ID":"a5d0173d-18d7-4c2a-8fd4-d4d5cacea268","Type":"ContainerStarted","Data":"70a02021e6531d99a61721cb52ca07637bd853800ab11293b45215c4f9fe4302"}
Jul 21 17:16:45.463765 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.463674    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:16:45.479109 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.479068    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-589694fdcc-g598v" podStartSLOduration=1.678108703 podStartE2EDuration="7.479054351s" totalImagesPullingTime="5.800945648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:45.476783993 +0000 UTC m=+508.022100213" watchObservedRunningTime="2026-07-21 17:16:45.479054351 +0000 UTC m=+508.024370566"
Jul 21 17:16:45.499427 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:45.499370    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb" podStartSLOduration=1.385440182 podStartE2EDuration="5.499350949s" totalImagesPullingTime="4.113910767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:45.496562944 +0000 UTC m=+508.041879160" watchObservedRunningTime="2026-07-21 17:16:45.499350949 +0000 UTC m=+508.044667167"
Jul 21 17:16:46.043669 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:46.043629    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:46.143472 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:46.143438    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:46.470715 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:46.470635    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bzmpb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 17:16:46.470715 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:46.470689    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb" podUID="2718bb1a-277b-4ddb-9e88-fc995eb4f76a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:16:46.842120 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:46.842071    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:47.047669 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:47.047634    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:47.189064 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:47.188992    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:47.394926 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:47.394895    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:49.469943 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:49.469913    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:49.493911 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:49.493863    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-grs4z" podStartSLOduration=5.879758701 podStartE2EDuration="10.493848025s" totalImagesPullingTime="4.614089324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:45.513915037 +0000 UTC m=+508.059231254" watchObservedRunningTime="2026-07-21 17:16:49.493848025 +0000 UTC m=+512.039164243"
Jul 21 17:16:50.272593 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.272547    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:50.353565 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.353534    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"]
Jul 21 17:16:50.360176 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.360157    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:50.364971 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.364947    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 21 17:16:50.364971 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.364965    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5nx6f\""
Jul 21 17:16:50.366989 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.366969    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"]
Jul 21 17:16:50.371626 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.371606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"]
Jul 21 17:16:50.371726 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.371714    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:50.375379 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.375364    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cblqb\""
Jul 21 17:16:50.376974 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.376952    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 21 17:16:50.384991 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.384968    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"]
Jul 21 17:16:50.389264 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.389244    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:50.449947 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.449907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ad371c-9de4-4517-b8fb-bac1e92b1cf6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kbcc9\" (UID: \"03ad371c-9de4-4517-b8fb-bac1e92b1cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:50.449947 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.449945    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/250df1ec-526e-4b29-92eb-e7f313b98e78-cert\") pod \"kserve-controller-manager-d6f4b65b8-ntshb\" (UID: \"250df1ec-526e-4b29-92eb-e7f313b98e78\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:50.450133 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.449966    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngc8\" (UniqueName: \"kubernetes.io/projected/250df1ec-526e-4b29-92eb-e7f313b98e78-kube-api-access-lngc8\") pod \"kserve-controller-manager-d6f4b65b8-ntshb\" (UID: \"250df1ec-526e-4b29-92eb-e7f313b98e78\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:50.450133 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.450062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrspq\" (UniqueName: \"kubernetes.io/projected/03ad371c-9de4-4517-b8fb-bac1e92b1cf6-kube-api-access-nrspq\") pod \"llmisvc-controller-manager-777c6bd7d5-kbcc9\" (UID: \"03ad371c-9de4-4517-b8fb-bac1e92b1cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:50.545273 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.545184    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:50.551350 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.551325    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrspq\" (UniqueName: \"kubernetes.io/projected/03ad371c-9de4-4517-b8fb-bac1e92b1cf6-kube-api-access-nrspq\") pod \"llmisvc-controller-manager-777c6bd7d5-kbcc9\" (UID: \"03ad371c-9de4-4517-b8fb-bac1e92b1cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:50.551459 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.551415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ad371c-9de4-4517-b8fb-bac1e92b1cf6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kbcc9\" (UID: \"03ad371c-9de4-4517-b8fb-bac1e92b1cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:50.551459 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.551437    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/250df1ec-526e-4b29-92eb-e7f313b98e78-cert\") pod \"kserve-controller-manager-d6f4b65b8-ntshb\" (UID: \"250df1ec-526e-4b29-92eb-e7f313b98e78\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:50.551459 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.551452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngc8\" (UniqueName: \"kubernetes.io/projected/250df1ec-526e-4b29-92eb-e7f313b98e78-kube-api-access-lngc8\") pod \"kserve-controller-manager-d6f4b65b8-ntshb\" (UID: \"250df1ec-526e-4b29-92eb-e7f313b98e78\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:50.553889 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.553869    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ad371c-9de4-4517-b8fb-bac1e92b1cf6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kbcc9\" (UID: \"03ad371c-9de4-4517-b8fb-bac1e92b1cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:50.553988 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.553949    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/250df1ec-526e-4b29-92eb-e7f313b98e78-cert\") pod \"kserve-controller-manager-d6f4b65b8-ntshb\" (UID: \"250df1ec-526e-4b29-92eb-e7f313b98e78\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:50.560864 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.560837    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrspq\" (UniqueName: \"kubernetes.io/projected/03ad371c-9de4-4517-b8fb-bac1e92b1cf6-kube-api-access-nrspq\") pod \"llmisvc-controller-manager-777c6bd7d5-kbcc9\" (UID: \"03ad371c-9de4-4517-b8fb-bac1e92b1cf6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:50.561507 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.561489    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngc8\" (UniqueName: \"kubernetes.io/projected/250df1ec-526e-4b29-92eb-e7f313b98e78-kube-api-access-lngc8\") pod \"kserve-controller-manager-d6f4b65b8-ntshb\" (UID: \"250df1ec-526e-4b29-92eb-e7f313b98e78\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:50.647323 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.647289    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:50.672429 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.672380    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:50.680446 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.680422    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:50.820850 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.820823    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"]
Jul 21 17:16:50.822716 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:16:50.822685    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250df1ec_526e_4b29_92eb_e7f313b98e78.slice/crio-4da0fe71c865a226a64ae0f08abf54e26cf66bf0e263fcabdbd90c7afda06e14 WatchSource:0}: Error finding container 4da0fe71c865a226a64ae0f08abf54e26cf66bf0e263fcabdbd90c7afda06e14: Status 404 returned error can't find the container with id 4da0fe71c865a226a64ae0f08abf54e26cf66bf0e263fcabdbd90c7afda06e14
Jul 21 17:16:50.841579 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:50.841557    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"]
Jul 21 17:16:50.842762 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:16:50.842724    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod03ad371c_9de4_4517_b8fb_bac1e92b1cf6.slice/crio-23f283af4fedd2bf488d708d5fe89353445ed515cd9b4df70ceb9daa56d160c0 WatchSource:0}: Error finding container 23f283af4fedd2bf488d708d5fe89353445ed515cd9b4df70ceb9daa56d160c0: Status 404 returned error can't find the container with id 23f283af4fedd2bf488d708d5fe89353445ed515cd9b4df70ceb9daa56d160c0
Jul 21 17:16:51.494942 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:51.494907    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9" event={"ID":"03ad371c-9de4-4517-b8fb-bac1e92b1cf6","Type":"ContainerStarted","Data":"23f283af4fedd2bf488d708d5fe89353445ed515cd9b4df70ceb9daa56d160c0"}
Jul 21 17:16:51.496048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:51.496026    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb" event={"ID":"250df1ec-526e-4b29-92eb-e7f313b98e78","Type":"ContainerStarted","Data":"4da0fe71c865a226a64ae0f08abf54e26cf66bf0e263fcabdbd90c7afda06e14"}
Jul 21 17:16:51.576602 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:51.576568    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:51.671398 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:51.671368    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:51.783686 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:51.783649    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:16:52.873782 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:52.873400    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"]
Jul 21 17:16:52.873782 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:52.873616    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb" podUID="2718bb1a-277b-4ddb-9e88-fc995eb4f76a" containerName="discovery" containerID="cri-o://f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73" gracePeriod=30
Jul 21 17:16:53.466361 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.466337    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:53.510431 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.510402    2557 generic.go:356] "Generic (PLEG): container finished" podID="2718bb1a-277b-4ddb-9e88-fc995eb4f76a" containerID="f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73" exitCode=0
Jul 21 17:16:53.510616 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.510459    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"
Jul 21 17:16:53.510616 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.510527    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb" event={"ID":"2718bb1a-277b-4ddb-9e88-fc995eb4f76a","Type":"ContainerDied","Data":"f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73"}
Jul 21 17:16:53.510616 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.510580    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb" event={"ID":"2718bb1a-277b-4ddb-9e88-fc995eb4f76a","Type":"ContainerDied","Data":"6463159359ae3cc375c658c883643fabb62e37a13005fca76d123b39202f1ea7"}
Jul 21 17:16:53.510616 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.510605    2557 scope.go:117] "RemoveContainer" containerID="f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73"
Jul 21 17:16:53.512633 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.512565    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb" event={"ID":"250df1ec-526e-4b29-92eb-e7f313b98e78","Type":"ContainerStarted","Data":"c945c0079630a0d211ce011e90e99ff6548a02cfcd5d1a46ca52d451a5bcd184"}
Jul 21 17:16:53.512633 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.512630    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:16:53.534270 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.534221    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb" podStartSLOduration=0.990012145 podStartE2EDuration="3.534202813s" totalImagesPullingTime="2.544190668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:53.531934088 +0000 UTC m=+516.077250369" watchObservedRunningTime="2026-07-21 17:16:53.534202813 +0000 UTC m=+516.079519030"
Jul 21 17:16:53.584343 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584266    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-dns-cert\") pod \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") "
Jul 21 17:16:53.584565 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584396    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-ca-configmap\") pod \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") "
Jul 21 17:16:53.584565 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584436    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-token\") pod \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") "
Jul 21 17:16:53.584565 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584466    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-local-certs\") pod \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") "
Jul 21 17:16:53.584565 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584509    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb5t9\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-kube-api-access-cb5t9\") pod \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") "
Jul 21 17:16:53.584565 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584534    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-kubeconfig\") pod \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") "
Jul 21 17:16:53.584870 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584590    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-cacerts\") pod \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\" (UID: \"2718bb1a-277b-4ddb-9e88-fc995eb4f76a\") "
Jul 21 17:16:53.584870 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584838    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2718bb1a-277b-4ddb-9e88-fc995eb4f76a" (UID: "2718bb1a-277b-4ddb-9e88-fc995eb4f76a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:16:53.584975 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.584956    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-ca-configmap\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:53.587643 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.587615    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2718bb1a-277b-4ddb-9e88-fc995eb4f76a" (UID: "2718bb1a-277b-4ddb-9e88-fc995eb4f76a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:16:53.588028 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.587955    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-cacerts" (OuterVolumeSpecName: "cacerts") pod "2718bb1a-277b-4ddb-9e88-fc995eb4f76a" (UID: "2718bb1a-277b-4ddb-9e88-fc995eb4f76a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:16:53.588128 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.588060    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2718bb1a-277b-4ddb-9e88-fc995eb4f76a" (UID: "2718bb1a-277b-4ddb-9e88-fc995eb4f76a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:16:53.588304 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.588283    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-local-certs" (OuterVolumeSpecName: "local-certs") pod "2718bb1a-277b-4ddb-9e88-fc995eb4f76a" (UID: "2718bb1a-277b-4ddb-9e88-fc995eb4f76a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:16:53.588374 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.588301    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-token" (OuterVolumeSpecName: "istio-token") pod "2718bb1a-277b-4ddb-9e88-fc995eb4f76a" (UID: "2718bb1a-277b-4ddb-9e88-fc995eb4f76a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:16:53.588743 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.588709    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-kube-api-access-cb5t9" (OuterVolumeSpecName: "kube-api-access-cb5t9") pod "2718bb1a-277b-4ddb-9e88-fc995eb4f76a" (UID: "2718bb1a-277b-4ddb-9e88-fc995eb4f76a"). InnerVolumeSpecName "kube-api-access-cb5t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:16:53.685534 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.685488    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb5t9\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-kube-api-access-cb5t9\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:53.685534 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.685520    2557 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-kubeconfig\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:53.685534 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.685543    2557 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-cacerts\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:53.685865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.685555    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-csr-dns-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:53.685865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.685568    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-istio-token\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:53.685865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.685581    2557 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2718bb1a-277b-4ddb-9e88-fc995eb4f76a-local-certs\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:53.855500 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.855415    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"]
Jul 21 17:16:53.861896 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:53.861851    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzmpb"]
Jul 21 17:16:54.035046 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.035018    2557 scope.go:117] "RemoveContainer" containerID="f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73"
Jul 21 17:16:54.035385 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:16:54.035364    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73\": container with ID starting with f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73 not found: ID does not exist" containerID="f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73"
Jul 21 17:16:54.035442 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.035396    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73"} err="failed to get container status \"f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73\": rpc error: code = NotFound desc = could not find container \"f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73\": container with ID starting with f4f2c515411f00da7ac605903d843d5a8b6ce431cb2041562103e92266e2bd73 not found: ID does not exist"
Jul 21 17:16:54.062626 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.062600    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2718bb1a-277b-4ddb-9e88-fc995eb4f76a" path="/var/lib/kubelet/pods/2718bb1a-277b-4ddb-9e88-fc995eb4f76a/volumes"
Jul 21 17:16:54.446067 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.445972    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f9d95fbfb-x9ftd" podUID="14fa0420-e041-4970-b2bb-73b017ac107c" containerName="console" containerID="cri-o://e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719" gracePeriod=15
Jul 21 17:16:54.519941 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.519907    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9" event={"ID":"03ad371c-9de4-4517-b8fb-bac1e92b1cf6","Type":"ContainerStarted","Data":"37826c57e099c6cf16c7fafdfdc9d4ecd3aa9534089331fdde7690b653b0acd3"}
Jul 21 17:16:54.520118 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.520020    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:16:54.537868 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.537824    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9" podStartSLOduration=1.297750383 podStartE2EDuration="4.537789623s" totalImagesPullingTime="3.24003924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:54.536163055 +0000 UTC m=+517.081479271" watchObservedRunningTime="2026-07-21 17:16:54.537789623 +0000 UTC m=+517.083105842"
Jul 21 17:16:54.700111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.700054    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:16:54.794994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.794962    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-serving-cert\") pod \"14fa0420-e041-4970-b2bb-73b017ac107c\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") "
Jul 21 17:16:54.795154 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795008    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-service-ca\") pod \"14fa0420-e041-4970-b2bb-73b017ac107c\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") "
Jul 21 17:16:54.795154 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795027    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-console-config\") pod \"14fa0420-e041-4970-b2bb-73b017ac107c\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") "
Jul 21 17:16:54.795154 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795075    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-oauth-config\") pod \"14fa0420-e041-4970-b2bb-73b017ac107c\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") "
Jul 21 17:16:54.795154 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795119    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwkrz\" (UniqueName: \"kubernetes.io/projected/14fa0420-e041-4970-b2bb-73b017ac107c-kube-api-access-fwkrz\") pod \"14fa0420-e041-4970-b2bb-73b017ac107c\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") "
Jul 21 17:16:54.795154 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795140    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-trusted-ca-bundle\") pod \"14fa0420-e041-4970-b2bb-73b017ac107c\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") "
Jul 21 17:16:54.795408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795176    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-oauth-serving-cert\") pod \"14fa0420-e041-4970-b2bb-73b017ac107c\" (UID: \"14fa0420-e041-4970-b2bb-73b017ac107c\") "
Jul 21 17:16:54.795408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795357    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-console-config" (OuterVolumeSpecName: "console-config") pod "14fa0420-e041-4970-b2bb-73b017ac107c" (UID: "14fa0420-e041-4970-b2bb-73b017ac107c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:16:54.795695 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795538    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-console-config\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:54.795695 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795633    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14fa0420-e041-4970-b2bb-73b017ac107c" (UID: "14fa0420-e041-4970-b2bb-73b017ac107c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:16:54.795695 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795646    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14fa0420-e041-4970-b2bb-73b017ac107c" (UID: "14fa0420-e041-4970-b2bb-73b017ac107c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:16:54.795963 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.795878    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-service-ca" (OuterVolumeSpecName: "service-ca") pod "14fa0420-e041-4970-b2bb-73b017ac107c" (UID: "14fa0420-e041-4970-b2bb-73b017ac107c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:16:54.797362 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.797340    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14fa0420-e041-4970-b2bb-73b017ac107c" (UID: "14fa0420-e041-4970-b2bb-73b017ac107c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:16:54.797459 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.797341    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fa0420-e041-4970-b2bb-73b017ac107c-kube-api-access-fwkrz" (OuterVolumeSpecName: "kube-api-access-fwkrz") pod "14fa0420-e041-4970-b2bb-73b017ac107c" (UID: "14fa0420-e041-4970-b2bb-73b017ac107c"). InnerVolumeSpecName "kube-api-access-fwkrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:16:54.797628 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.797611    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14fa0420-e041-4970-b2bb-73b017ac107c" (UID: "14fa0420-e041-4970-b2bb-73b017ac107c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:16:54.896390 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.896351    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwkrz\" (UniqueName: \"kubernetes.io/projected/14fa0420-e041-4970-b2bb-73b017ac107c-kube-api-access-fwkrz\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:54.896390 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.896386    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-trusted-ca-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:54.896558 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.896407    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-oauth-serving-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:54.896558 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.896416    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-serving-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:54.896558 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.896427    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14fa0420-e041-4970-b2bb-73b017ac107c-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:54.896558 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:54.896435    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14fa0420-e041-4970-b2bb-73b017ac107c-console-oauth-config\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:16:55.527790 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.527752    2557 generic.go:356] "Generic (PLEG): container finished" podID="14fa0420-e041-4970-b2bb-73b017ac107c" containerID="e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719" exitCode=0
Jul 21 17:16:55.527790 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.527814    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9d95fbfb-x9ftd"
Jul 21 17:16:55.528370 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.527844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9d95fbfb-x9ftd" event={"ID":"14fa0420-e041-4970-b2bb-73b017ac107c","Type":"ContainerDied","Data":"e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719"}
Jul 21 17:16:55.528370 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.527906    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9d95fbfb-x9ftd" event={"ID":"14fa0420-e041-4970-b2bb-73b017ac107c","Type":"ContainerDied","Data":"4094a580b63b243828d25acd359c151da471ee7f0e105cced900aec9466655cd"}
Jul 21 17:16:55.528370 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.527938    2557 scope.go:117] "RemoveContainer" containerID="e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719"
Jul 21 17:16:55.537580 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.537565    2557 scope.go:117] "RemoveContainer" containerID="e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719"
Jul 21 17:16:55.537839 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:16:55.537822    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719\": container with ID starting with e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719 not found: ID does not exist" containerID="e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719"
Jul 21 17:16:55.537904 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.537846    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719"} err="failed to get container status \"e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719\": rpc error: code = NotFound desc = could not find container \"e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719\": container with ID starting with e4b7765ccc67c7bd3127209c987fe27747cd4524782aa43f1a678122d5e24719 not found: ID does not exist"
Jul 21 17:16:55.550242 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.550215    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9d95fbfb-x9ftd"]
Jul 21 17:16:55.554875 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:55.554850    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9d95fbfb-x9ftd"]
Jul 21 17:16:56.062807 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:56.062762    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fa0420-e041-4970-b2bb-73b017ac107c" path="/var/lib/kubelet/pods/14fa0420-e041-4970-b2bb-73b017ac107c/volumes"
Jul 21 17:16:56.470952 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:16:56.470869    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-grs4z"
Jul 21 17:17:24.527084 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:24.527053    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ntshb"
Jul 21 17:17:25.531174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:25.531147    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kbcc9"
Jul 21 17:17:36.516022 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:36.515984    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:17:40.079501 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.079459    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:17:40.176202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.176174    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:17:40.215113 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.215069    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlltd"]
Jul 21 17:17:40.215690 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.215669    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2718bb1a-277b-4ddb-9e88-fc995eb4f76a" containerName="discovery"
Jul 21 17:17:40.215751 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.215696    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2718bb1a-277b-4ddb-9e88-fc995eb4f76a" containerName="discovery"
Jul 21 17:17:40.215751 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.215715    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14fa0420-e041-4970-b2bb-73b017ac107c" containerName="console"
Jul 21 17:17:40.215751 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.215725    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fa0420-e041-4970-b2bb-73b017ac107c" containerName="console"
Jul 21 17:17:40.215890 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.215878    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2718bb1a-277b-4ddb-9e88-fc995eb4f76a" containerName="discovery"
Jul 21 17:17:40.215930 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.215893    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="14fa0420-e041-4970-b2bb-73b017ac107c" containerName="console"
Jul 21 17:17:40.225416 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.225392    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlltd"]
Jul 21 17:17:40.225589 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.225473    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vlltd"
Jul 21 17:17:40.228878 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.228853    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 17:17:40.229327 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.229302    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 17:17:40.229699 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.229681    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mm7t9\""
Jul 21 17:17:40.269476 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.269442    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:17:40.301926 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.301890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mb9f\" (UniqueName: \"kubernetes.io/projected/17d3138c-cdf1-457c-bb02-986b9b10f29e-kube-api-access-4mb9f\") pod \"kuadrant-operator-catalog-vlltd\" (UID: \"17d3138c-cdf1-457c-bb02-986b9b10f29e\") " pod="kuadrant-system/kuadrant-operator-catalog-vlltd"
Jul 21 17:17:40.402927 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.402792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mb9f\" (UniqueName: \"kubernetes.io/projected/17d3138c-cdf1-457c-bb02-986b9b10f29e-kube-api-access-4mb9f\") pod \"kuadrant-operator-catalog-vlltd\" (UID: \"17d3138c-cdf1-457c-bb02-986b9b10f29e\") " pod="kuadrant-system/kuadrant-operator-catalog-vlltd"
Jul 21 17:17:40.418054 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.418020    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mb9f\" (UniqueName: \"kubernetes.io/projected/17d3138c-cdf1-457c-bb02-986b9b10f29e-kube-api-access-4mb9f\") pod \"kuadrant-operator-catalog-vlltd\" (UID: \"17d3138c-cdf1-457c-bb02-986b9b10f29e\") " pod="kuadrant-system/kuadrant-operator-catalog-vlltd"
Jul 21 17:17:40.536259 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.536218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vlltd"
Jul 21 17:17:40.565488 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.565459    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlltd"]
Jul 21 17:17:40.668826 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.668641    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlltd"]
Jul 21 17:17:40.674238 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:17:40.674197    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d3138c_cdf1_457c_bb02_986b9b10f29e.slice/crio-89d5d21883554274746932cfbd6d1dbb642070e8a0b225204d103866a32d6ccc WatchSource:0}: Error finding container 89d5d21883554274746932cfbd6d1dbb642070e8a0b225204d103866a32d6ccc: Status 404 returned error can't find the container with id 89d5d21883554274746932cfbd6d1dbb642070e8a0b225204d103866a32d6ccc
Jul 21 17:17:40.759683 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.759650    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vlltd" event={"ID":"17d3138c-cdf1-457c-bb02-986b9b10f29e","Type":"ContainerStarted","Data":"89d5d21883554274746932cfbd6d1dbb642070e8a0b225204d103866a32d6ccc"}
Jul 21 17:17:40.771872 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.771847    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rgd48"]
Jul 21 17:17:40.775261 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.775248    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:40.783909 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.783886    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rgd48"]
Jul 21 17:17:40.907288 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:40.907246    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk4p2\" (UniqueName: \"kubernetes.io/projected/ec5b0357-6b99-4c0f-a59d-9f9a7c06c678-kube-api-access-bk4p2\") pod \"kuadrant-operator-catalog-rgd48\" (UID: \"ec5b0357-6b99-4c0f-a59d-9f9a7c06c678\") " pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:41.008366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:41.008338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk4p2\" (UniqueName: \"kubernetes.io/projected/ec5b0357-6b99-4c0f-a59d-9f9a7c06c678-kube-api-access-bk4p2\") pod \"kuadrant-operator-catalog-rgd48\" (UID: \"ec5b0357-6b99-4c0f-a59d-9f9a7c06c678\") " pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:41.020180 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:41.020145    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk4p2\" (UniqueName: \"kubernetes.io/projected/ec5b0357-6b99-4c0f-a59d-9f9a7c06c678-kube-api-access-bk4p2\") pod \"kuadrant-operator-catalog-rgd48\" (UID: \"ec5b0357-6b99-4c0f-a59d-9f9a7c06c678\") " pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:41.085333 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:41.085301    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:41.227074 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:41.227049    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rgd48"]
Jul 21 17:17:41.233347 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:17:41.233319    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5b0357_6b99_4c0f_a59d_9f9a7c06c678.slice/crio-0cc6d4b2f6bff3f6601055701d7333d119ee016f2f12b6c09c6d6b236e12023c WatchSource:0}: Error finding container 0cc6d4b2f6bff3f6601055701d7333d119ee016f2f12b6c09c6d6b236e12023c: Status 404 returned error can't find the container with id 0cc6d4b2f6bff3f6601055701d7333d119ee016f2f12b6c09c6d6b236e12023c
Jul 21 17:17:41.771561 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:41.771522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rgd48" event={"ID":"ec5b0357-6b99-4c0f-a59d-9f9a7c06c678","Type":"ContainerStarted","Data":"0cc6d4b2f6bff3f6601055701d7333d119ee016f2f12b6c09c6d6b236e12023c"}
Jul 21 17:17:42.778505 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:42.778448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vlltd" event={"ID":"17d3138c-cdf1-457c-bb02-986b9b10f29e","Type":"ContainerStarted","Data":"98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7"}
Jul 21 17:17:42.778505 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:42.778479    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-vlltd" podUID="17d3138c-cdf1-457c-bb02-986b9b10f29e" containerName="registry-server" containerID="cri-o://98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7" gracePeriod=2
Jul 21 17:17:42.780347 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:42.780312    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rgd48" event={"ID":"ec5b0357-6b99-4c0f-a59d-9f9a7c06c678","Type":"ContainerStarted","Data":"2d606f5437d7fb8ba1bbcda434da521c1aed6de09b970e21c5caae81e7ef3814"}
Jul 21 17:17:42.797758 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:42.797703    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vlltd" podStartSLOduration=0.8607263 podStartE2EDuration="2.797687692s" totalImagesPullingTime="1.936961392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:17:42.79632647 +0000 UTC m=+565.341642687" watchObservedRunningTime="2026-07-21 17:17:42.797687692 +0000 UTC m=+565.343003908"
Jul 21 17:17:42.813510 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:42.813454    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rgd48" podStartSLOduration=1.361187782 podStartE2EDuration="2.81343744s" totalImagesPullingTime="1.452249658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:17:42.812487813 +0000 UTC m=+565.357804030" watchObservedRunningTime="2026-07-21 17:17:42.81343744 +0000 UTC m=+565.358753711"
Jul 21 17:17:43.039171 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.039142    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vlltd"
Jul 21 17:17:43.128932 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.128899    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mb9f\" (UniqueName: \"kubernetes.io/projected/17d3138c-cdf1-457c-bb02-986b9b10f29e-kube-api-access-4mb9f\") pod \"17d3138c-cdf1-457c-bb02-986b9b10f29e\" (UID: \"17d3138c-cdf1-457c-bb02-986b9b10f29e\") "
Jul 21 17:17:43.131075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.131056    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17d3138c-cdf1-457c-bb02-986b9b10f29e-kube-api-access-4mb9f" (OuterVolumeSpecName: "kube-api-access-4mb9f") pod "17d3138c-cdf1-457c-bb02-986b9b10f29e" (UID: "17d3138c-cdf1-457c-bb02-986b9b10f29e"). InnerVolumeSpecName "kube-api-access-4mb9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:17:43.230569 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.230483    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mb9f\" (UniqueName: \"kubernetes.io/projected/17d3138c-cdf1-457c-bb02-986b9b10f29e-kube-api-access-4mb9f\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:17:43.787582 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.787542    2557 generic.go:356] "Generic (PLEG): container finished" podID="17d3138c-cdf1-457c-bb02-986b9b10f29e" containerID="98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7" exitCode=0
Jul 21 17:17:43.787582 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.787589    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vlltd"
Jul 21 17:17:43.788075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.787630    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vlltd" event={"ID":"17d3138c-cdf1-457c-bb02-986b9b10f29e","Type":"ContainerDied","Data":"98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7"}
Jul 21 17:17:43.788075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.787678    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vlltd" event={"ID":"17d3138c-cdf1-457c-bb02-986b9b10f29e","Type":"ContainerDied","Data":"89d5d21883554274746932cfbd6d1dbb642070e8a0b225204d103866a32d6ccc"}
Jul 21 17:17:43.788075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.787699    2557 scope.go:117] "RemoveContainer" containerID="98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7"
Jul 21 17:17:43.798058 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.798039    2557 scope.go:117] "RemoveContainer" containerID="98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7"
Jul 21 17:17:43.798325 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:17:43.798304    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7\": container with ID starting with 98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7 not found: ID does not exist" containerID="98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7"
Jul 21 17:17:43.798415 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.798333    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7"} err="failed to get container status \"98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7\": rpc error: code = NotFound desc = could not find container \"98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7\": container with ID starting with 98a8ed73e5f03c53d56ba87bf922499fa34cfb24da8c5305c1d4f4f352a0fdc7 not found: ID does not exist"
Jul 21 17:17:43.809721 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.809693    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlltd"]
Jul 21 17:17:43.815432 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:43.815408    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlltd"]
Jul 21 17:17:44.062532 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:44.062503    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17d3138c-cdf1-457c-bb02-986b9b10f29e" path="/var/lib/kubelet/pods/17d3138c-cdf1-457c-bb02-986b9b10f29e/volumes"
Jul 21 17:17:51.085529 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:51.085489    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:51.086091 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:51.085574    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:51.109618 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:51.109592    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:51.852691 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:51.852666    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rgd48"
Jul 21 17:17:55.567477 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.567447    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"]
Jul 21 17:17:55.567907 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.567892    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d3138c-cdf1-457c-bb02-986b9b10f29e" containerName="registry-server"
Jul 21 17:17:55.567907 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.567908    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d3138c-cdf1-457c-bb02-986b9b10f29e" containerName="registry-server"
Jul 21 17:17:55.567993 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.567970    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="17d3138c-cdf1-457c-bb02-986b9b10f29e" containerName="registry-server"
Jul 21 17:17:55.572615 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.572598    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.575321 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.575302    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w9h6f\""
Jul 21 17:17:55.581516 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.581493    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"]
Jul 21 17:17:55.649629 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.649595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.649833 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.649662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.649833 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.649692    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw942\" (UniqueName: \"kubernetes.io/projected/f33210c4-7c8e-424c-aebc-61810093ea66-kube-api-access-bw942\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.750367 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.750333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.750534 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.750386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.750534 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.750501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw942\" (UniqueName: \"kubernetes.io/projected/f33210c4-7c8e-424c-aebc-61810093ea66-kube-api-access-bw942\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.750693 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.750679    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.750764 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.750747    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.759937 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.759917    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw942\" (UniqueName: \"kubernetes.io/projected/f33210c4-7c8e-424c-aebc-61810093ea66-kube-api-access-bw942\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:55.882459 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:55.882362    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:17:56.017110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.017085    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"]
Jul 21 17:17:56.019070 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:17:56.019047    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33210c4_7c8e_424c_aebc_61810093ea66.slice/crio-4b9f0d17d2eaeebc2c799eada98b146ad8bd1df94c7237d47e25eb4780ada680 WatchSource:0}: Error finding container 4b9f0d17d2eaeebc2c799eada98b146ad8bd1df94c7237d47e25eb4780ada680: Status 404 returned error can't find the container with id 4b9f0d17d2eaeebc2c799eada98b146ad8bd1df94c7237d47e25eb4780ada680
Jul 21 17:17:56.168895 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.168822    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"]
Jul 21 17:17:56.172491 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.172474    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.181361 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.181334    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"]
Jul 21 17:17:56.256067 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.256036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.256270 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.256075    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.256270 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.256233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lht9c\" (UniqueName: \"kubernetes.io/projected/14db8b79-3e88-4828-b6ed-d1b7290daf1a-kube-api-access-lht9c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.357297 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.357258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lht9c\" (UniqueName: \"kubernetes.io/projected/14db8b79-3e88-4828-b6ed-d1b7290daf1a-kube-api-access-lht9c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.357486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.357322    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.357486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.357357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.357647 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.357631    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.357687 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.357662    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.365580 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.365560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lht9c\" (UniqueName: \"kubernetes.io/projected/14db8b79-3e88-4828-b6ed-d1b7290daf1a-kube-api-access-lht9c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.482505 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.482421    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:17:56.572247 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.572214    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"]
Jul 21 17:17:56.577317 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.577293    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.586544 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.586129    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"]
Jul 21 17:17:56.619003 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.618981    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"]
Jul 21 17:17:56.620576 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:17:56.620548    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14db8b79_3e88_4828_b6ed_d1b7290daf1a.slice/crio-97d0a804a617b4892af8bbd364f96aeff686eb159fea229363f89cb6a01a9f87 WatchSource:0}: Error finding container 97d0a804a617b4892af8bbd364f96aeff686eb159fea229363f89cb6a01a9f87: Status 404 returned error can't find the container with id 97d0a804a617b4892af8bbd364f96aeff686eb159fea229363f89cb6a01a9f87
Jul 21 17:17:56.660457 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.660429    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.660457 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.660459    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.660597 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.660483    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzq98\" (UniqueName: \"kubernetes.io/projected/9818638a-1ec7-40a9-a647-ad2c1effe2a5-kube-api-access-fzq98\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.761505 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.761481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.761659 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.761513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.761659 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.761536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzq98\" (UniqueName: \"kubernetes.io/projected/9818638a-1ec7-40a9-a647-ad2c1effe2a5-kube-api-access-fzq98\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.761945 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.761926    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.762002 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.761944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.769865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.769845    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzq98\" (UniqueName: \"kubernetes.io/projected/9818638a-1ec7-40a9-a647-ad2c1effe2a5-kube-api-access-fzq98\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.860110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.860081    2557 generic.go:356] "Generic (PLEG): container finished" podID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerID="c4b50ac39e7c547ef745a2c2fd7493882ed44d9c01a6185bccbd9f45625e7b20" exitCode=0
Jul 21 17:17:56.860278 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.860170    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl" event={"ID":"14db8b79-3e88-4828-b6ed-d1b7290daf1a","Type":"ContainerDied","Data":"c4b50ac39e7c547ef745a2c2fd7493882ed44d9c01a6185bccbd9f45625e7b20"}
Jul 21 17:17:56.860278 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.860234    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl" event={"ID":"14db8b79-3e88-4828-b6ed-d1b7290daf1a","Type":"ContainerStarted","Data":"97d0a804a617b4892af8bbd364f96aeff686eb159fea229363f89cb6a01a9f87"}
Jul 21 17:17:56.861763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.861741    2557 generic.go:356] "Generic (PLEG): container finished" podID="f33210c4-7c8e-424c-aebc-61810093ea66" containerID="e90165a47dcab822814194fe6b902f0f1c3f10c8cbb157722bf9523ee1d33602" exitCode=0
Jul 21 17:17:56.861900 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.861782    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v" event={"ID":"f33210c4-7c8e-424c-aebc-61810093ea66","Type":"ContainerDied","Data":"e90165a47dcab822814194fe6b902f0f1c3f10c8cbb157722bf9523ee1d33602"}
Jul 21 17:17:56.861900 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.861839    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v" event={"ID":"f33210c4-7c8e-424c-aebc-61810093ea66","Type":"ContainerStarted","Data":"4b9f0d17d2eaeebc2c799eada98b146ad8bd1df94c7237d47e25eb4780ada680"}
Jul 21 17:17:56.890394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.890363    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:17:56.974764 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.974512    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"]
Jul 21 17:17:56.979697 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.979671    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:56.986772 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:56.986741    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"]
Jul 21 17:17:57.031289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.031265    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"]
Jul 21 17:17:57.032590 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:17:57.032568    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9818638a_1ec7_40a9_a647_ad2c1effe2a5.slice/crio-6e4a6cce5f402b0e4d15e40f56c6104830268b1c536a18fbbb9edc2ae62e77b6 WatchSource:0}: Error finding container 6e4a6cce5f402b0e4d15e40f56c6104830268b1c536a18fbbb9edc2ae62e77b6: Status 404 returned error can't find the container with id 6e4a6cce5f402b0e4d15e40f56c6104830268b1c536a18fbbb9edc2ae62e77b6
Jul 21 17:17:57.064172 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.064061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j7ww\" (UniqueName: \"kubernetes.io/projected/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-kube-api-access-4j7ww\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.064172 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.064115    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.064172 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.064148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.165287 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.165250    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.165596 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.165397    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.165596 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.165589    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j7ww\" (UniqueName: \"kubernetes.io/projected/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-kube-api-access-4j7ww\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.165732 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.165656    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.165791 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.165734    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.175180 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.175158    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j7ww\" (UniqueName: \"kubernetes.io/projected/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-kube-api-access-4j7ww\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.292316 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.292233    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:17:57.427829 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.427791    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"]
Jul 21 17:17:57.429714 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:17:57.429690    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086d0064_7137_4e1c_8bb3_e9ab6fb3d7a5.slice/crio-d2ae8d8b24757b7d9d8cdce96ed11f18b75867d1e285e93a6ea45babc079b026 WatchSource:0}: Error finding container d2ae8d8b24757b7d9d8cdce96ed11f18b75867d1e285e93a6ea45babc079b026: Status 404 returned error can't find the container with id d2ae8d8b24757b7d9d8cdce96ed11f18b75867d1e285e93a6ea45babc079b026
Jul 21 17:17:57.871962 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.871784    2557 generic.go:356] "Generic (PLEG): container finished" podID="f33210c4-7c8e-424c-aebc-61810093ea66" containerID="85033884195fa6bcd0f62c98404279be6f9a581fa9d3f776f72ceb37c9e7a660" exitCode=0
Jul 21 17:17:57.871962 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.871947    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v" event={"ID":"f33210c4-7c8e-424c-aebc-61810093ea66","Type":"ContainerDied","Data":"85033884195fa6bcd0f62c98404279be6f9a581fa9d3f776f72ceb37c9e7a660"}
Jul 21 17:17:57.873702 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.873677    2557 generic.go:356] "Generic (PLEG): container finished" podID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerID="01383cf96f47c559d1cb89c22db1a7ff5c3ba2829785bf2862126d689da5f631" exitCode=0
Jul 21 17:17:57.873833 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.873751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6" event={"ID":"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5","Type":"ContainerDied","Data":"01383cf96f47c559d1cb89c22db1a7ff5c3ba2829785bf2862126d689da5f631"}
Jul 21 17:17:57.873833 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.873816    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6" event={"ID":"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5","Type":"ContainerStarted","Data":"d2ae8d8b24757b7d9d8cdce96ed11f18b75867d1e285e93a6ea45babc079b026"}
Jul 21 17:17:57.875327 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.875306    2557 generic.go:356] "Generic (PLEG): container finished" podID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerID="8cb538b20b80f9669649e4e158d0b4e8d1eef8c36bf7e6b34ceb5f08dc47a68a" exitCode=0
Jul 21 17:17:57.875424 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.875395    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds" event={"ID":"9818638a-1ec7-40a9-a647-ad2c1effe2a5","Type":"ContainerDied","Data":"8cb538b20b80f9669649e4e158d0b4e8d1eef8c36bf7e6b34ceb5f08dc47a68a"}
Jul 21 17:17:57.875493 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:57.875438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds" event={"ID":"9818638a-1ec7-40a9-a647-ad2c1effe2a5","Type":"ContainerStarted","Data":"6e4a6cce5f402b0e4d15e40f56c6104830268b1c536a18fbbb9edc2ae62e77b6"}
Jul 21 17:17:58.883069 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:58.883039    2557 generic.go:356] "Generic (PLEG): container finished" podID="f33210c4-7c8e-424c-aebc-61810093ea66" containerID="4fab5c24c22fc6fd0fbb2f365988e262788eee32c6bd2c9765788e1522278b95" exitCode=0
Jul 21 17:17:58.883441 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:58.883075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v" event={"ID":"f33210c4-7c8e-424c-aebc-61810093ea66","Type":"ContainerDied","Data":"4fab5c24c22fc6fd0fbb2f365988e262788eee32c6bd2c9765788e1522278b95"}
Jul 21 17:17:58.884861 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:58.884835    2557 generic.go:356] "Generic (PLEG): container finished" podID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerID="8f07a3a15cb65dbc43ccdeb2d0169cf039f6a8679f9b921e5977da34b0b633db" exitCode=0
Jul 21 17:17:58.885030 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:58.884919    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6" event={"ID":"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5","Type":"ContainerDied","Data":"8f07a3a15cb65dbc43ccdeb2d0169cf039f6a8679f9b921e5977da34b0b633db"}
Jul 21 17:17:58.886737 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:58.886711    2557 generic.go:356] "Generic (PLEG): container finished" podID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerID="c2acd6fc8968a7722ea639fcfcd3a1549b9acbbb5fdc3e946c874b8bc7e1daf0" exitCode=0
Jul 21 17:17:58.886848 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:58.886760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl" event={"ID":"14db8b79-3e88-4828-b6ed-d1b7290daf1a","Type":"ContainerDied","Data":"c2acd6fc8968a7722ea639fcfcd3a1549b9acbbb5fdc3e946c874b8bc7e1daf0"}
Jul 21 17:17:59.895054 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:59.895021    2557 generic.go:356] "Generic (PLEG): container finished" podID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerID="d5105c3889fced22ef90ab59909effe4d8853a72487b7d67cf9f7da885c49d12" exitCode=0
Jul 21 17:17:59.895440 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:59.895092    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6" event={"ID":"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5","Type":"ContainerDied","Data":"d5105c3889fced22ef90ab59909effe4d8853a72487b7d67cf9f7da885c49d12"}
Jul 21 17:17:59.896822 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:59.896781    2557 generic.go:356] "Generic (PLEG): container finished" podID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerID="6f616fdc0b36ebac06153fb8c10a75e1aeaf6ddee8af0e105ed56718049f9b24" exitCode=0
Jul 21 17:17:59.896945 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:59.896872    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds" event={"ID":"9818638a-1ec7-40a9-a647-ad2c1effe2a5","Type":"ContainerDied","Data":"6f616fdc0b36ebac06153fb8c10a75e1aeaf6ddee8af0e105ed56718049f9b24"}
Jul 21 17:17:59.899155 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:59.899135    2557 generic.go:356] "Generic (PLEG): container finished" podID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerID="987d8820a296a2eaf81c304ab533d472f7a56b07b16c67ffcb16939bc38219da" exitCode=0
Jul 21 17:17:59.899261 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:17:59.899192    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl" event={"ID":"14db8b79-3e88-4828-b6ed-d1b7290daf1a","Type":"ContainerDied","Data":"987d8820a296a2eaf81c304ab533d472f7a56b07b16c67ffcb16939bc38219da"}
Jul 21 17:18:00.044142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.044120    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:18:00.096009 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.093849    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw942\" (UniqueName: \"kubernetes.io/projected/f33210c4-7c8e-424c-aebc-61810093ea66-kube-api-access-bw942\") pod \"f33210c4-7c8e-424c-aebc-61810093ea66\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") "
Jul 21 17:18:00.096009 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.093967    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-bundle\") pod \"f33210c4-7c8e-424c-aebc-61810093ea66\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") "
Jul 21 17:18:00.096009 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.094025    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-util\") pod \"f33210c4-7c8e-424c-aebc-61810093ea66\" (UID: \"f33210c4-7c8e-424c-aebc-61810093ea66\") "
Jul 21 17:18:00.096009 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.095640    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-bundle" (OuterVolumeSpecName: "bundle") pod "f33210c4-7c8e-424c-aebc-61810093ea66" (UID: "f33210c4-7c8e-424c-aebc-61810093ea66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:00.102767 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.102733    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-util" (OuterVolumeSpecName: "util") pod "f33210c4-7c8e-424c-aebc-61810093ea66" (UID: "f33210c4-7c8e-424c-aebc-61810093ea66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:00.102943 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.102884    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f33210c4-7c8e-424c-aebc-61810093ea66-kube-api-access-bw942" (OuterVolumeSpecName: "kube-api-access-bw942") pod "f33210c4-7c8e-424c-aebc-61810093ea66" (UID: "f33210c4-7c8e-424c-aebc-61810093ea66"). InnerVolumeSpecName "kube-api-access-bw942". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:18:00.195386 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.195349    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw942\" (UniqueName: \"kubernetes.io/projected/f33210c4-7c8e-424c-aebc-61810093ea66-kube-api-access-bw942\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:00.195386 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.195380    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:00.195386 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.195390    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33210c4-7c8e-424c-aebc-61810093ea66-util\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:00.906149 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.906110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v" event={"ID":"f33210c4-7c8e-424c-aebc-61810093ea66","Type":"ContainerDied","Data":"4b9f0d17d2eaeebc2c799eada98b146ad8bd1df94c7237d47e25eb4780ada680"}
Jul 21 17:18:00.906149 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.906132    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v"
Jul 21 17:18:00.906617 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.906197    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b9f0d17d2eaeebc2c799eada98b146ad8bd1df94c7237d47e25eb4780ada680"
Jul 21 17:18:00.908360 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.908333    2557 generic.go:356] "Generic (PLEG): container finished" podID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerID="63a4e43ed365e1e18d8659b600bd60fa73298b183fc1e1bc7080083fca903b70" exitCode=0
Jul 21 17:18:00.908489 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:00.908403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds" event={"ID":"9818638a-1ec7-40a9-a647-ad2c1effe2a5","Type":"ContainerDied","Data":"63a4e43ed365e1e18d8659b600bd60fa73298b183fc1e1bc7080083fca903b70"}
Jul 21 17:18:01.050885 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.050858    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:18:01.082826 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.082785    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:18:01.102542 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.102514    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lht9c\" (UniqueName: \"kubernetes.io/projected/14db8b79-3e88-4828-b6ed-d1b7290daf1a-kube-api-access-lht9c\") pod \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") "
Jul 21 17:18:01.102674 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.102594    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-bundle\") pod \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") "
Jul 21 17:18:01.102674 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.102623    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-util\") pod \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\" (UID: \"14db8b79-3e88-4828-b6ed-d1b7290daf1a\") "
Jul 21 17:18:01.103151 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.103092    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-bundle" (OuterVolumeSpecName: "bundle") pod "14db8b79-3e88-4828-b6ed-d1b7290daf1a" (UID: "14db8b79-3e88-4828-b6ed-d1b7290daf1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:01.103712 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.103691    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:01.104947 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.104903    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14db8b79-3e88-4828-b6ed-d1b7290daf1a-kube-api-access-lht9c" (OuterVolumeSpecName: "kube-api-access-lht9c") pod "14db8b79-3e88-4828-b6ed-d1b7290daf1a" (UID: "14db8b79-3e88-4828-b6ed-d1b7290daf1a"). InnerVolumeSpecName "kube-api-access-lht9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:18:01.110377 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.110346    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-util" (OuterVolumeSpecName: "util") pod "14db8b79-3e88-4828-b6ed-d1b7290daf1a" (UID: "14db8b79-3e88-4828-b6ed-d1b7290daf1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:01.204807 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.204776    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j7ww\" (UniqueName: \"kubernetes.io/projected/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-kube-api-access-4j7ww\") pod \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") "
Jul 21 17:18:01.204988 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.204844    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-bundle\") pod \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") "
Jul 21 17:18:01.204988 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.204883    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-util\") pod \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\" (UID: \"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5\") "
Jul 21 17:18:01.205139 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.205122    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lht9c\" (UniqueName: \"kubernetes.io/projected/14db8b79-3e88-4828-b6ed-d1b7290daf1a-kube-api-access-lht9c\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:01.205173 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.205147    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14db8b79-3e88-4828-b6ed-d1b7290daf1a-util\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:01.205377 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.205359    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-bundle" (OuterVolumeSpecName: "bundle") pod "086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" (UID: "086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:01.206974 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.206942    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-kube-api-access-4j7ww" (OuterVolumeSpecName: "kube-api-access-4j7ww") pod "086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" (UID: "086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5"). InnerVolumeSpecName "kube-api-access-4j7ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:18:01.210543 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.210508    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-util" (OuterVolumeSpecName: "util") pod "086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" (UID: "086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:01.305916 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.305838    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j7ww\" (UniqueName: \"kubernetes.io/projected/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-kube-api-access-4j7ww\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:01.305916 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.305869    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:01.305916 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.305881    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5-util\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:01.916399 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.916363    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl"
Jul 21 17:18:01.916399 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.916387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl" event={"ID":"14db8b79-3e88-4828-b6ed-d1b7290daf1a","Type":"ContainerDied","Data":"97d0a804a617b4892af8bbd364f96aeff686eb159fea229363f89cb6a01a9f87"}
Jul 21 17:18:01.916921 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.916432    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97d0a804a617b4892af8bbd364f96aeff686eb159fea229363f89cb6a01a9f87"
Jul 21 17:18:01.918371 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.918352    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6"
Jul 21 17:18:01.918503 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.918397    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6" event={"ID":"086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5","Type":"ContainerDied","Data":"d2ae8d8b24757b7d9d8cdce96ed11f18b75867d1e285e93a6ea45babc079b026"}
Jul 21 17:18:01.918503 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:01.918446    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2ae8d8b24757b7d9d8cdce96ed11f18b75867d1e285e93a6ea45babc079b026"
Jul 21 17:18:02.053483 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.053461    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:18:02.113200 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.113174    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-bundle\") pod \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") "
Jul 21 17:18:02.113393 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.113293    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzq98\" (UniqueName: \"kubernetes.io/projected/9818638a-1ec7-40a9-a647-ad2c1effe2a5-kube-api-access-fzq98\") pod \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") "
Jul 21 17:18:02.113393 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.113325    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-util\") pod \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\" (UID: \"9818638a-1ec7-40a9-a647-ad2c1effe2a5\") "
Jul 21 17:18:02.113844 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.113788    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-bundle" (OuterVolumeSpecName: "bundle") pod "9818638a-1ec7-40a9-a647-ad2c1effe2a5" (UID: "9818638a-1ec7-40a9-a647-ad2c1effe2a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:02.115358 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.115335    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9818638a-1ec7-40a9-a647-ad2c1effe2a5-kube-api-access-fzq98" (OuterVolumeSpecName: "kube-api-access-fzq98") pod "9818638a-1ec7-40a9-a647-ad2c1effe2a5" (UID: "9818638a-1ec7-40a9-a647-ad2c1effe2a5"). InnerVolumeSpecName "kube-api-access-fzq98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:18:02.118614 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.118581    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-util" (OuterVolumeSpecName: "util") pod "9818638a-1ec7-40a9-a647-ad2c1effe2a5" (UID: "9818638a-1ec7-40a9-a647-ad2c1effe2a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:02.214498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.214466    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzq98\" (UniqueName: \"kubernetes.io/projected/9818638a-1ec7-40a9-a647-ad2c1effe2a5-kube-api-access-fzq98\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:02.214498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.214492    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-util\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:02.214498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.214504    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9818638a-1ec7-40a9-a647-ad2c1effe2a5-bundle\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:02.925815 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.925770    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds" event={"ID":"9818638a-1ec7-40a9-a647-ad2c1effe2a5","Type":"ContainerDied","Data":"6e4a6cce5f402b0e4d15e40f56c6104830268b1c536a18fbbb9edc2ae62e77b6"}
Jul 21 17:18:02.926162 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.925836    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e4a6cce5f402b0e4d15e40f56c6104830268b1c536a18fbbb9edc2ae62e77b6"
Jul 21 17:18:02.926162 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:02.925783    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds"
Jul 21 17:18:08.789473 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:08.789443    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:12.228950 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:12.228916    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:13.546143 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546111    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"]
Jul 21 17:18:13.546509 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546490    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerName="util"
Jul 21 17:18:13.546509 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546501    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerName="util"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546511    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerName="pull"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546516    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerName="pull"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546527    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerName="extract"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546532    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerName="extract"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546543    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerName="extract"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546548    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerName="extract"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546559    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33210c4-7c8e-424c-aebc-61810093ea66" containerName="pull"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546564    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33210c4-7c8e-424c-aebc-61810093ea66" containerName="pull"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546570    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerName="pull"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546574    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerName="pull"
Jul 21 17:18:13.546581 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546583    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerName="util"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546588    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerName="util"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546594    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerName="util"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546598    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerName="util"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546607    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33210c4-7c8e-424c-aebc-61810093ea66" containerName="util"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546612    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33210c4-7c8e-424c-aebc-61810093ea66" containerName="util"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546617    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerName="pull"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546622    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerName="pull"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546628    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerName="extract"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546632    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerName="extract"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546639    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33210c4-7c8e-424c-aebc-61810093ea66" containerName="extract"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546644    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33210c4-7c8e-424c-aebc-61810093ea66" containerName="extract"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546697    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="14db8b79-3e88-4828-b6ed-d1b7290daf1a" containerName="extract"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546706    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f33210c4-7c8e-424c-aebc-61810093ea66" containerName="extract"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546713    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5" containerName="extract"
Jul 21 17:18:13.546929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.546721    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9818638a-1ec7-40a9-a647-ad2c1effe2a5" containerName="extract"
Jul 21 17:18:13.553764 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.553747    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:13.557300 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.557281    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-czqmv\""
Jul 21 17:18:13.568055 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.568035    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"]
Jul 21 17:18:13.621822 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.621771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l48kc\" (UniqueName: \"kubernetes.io/projected/7d86122e-25ce-4649-ba0f-29ed111c69bf-kube-api-access-l48kc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" (UID: \"7d86122e-25ce-4649-ba0f-29ed111c69bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:13.621965 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.621924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d86122e-25ce-4649-ba0f-29ed111c69bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" (UID: \"7d86122e-25ce-4649-ba0f-29ed111c69bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:13.723023 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.722999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l48kc\" (UniqueName: \"kubernetes.io/projected/7d86122e-25ce-4649-ba0f-29ed111c69bf-kube-api-access-l48kc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" (UID: \"7d86122e-25ce-4649-ba0f-29ed111c69bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:13.723135 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.723063    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d86122e-25ce-4649-ba0f-29ed111c69bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" (UID: \"7d86122e-25ce-4649-ba0f-29ed111c69bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:13.723388 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.723367    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d86122e-25ce-4649-ba0f-29ed111c69bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" (UID: \"7d86122e-25ce-4649-ba0f-29ed111c69bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:13.735755 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.735733    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l48kc\" (UniqueName: \"kubernetes.io/projected/7d86122e-25ce-4649-ba0f-29ed111c69bf-kube-api-access-l48kc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" (UID: \"7d86122e-25ce-4649-ba0f-29ed111c69bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:13.864369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:13.864280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:14.004097 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:14.004076    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"]
Jul 21 17:18:14.006386 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:18:14.006361    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d86122e_25ce_4649_ba0f_29ed111c69bf.slice/crio-c0f6facdc386a2e698ff55414586233fd2f74ce75944e80ee1fe81c3f5445e19 WatchSource:0}: Error finding container c0f6facdc386a2e698ff55414586233fd2f74ce75944e80ee1fe81c3f5445e19: Status 404 returned error can't find the container with id c0f6facdc386a2e698ff55414586233fd2f74ce75944e80ee1fe81c3f5445e19
Jul 21 17:18:14.278133 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:14.278102    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:14.997814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:14.997748    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq" event={"ID":"7d86122e-25ce-4649-ba0f-29ed111c69bf","Type":"ContainerStarted","Data":"c0f6facdc386a2e698ff55414586233fd2f74ce75944e80ee1fe81c3f5445e19"}
Jul 21 17:18:15.485992 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.485957    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"]
Jul 21 17:18:15.489651 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.489636    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"
Jul 21 17:18:15.492303 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.492287    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tlbtr\""
Jul 21 17:18:15.492605 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.492591    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 17:18:15.501128 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.501105    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"]
Jul 21 17:18:15.642483 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.642450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z647f\" (UniqueName: \"kubernetes.io/projected/7357fbe9-fbf5-4494-9d06-e94f593a9447-kube-api-access-z647f\") pod \"dns-operator-controller-manager-864dd78c4c-c99nf\" (UID: \"7357fbe9-fbf5-4494-9d06-e94f593a9447\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"
Jul 21 17:18:15.743548 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.743463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z647f\" (UniqueName: \"kubernetes.io/projected/7357fbe9-fbf5-4494-9d06-e94f593a9447-kube-api-access-z647f\") pod \"dns-operator-controller-manager-864dd78c4c-c99nf\" (UID: \"7357fbe9-fbf5-4494-9d06-e94f593a9447\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"
Jul 21 17:18:15.756340 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.756287    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z647f\" (UniqueName: \"kubernetes.io/projected/7357fbe9-fbf5-4494-9d06-e94f593a9447-kube-api-access-z647f\") pod \"dns-operator-controller-manager-864dd78c4c-c99nf\" (UID: \"7357fbe9-fbf5-4494-9d06-e94f593a9447\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"
Jul 21 17:18:15.785569 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.785539    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:15.800673 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.800648    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"
Jul 21 17:18:15.951904 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:15.951877    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"]
Jul 21 17:18:15.952950 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:18:15.952914    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7357fbe9_fbf5_4494_9d06_e94f593a9447.slice/crio-5a9ed54b86d9eb79a7f95099ec80ecadf8fd0f1e1855689e191b1c1188c2d2f4 WatchSource:0}: Error finding container 5a9ed54b86d9eb79a7f95099ec80ecadf8fd0f1e1855689e191b1c1188c2d2f4: Status 404 returned error can't find the container with id 5a9ed54b86d9eb79a7f95099ec80ecadf8fd0f1e1855689e191b1c1188c2d2f4
Jul 21 17:18:16.007121 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:16.007033    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf" event={"ID":"7357fbe9-fbf5-4494-9d06-e94f593a9447","Type":"ContainerStarted","Data":"5a9ed54b86d9eb79a7f95099ec80ecadf8fd0f1e1855689e191b1c1188c2d2f4"}
Jul 21 17:18:16.045440 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:16.045405    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:16.210708 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:16.210654    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:17.868784 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:17.868760    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 17:18:17.931059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:17.931036    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:18:17.931185 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:17.931086    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:18:18.023423 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:18.023391    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf" event={"ID":"7357fbe9-fbf5-4494-9d06-e94f593a9447","Type":"ContainerStarted","Data":"e9ce058f218bfd2df2bf9100279c1fd54d82dc957060b33dbad81d2aaffe06ad"}
Jul 21 17:18:18.023586 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:18.023479    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"
Jul 21 17:18:18.042832 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:18.042767    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf" podStartSLOduration=1.132237798 podStartE2EDuration="3.042750643s" totalImagesPullingTime="1.910512845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:18:18.040331987 +0000 UTC m=+600.585648204" watchObservedRunningTime="2026-07-21 17:18:18.042750643 +0000 UTC m=+600.588066858"
Jul 21 17:18:18.812776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:18.812738    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"]
Jul 21 17:18:18.817059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:18.817031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"
Jul 21 17:18:18.820153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:18.820121    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lpg7l\""
Jul 21 17:18:18.828272 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:18.828246    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"]
Jul 21 17:18:18.975445 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:18.975401    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtf5\" (UniqueName: \"kubernetes.io/projected/e5bb7f5d-4188-4360-8c19-d7e665975825-kube-api-access-xwtf5\") pod \"authorino-operator-75cc8d5cb7-9js2j\" (UID: \"e5bb7f5d-4188-4360-8c19-d7e665975825\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"
Jul 21 17:18:19.076684 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:19.076553    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtf5\" (UniqueName: \"kubernetes.io/projected/e5bb7f5d-4188-4360-8c19-d7e665975825-kube-api-access-xwtf5\") pod \"authorino-operator-75cc8d5cb7-9js2j\" (UID: \"e5bb7f5d-4188-4360-8c19-d7e665975825\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"
Jul 21 17:18:19.088919 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:19.088897    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtf5\" (UniqueName: \"kubernetes.io/projected/e5bb7f5d-4188-4360-8c19-d7e665975825-kube-api-access-xwtf5\") pod \"authorino-operator-75cc8d5cb7-9js2j\" (UID: \"e5bb7f5d-4188-4360-8c19-d7e665975825\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"
Jul 21 17:18:19.131741 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:19.131710    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"
Jul 21 17:18:19.314183 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:19.314155    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"]
Jul 21 17:18:19.315585 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:18:19.315558    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5bb7f5d_4188_4360_8c19_d7e665975825.slice/crio-51967626f521b18b93dfe4456bc5d4cdc81bd71080502d7ffc95d0a27dd8e719 WatchSource:0}: Error finding container 51967626f521b18b93dfe4456bc5d4cdc81bd71080502d7ffc95d0a27dd8e719: Status 404 returned error can't find the container with id 51967626f521b18b93dfe4456bc5d4cdc81bd71080502d7ffc95d0a27dd8e719
Jul 21 17:18:19.409731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:19.409643    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:19.825957 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:19.825928    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:19.916135 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:19.916093    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:20.042170 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:20.041348    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j" event={"ID":"e5bb7f5d-4188-4360-8c19-d7e665975825","Type":"ContainerStarted","Data":"51967626f521b18b93dfe4456bc5d4cdc81bd71080502d7ffc95d0a27dd8e719"}
Jul 21 17:18:20.044228 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:20.044196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq" event={"ID":"7d86122e-25ce-4649-ba0f-29ed111c69bf","Type":"ContainerStarted","Data":"08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a"}
Jul 21 17:18:20.044499 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:20.044481    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:20.068320 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:20.068258    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq" podStartSLOduration=1.8309851369999999 podStartE2EDuration="7.068238209s" totalImagesPullingTime="5.237253072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:18:20.065887925 +0000 UTC m=+602.611204142" watchObservedRunningTime="2026-07-21 17:18:20.068238209 +0000 UTC m=+602.613554429"
Jul 21 17:18:21.479324 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.479286    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"]
Jul 21 17:18:21.483147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.483124    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:21.485877 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.485855    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vshn5\""
Jul 21 17:18:21.495284 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.495261    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"]
Jul 21 17:18:21.601226 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.601190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwcb2\" (UniqueName: \"kubernetes.io/projected/cac7381e-02c7-42d2-bd5e-90d6839b36cc-kube-api-access-dwcb2\") pod \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" (UID: \"cac7381e-02c7-42d2-bd5e-90d6839b36cc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:21.701853 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.701786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwcb2\" (UniqueName: \"kubernetes.io/projected/cac7381e-02c7-42d2-bd5e-90d6839b36cc-kube-api-access-dwcb2\") pod \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" (UID: \"cac7381e-02c7-42d2-bd5e-90d6839b36cc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:21.711660 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.711630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwcb2\" (UniqueName: \"kubernetes.io/projected/cac7381e-02c7-42d2-bd5e-90d6839b36cc-kube-api-access-dwcb2\") pod \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" (UID: \"cac7381e-02c7-42d2-bd5e-90d6839b36cc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:21.797674 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.797647    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:21.945612 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:21.945585    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"]
Jul 21 17:18:21.947433 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:18:21.947406    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac7381e_02c7_42d2_bd5e_90d6839b36cc.slice/crio-a56e2ac20ec566a6ecf1fbb4c66bb9d735a46775dc56a05f26c4354f9037f3e5 WatchSource:0}: Error finding container a56e2ac20ec566a6ecf1fbb4c66bb9d735a46775dc56a05f26c4354f9037f3e5: Status 404 returned error can't find the container with id a56e2ac20ec566a6ecf1fbb4c66bb9d735a46775dc56a05f26c4354f9037f3e5
Jul 21 17:18:22.063029 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:22.063002    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"
Jul 21 17:18:22.063196 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:22.063048    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j" event={"ID":"e5bb7f5d-4188-4360-8c19-d7e665975825","Type":"ContainerStarted","Data":"271561fbda8c8faf0e9f39678699c8f61e64afcf50417897ebe587bfc522276e"}
Jul 21 17:18:22.063196 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:22.063068    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb" event={"ID":"cac7381e-02c7-42d2-bd5e-90d6839b36cc","Type":"ContainerStarted","Data":"a56e2ac20ec566a6ecf1fbb4c66bb9d735a46775dc56a05f26c4354f9037f3e5"}
Jul 21 17:18:22.080570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:22.080521    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j" podStartSLOduration=1.733259974 podStartE2EDuration="4.080503553s" totalImagesPullingTime="2.347243579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:18:22.079988679 +0000 UTC m=+604.625304899" watchObservedRunningTime="2026-07-21 17:18:22.080503553 +0000 UTC m=+604.625819768"
Jul 21 17:18:22.403456 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:22.403376    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:22.622239 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:22.622209    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:23.449731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:23.449697    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:24.952672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:24.952640    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:25.082160 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:25.082128    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb" event={"ID":"cac7381e-02c7-42d2-bd5e-90d6839b36cc","Type":"ContainerStarted","Data":"6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2"}
Jul 21 17:18:25.082339 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:25.082254    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:25.105953 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:25.105906    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb" podStartSLOduration=1.7668351420000001 podStartE2EDuration="4.105891943s" totalImagesPullingTime="2.339056801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:18:25.103329117 +0000 UTC m=+607.648645334" watchObservedRunningTime="2026-07-21 17:18:25.105891943 +0000 UTC m=+607.651208223"
Jul 21 17:18:29.032688 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:29.032661    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c99nf"
Jul 21 17:18:31.055771 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:31.055743    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:32.599025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.598996    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:32.700032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.700002    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:32.712342 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.712317    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"]
Jul 21 17:18:32.712566 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.712541    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" containerName="manager" containerID="cri-o://08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a" gracePeriod=2
Jul 21 17:18:32.716832 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.716772    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:32.716962 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.716856    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"]
Jul 21 17:18:32.734600 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.734579    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"]
Jul 21 17:18:32.734895 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.734853    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" containerName="manager" containerID="cri-o://6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2" gracePeriod=2
Jul 21 17:18:32.736773 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.736750    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:32.739105 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.739081    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:32.750972 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.750941    2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cac7381e-02c7-42d2-bd5e-90d6839b36cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-pxwvb\": pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:32.751097 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.751021    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"]
Jul 21 17:18:32.753368 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.753335    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:32.754807 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.754775    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"]
Jul 21 17:18:32.755369 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.755353    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" containerName="manager"
Jul 21 17:18:32.755431 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.755373    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" containerName="manager"
Jul 21 17:18:32.755431 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.755392    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" containerName="manager"
Jul 21 17:18:32.755431 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.755401    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" containerName="manager"
Jul 21 17:18:32.755571 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.755514    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:32.755571 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.755527    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" containerName="manager"
Jul 21 17:18:32.755571 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.755559    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" containerName="manager"
Jul 21 17:18:32.758744 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.758702    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:32.760841 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.760811    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:32.763463 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.763437    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:32.765684 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.765667    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"]
Jul 21 17:18:32.769215 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.769195    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"
Jul 21 17:18:32.771481 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.771458    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"]
Jul 21 17:18:32.787104 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.787078    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"]
Jul 21 17:18:32.807385 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.807363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjdnb\" (UniqueName: \"kubernetes.io/projected/510284b6-8834-4737-a2a3-d17a341e630c-kube-api-access-tjdnb\") pod \"limitador-operator-controller-manager-859d7b78bd-df9g5\" (UID: \"510284b6-8834-4737-a2a3-d17a341e630c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"
Jul 21 17:18:32.807519 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.807401    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvd8\" (UniqueName: \"kubernetes.io/projected/fc2de8af-6ea0-463b-814e-6cc236b14bf7-kube-api-access-skvd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7vsz8\" (UID: \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:32.807582 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.807509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2de8af-6ea0-463b-814e-6cc236b14bf7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7vsz8\" (UID: \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:32.809041 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.809012    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:32.813557 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.813535    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:32.908865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.908783    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2de8af-6ea0-463b-814e-6cc236b14bf7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7vsz8\" (UID: \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:32.909025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.908929    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjdnb\" (UniqueName: \"kubernetes.io/projected/510284b6-8834-4737-a2a3-d17a341e630c-kube-api-access-tjdnb\") pod \"limitador-operator-controller-manager-859d7b78bd-df9g5\" (UID: \"510284b6-8834-4737-a2a3-d17a341e630c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"
Jul 21 17:18:32.909025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.908979    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvd8\" (UniqueName: \"kubernetes.io/projected/fc2de8af-6ea0-463b-814e-6cc236b14bf7-kube-api-access-skvd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7vsz8\" (UID: \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:32.909250 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.909197    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2de8af-6ea0-463b-814e-6cc236b14bf7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7vsz8\" (UID: \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:32.918729 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.918705    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjdnb\" (UniqueName: \"kubernetes.io/projected/510284b6-8834-4737-a2a3-d17a341e630c-kube-api-access-tjdnb\") pod \"limitador-operator-controller-manager-859d7b78bd-df9g5\" (UID: \"510284b6-8834-4737-a2a3-d17a341e630c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"
Jul 21 17:18:32.920104 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.920062    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvd8\" (UniqueName: \"kubernetes.io/projected/fc2de8af-6ea0-463b-814e-6cc236b14bf7-kube-api-access-skvd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7vsz8\" (UID: \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:32.973346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.973323    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:32.976091 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.976067    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:32.977722 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:32.977706    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:32.978842 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.978818    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:32.981755 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.981735    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:32.983581 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:32.983564    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:33.010020 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.009999    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l48kc\" (UniqueName: \"kubernetes.io/projected/7d86122e-25ce-4649-ba0f-29ed111c69bf-kube-api-access-l48kc\") pod \"7d86122e-25ce-4649-ba0f-29ed111c69bf\" (UID: \"7d86122e-25ce-4649-ba0f-29ed111c69bf\") "
Jul 21 17:18:33.010131 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.010035    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d86122e-25ce-4649-ba0f-29ed111c69bf-extensions-socket-volume\") pod \"7d86122e-25ce-4649-ba0f-29ed111c69bf\" (UID: \"7d86122e-25ce-4649-ba0f-29ed111c69bf\") "
Jul 21 17:18:33.010180 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.010164    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwcb2\" (UniqueName: \"kubernetes.io/projected/cac7381e-02c7-42d2-bd5e-90d6839b36cc-kube-api-access-dwcb2\") pod \"cac7381e-02c7-42d2-bd5e-90d6839b36cc\" (UID: \"cac7381e-02c7-42d2-bd5e-90d6839b36cc\") "
Jul 21 17:18:33.010543 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.010522    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d86122e-25ce-4649-ba0f-29ed111c69bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7d86122e-25ce-4649-ba0f-29ed111c69bf" (UID: "7d86122e-25ce-4649-ba0f-29ed111c69bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:18:33.012034 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.012009    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d86122e-25ce-4649-ba0f-29ed111c69bf-kube-api-access-l48kc" (OuterVolumeSpecName: "kube-api-access-l48kc") pod "7d86122e-25ce-4649-ba0f-29ed111c69bf" (UID: "7d86122e-25ce-4649-ba0f-29ed111c69bf"). InnerVolumeSpecName "kube-api-access-l48kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:18:33.012109 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.012057    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cac7381e-02c7-42d2-bd5e-90d6839b36cc-kube-api-access-dwcb2" (OuterVolumeSpecName: "kube-api-access-dwcb2") pod "cac7381e-02c7-42d2-bd5e-90d6839b36cc" (UID: "cac7381e-02c7-42d2-bd5e-90d6839b36cc"). InnerVolumeSpecName "kube-api-access-dwcb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:18:33.071574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.071548    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9js2j"
Jul 21 17:18:33.074250 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.074219    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:33.109922 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.109836    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:33.111246 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.111226    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l48kc\" (UniqueName: \"kubernetes.io/projected/7d86122e-25ce-4649-ba0f-29ed111c69bf-kube-api-access-l48kc\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:33.111291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.111252    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d86122e-25ce-4649-ba0f-29ed111c69bf-extensions-socket-volume\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:33.111291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.111266    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwcb2\" (UniqueName: \"kubernetes.io/projected/cac7381e-02c7-42d2-bd5e-90d6839b36cc-kube-api-access-dwcb2\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:18:33.130944 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.130918    2557 generic.go:356] "Generic (PLEG): container finished" podID="7d86122e-25ce-4649-ba0f-29ed111c69bf" containerID="08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a" exitCode=0
Jul 21 17:18:33.131090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.130969    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:33.131090 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.131033    2557 scope.go:117] "RemoveContainer" containerID="08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a"
Jul 21 17:18:33.132397 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.132368    2557 generic.go:356] "Generic (PLEG): container finished" podID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" containerID="6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2" exitCode=0
Jul 21 17:18:33.132531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.132442    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:33.133554 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.133530    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:33.135918 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.135895    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:33.138381 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.138359    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:33.140722 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.140695    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:33.141516 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.141497    2557 scope.go:117] "RemoveContainer" containerID="08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a"
Jul 21 17:18:33.141872 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.141847    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a\": container with ID starting with 08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a not found: ID does not exist" containerID="08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a"
Jul 21 17:18:33.141951 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.141880    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a"} err="failed to get container status \"08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a\": rpc error: code = NotFound desc = could not find container \"08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a\": container with ID starting with 08f2264041247046b6911bc7c5e88071accca17d378013cf5e39de82f1bd523a not found: ID does not exist"
Jul 21 17:18:33.141951 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.141900    2557 scope.go:117] "RemoveContainer" containerID="6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2"
Jul 21 17:18:33.143260 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.143092    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:33.147472 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.147342    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:33.149278 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.149258    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"
Jul 21 17:18:33.149543 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.149522    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:33.151819 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.151781    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pxwvb\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxwvb"
Jul 21 17:18:33.152347 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.152333    2557 scope.go:117] "RemoveContainer" containerID="6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2"
Jul 21 17:18:33.152632 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.152608    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2\": container with ID starting with 6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2 not found: ID does not exist" containerID="6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2"
Jul 21 17:18:33.152727 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.152644    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2"} err="failed to get container status \"6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2\": rpc error: code = NotFound desc = could not find container \"6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2\": container with ID starting with 6bca1739348cf4ec8e6674264b63fe9dd895adea577fed2928f9acd1d66242c2 not found: ID does not exist"
Jul 21 17:18:33.153939 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:18:33.153912    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zsmmq\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zsmmq"
Jul 21 17:18:33.301502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.301471    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"]
Jul 21 17:18:33.302791 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:18:33.302764    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod510284b6_8834_4737_a2a3_d17a341e630c.slice/crio-9af6c903ee8497674a83c9d944f59a66ed774b95282566376933ba1a4fd46af4 WatchSource:0}: Error finding container 9af6c903ee8497674a83c9d944f59a66ed774b95282566376933ba1a4fd46af4: Status 404 returned error can't find the container with id 9af6c903ee8497674a83c9d944f59a66ed774b95282566376933ba1a4fd46af4
Jul 21 17:18:33.325775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:33.325757    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"]
Jul 21 17:18:33.327411 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:18:33.327385    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2de8af_6ea0_463b_814e_6cc236b14bf7.slice/crio-c2a3c052dcd53962c8af8f514f3b0df6f5c31682b4f040ab8aa30e0d35e1aa19 WatchSource:0}: Error finding container c2a3c052dcd53962c8af8f514f3b0df6f5c31682b4f040ab8aa30e0d35e1aa19: Status 404 returned error can't find the container with id c2a3c052dcd53962c8af8f514f3b0df6f5c31682b4f040ab8aa30e0d35e1aa19
Jul 21 17:18:34.063307 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.063276    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d86122e-25ce-4649-ba0f-29ed111c69bf" path="/var/lib/kubelet/pods/7d86122e-25ce-4649-ba0f-29ed111c69bf/volumes"
Jul 21 17:18:34.063661 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.063603    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cac7381e-02c7-42d2-bd5e-90d6839b36cc" path="/var/lib/kubelet/pods/cac7381e-02c7-42d2-bd5e-90d6839b36cc/volumes"
Jul 21 17:18:34.138975 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.138946    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8" event={"ID":"fc2de8af-6ea0-463b-814e-6cc236b14bf7","Type":"ContainerStarted","Data":"6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b"}
Jul 21 17:18:34.139149 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.138990    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8" event={"ID":"fc2de8af-6ea0-463b-814e-6cc236b14bf7","Type":"ContainerStarted","Data":"c2a3c052dcd53962c8af8f514f3b0df6f5c31682b4f040ab8aa30e0d35e1aa19"}
Jul 21 17:18:34.139149 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.139047    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:34.140467 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.140444    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5" event={"ID":"510284b6-8834-4737-a2a3-d17a341e630c","Type":"ContainerStarted","Data":"2e152866473feff01b68e7b0c177c3ba6d41c7fdb228c0c364b465e85fb2dcd7"}
Jul 21 17:18:34.140574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.140486    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5" event={"ID":"510284b6-8834-4737-a2a3-d17a341e630c","Type":"ContainerStarted","Data":"9af6c903ee8497674a83c9d944f59a66ed774b95282566376933ba1a4fd46af4"}
Jul 21 17:18:34.140574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.140507    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"
Jul 21 17:18:34.164495 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.164432    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8" podStartSLOduration=2.164398754 podStartE2EDuration="2.164398754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:18:34.161749741 +0000 UTC m=+616.707065955" watchObservedRunningTime="2026-07-21 17:18:34.164398754 +0000 UTC m=+616.709714970"
Jul 21 17:18:34.186826 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:34.186741    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5" podStartSLOduration=2.186726398 podStartE2EDuration="2.186726398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:18:34.186601279 +0000 UTC m=+616.731917498" watchObservedRunningTime="2026-07-21 17:18:34.186726398 +0000 UTC m=+616.732042614"
Jul 21 17:18:37.010494 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:37.010463    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:37.121417 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:37.121389    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:38.605353 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:38.605322    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:38.667534 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:38.667504    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:39.219242 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:39.219170    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:39.286813 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:39.286716    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:42.995684 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:42.995636    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:43.096647 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:43.096613    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:45.149814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:45.149773    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:18:45.150180 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:45.149937    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-df9g5"
Jul 21 17:18:46.792924 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:46.792891    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:46.862951 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:46.862917    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:53.482373 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:53.482340    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:53.989639 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:53.989576    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:18:54.063555 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:18:54.063510    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:00.005949 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:00.005920    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:00.238231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:00.238190    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:03.015263 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:03.015232    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:03.115955 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:03.115918    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:04.703968 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:04.703936    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"]
Jul 21 17:19:04.704414 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:04.704159    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8" podUID="fc2de8af-6ea0-463b-814e-6cc236b14bf7" containerName="manager" containerID="cri-o://6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b" gracePeriod=10
Jul 21 17:19:04.955396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:04.955339    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:19:05.103651 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.103616    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2de8af-6ea0-463b-814e-6cc236b14bf7-extensions-socket-volume\") pod \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\" (UID: \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\") "
Jul 21 17:19:05.103882 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.103726    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skvd8\" (UniqueName: \"kubernetes.io/projected/fc2de8af-6ea0-463b-814e-6cc236b14bf7-kube-api-access-skvd8\") pod \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\" (UID: \"fc2de8af-6ea0-463b-814e-6cc236b14bf7\") "
Jul 21 17:19:05.104118 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.104081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2de8af-6ea0-463b-814e-6cc236b14bf7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc2de8af-6ea0-463b-814e-6cc236b14bf7" (UID: "fc2de8af-6ea0-463b-814e-6cc236b14bf7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:19:05.105827 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.105787    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2de8af-6ea0-463b-814e-6cc236b14bf7-kube-api-access-skvd8" (OuterVolumeSpecName: "kube-api-access-skvd8") pod "fc2de8af-6ea0-463b-814e-6cc236b14bf7" (UID: "fc2de8af-6ea0-463b-814e-6cc236b14bf7"). InnerVolumeSpecName "kube-api-access-skvd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:19:05.205448 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.205367    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skvd8\" (UniqueName: \"kubernetes.io/projected/fc2de8af-6ea0-463b-814e-6cc236b14bf7-kube-api-access-skvd8\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:19:05.205448 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.205392    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2de8af-6ea0-463b-814e-6cc236b14bf7-extensions-socket-volume\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:19:05.337245 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.337209    2557 generic.go:356] "Generic (PLEG): container finished" podID="fc2de8af-6ea0-463b-814e-6cc236b14bf7" containerID="6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b" exitCode=0
Jul 21 17:19:05.337411 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.337252    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"
Jul 21 17:19:05.337411 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.337288    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8" event={"ID":"fc2de8af-6ea0-463b-814e-6cc236b14bf7","Type":"ContainerDied","Data":"6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b"}
Jul 21 17:19:05.337411 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.337342    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8" event={"ID":"fc2de8af-6ea0-463b-814e-6cc236b14bf7","Type":"ContainerDied","Data":"c2a3c052dcd53962c8af8f514f3b0df6f5c31682b4f040ab8aa30e0d35e1aa19"}
Jul 21 17:19:05.337411 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.337377    2557 scope.go:117] "RemoveContainer" containerID="6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b"
Jul 21 17:19:05.346832 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.346789    2557 scope.go:117] "RemoveContainer" containerID="6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b"
Jul 21 17:19:05.347068 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:19:05.347052    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b\": container with ID starting with 6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b not found: ID does not exist" containerID="6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b"
Jul 21 17:19:05.347124 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.347075    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b"} err="failed to get container status \"6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b\": rpc error: code = NotFound desc = could not find container \"6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b\": container with ID starting with 6ccee5b199d47089d70649b7637e7337cd44e6fd70c7cb2992673fe3279e105b not found: ID does not exist"
Jul 21 17:19:05.388515 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.388478    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"]
Jul 21 17:19:05.406446 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:05.406410    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7vsz8"]
Jul 21 17:19:06.062110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:06.062082    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc2de8af-6ea0-463b-814e-6cc236b14bf7" path="/var/lib/kubelet/pods/fc2de8af-6ea0-463b-814e-6cc236b14bf7/volumes"
Jul 21 17:19:07.413158 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:07.413108    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:07.483780 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:07.483747    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:14.406831 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:14.406763    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:14.474584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:14.474514    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:20.609101 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:20.609058    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:20.708483 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:20.708429    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:21.167510 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.167483    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"]
Jul 21 17:19:21.167964 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.167937    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2de8af-6ea0-463b-814e-6cc236b14bf7" containerName="manager"
Jul 21 17:19:21.167964 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.167957    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2de8af-6ea0-463b-814e-6cc236b14bf7" containerName="manager"
Jul 21 17:19:21.168111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.168090    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2de8af-6ea0-463b-814e-6cc236b14bf7" containerName="manager"
Jul 21 17:19:21.172446 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.172423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.176428 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.176412    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 17:19:21.176902 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.176887    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sq5mr\""
Jul 21 17:19:21.206585 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.206546    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"]
Jul 21 17:19:21.235927 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.235898    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:21.248122 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248093    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.248301 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248134    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.248301 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.248301 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.248301 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248230    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.248301 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.248301 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248303    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.248614 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.248614 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.248471    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckp4m\" (UniqueName: \"kubernetes.io/projected/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-kube-api-access-ckp4m\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.330541 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.330493    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:21.348960 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.348927    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.348960 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.348960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckp4m\" (UniqueName: \"kubernetes.io/projected/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-kube-api-access-ckp4m\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349199 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.348997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349199 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349177    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349345 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349324    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349391 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349447 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349504 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349572 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349703 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349872 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.349964 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.349944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.350055 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.350007    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.351290 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.351267    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.351791 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.351774    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.358279 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.358255    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.358493 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.358476    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckp4m\" (UniqueName: \"kubernetes.io/projected/d8d8c43d-a4a0-43bb-a514-4382ef395cf5-kube-api-access-ckp4m\") pod \"maas-default-gateway-openshift-default-56654dcf7-vkrff\" (UID: \"d8d8c43d-a4a0-43bb-a514-4382ef395cf5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.483386 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.483281    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:21.622852 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:19:21.622825    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d8c43d_a4a0_43bb_a514_4382ef395cf5.slice/crio-ea456aff4091401deeca041a864c4a7b5780dfe87d61ecc7efb0e58bd03c9026 WatchSource:0}: Error finding container ea456aff4091401deeca041a864c4a7b5780dfe87d61ecc7efb0e58bd03c9026: Status 404 returned error can't find the container with id ea456aff4091401deeca041a864c4a7b5780dfe87d61ecc7efb0e58bd03c9026
Jul 21 17:19:21.623637 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:21.623607    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"]
Jul 21 17:19:22.433191 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:22.433153    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" event={"ID":"d8d8c43d-a4a0-43bb-a514-4382ef395cf5","Type":"ContainerStarted","Data":"ea456aff4091401deeca041a864c4a7b5780dfe87d61ecc7efb0e58bd03c9026"}
Jul 21 17:19:23.614346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:23.614307    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:23.727400 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:23.727363    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:24.540612 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:24.540575    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:19:24.540713 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:24.540647    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:19:24.540713 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:24.540694    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:19:25.454015 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:25.453981    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" event={"ID":"d8d8c43d-a4a0-43bb-a514-4382ef395cf5","Type":"ContainerStarted","Data":"30d5cb9d76ba61fd32020b6087a9aea3d9a735ea99824d7b921306200656b18f"}
Jul 21 17:19:25.478044 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:25.477994    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" podStartSLOduration=1.5626434900000001 podStartE2EDuration="4.477979652s" totalImagesPullingTime="2.915336162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:19:25.476026557 +0000 UTC m=+668.021342774" watchObservedRunningTime="2026-07-21 17:19:25.477979652 +0000 UTC m=+668.023295867"
Jul 21 17:19:25.483771 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:25.483750    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:25.488639 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:25.488619    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:26.460027 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.459989    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:26.460983 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.460964    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:19:26.508657 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.508626    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:26.511219 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.511194    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2tq28"]
Jul 21 17:19:26.515284 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.515267    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:26.519162 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.519126    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w9h6f\""
Jul 21 17:19:26.531314 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.531284    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2tq28"]
Jul 21 17:19:26.532132 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.532103    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 17:19:26.601751 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.601720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfgl\" (UniqueName: \"kubernetes.io/projected/f0374152-89cc-437b-81aa-6c09656923aa-kube-api-access-5mfgl\") pod \"limitador-limitador-64c94fd64f-2tq28\" (UID: \"f0374152-89cc-437b-81aa-6c09656923aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:26.601959 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.601927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0374152-89cc-437b-81aa-6c09656923aa-config-file\") pod \"limitador-limitador-64c94fd64f-2tq28\" (UID: \"f0374152-89cc-437b-81aa-6c09656923aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:26.613063 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.613024    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2tq28"]
Jul 21 17:19:26.660991 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.660950    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:26.703306 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.703273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfgl\" (UniqueName: \"kubernetes.io/projected/f0374152-89cc-437b-81aa-6c09656923aa-kube-api-access-5mfgl\") pod \"limitador-limitador-64c94fd64f-2tq28\" (UID: \"f0374152-89cc-437b-81aa-6c09656923aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:26.703455 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.703358    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0374152-89cc-437b-81aa-6c09656923aa-config-file\") pod \"limitador-limitador-64c94fd64f-2tq28\" (UID: \"f0374152-89cc-437b-81aa-6c09656923aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:26.704111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.704088    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0374152-89cc-437b-81aa-6c09656923aa-config-file\") pod \"limitador-limitador-64c94fd64f-2tq28\" (UID: \"f0374152-89cc-437b-81aa-6c09656923aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:26.713349 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.713290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfgl\" (UniqueName: \"kubernetes.io/projected/f0374152-89cc-437b-81aa-6c09656923aa-kube-api-access-5mfgl\") pod \"limitador-limitador-64c94fd64f-2tq28\" (UID: \"f0374152-89cc-437b-81aa-6c09656923aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:26.761834 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.761785    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:26.836812 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.836771    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:26.893437 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.893408    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:19:26.899038 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.899016    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:26.908495 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.908450    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:19:26.919422 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.919401    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:19:26.981193 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:26.981168    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2tq28"]
Jul 21 17:19:26.982617 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:19:26.982591    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0374152_89cc_437b_81aa_6c09656923aa.slice/crio-923d0203701f6872cda8f1884a6068c7c7ac56bdd79a9230617d69afb50db36c WatchSource:0}: Error finding container 923d0203701f6872cda8f1884a6068c7c7ac56bdd79a9230617d69afb50db36c: Status 404 returned error can't find the container with id 923d0203701f6872cda8f1884a6068c7c7ac56bdd79a9230617d69afb50db36c
Jul 21 17:19:27.006628 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.006607    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6-config-file\") pod \"limitador-limitador-54d6d988d5-t9cts\" (UID: \"f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:27.006759 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.006635    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gvxf\" (UniqueName: \"kubernetes.io/projected/f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6-kube-api-access-6gvxf\") pod \"limitador-limitador-54d6d988d5-t9cts\" (UID: \"f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:27.108032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.107998    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6-config-file\") pod \"limitador-limitador-54d6d988d5-t9cts\" (UID: \"f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:27.108197 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.108035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvxf\" (UniqueName: \"kubernetes.io/projected/f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6-kube-api-access-6gvxf\") pod \"limitador-limitador-54d6d988d5-t9cts\" (UID: \"f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:27.108626 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.108606    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6-config-file\") pod \"limitador-limitador-54d6d988d5-t9cts\" (UID: \"f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:27.116826 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.116786    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvxf\" (UniqueName: \"kubernetes.io/projected/f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6-kube-api-access-6gvxf\") pod \"limitador-limitador-54d6d988d5-t9cts\" (UID: \"f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:27.214815 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.214767    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:27.328448 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.328391    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wb76w"]
Jul 21 17:19:27.333290 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.333269    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wb76w"
Jul 21 17:19:27.335997 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.335977    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hlwrs\""
Jul 21 17:19:27.337943 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.337920    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wb76w"]
Jul 21 17:19:27.350623 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.350451    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:19:27.353132 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:19:27.353111    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c99ebf_ead7_4ac6_895c_5fb0417fbdb6.slice/crio-8393692d27adc974340a15cebc0afb52ae05718a36f675d9bcc75f5ce871f78b WatchSource:0}: Error finding container 8393692d27adc974340a15cebc0afb52ae05718a36f675d9bcc75f5ce871f78b: Status 404 returned error can't find the container with id 8393692d27adc974340a15cebc0afb52ae05718a36f675d9bcc75f5ce871f78b
Jul 21 17:19:27.368444 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.368370    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:27.411250 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.411221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzzx\" (UniqueName: \"kubernetes.io/projected/be7d7eae-aaa9-4849-9d51-c63dc8bac9bb-kube-api-access-qjzzx\") pod \"authorino-58cd955675-wb76w\" (UID: \"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb\") " pod="kuadrant-system/authorino-58cd955675-wb76w"
Jul 21 17:19:27.464968 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.464931    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:27.467148 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.467126    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28" event={"ID":"f0374152-89cc-437b-81aa-6c09656923aa","Type":"ContainerStarted","Data":"923d0203701f6872cda8f1884a6068c7c7ac56bdd79a9230617d69afb50db36c"}
Jul 21 17:19:27.468340 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.468320    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts" event={"ID":"f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6","Type":"ContainerStarted","Data":"8393692d27adc974340a15cebc0afb52ae05718a36f675d9bcc75f5ce871f78b"}
Jul 21 17:19:27.512368 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.512328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzzx\" (UniqueName: \"kubernetes.io/projected/be7d7eae-aaa9-4849-9d51-c63dc8bac9bb-kube-api-access-qjzzx\") pod \"authorino-58cd955675-wb76w\" (UID: \"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb\") " pod="kuadrant-system/authorino-58cd955675-wb76w"
Jul 21 17:19:27.522617 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.522554    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzzx\" (UniqueName: \"kubernetes.io/projected/be7d7eae-aaa9-4849-9d51-c63dc8bac9bb-kube-api-access-qjzzx\") pod \"authorino-58cd955675-wb76w\" (UID: \"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb\") " pod="kuadrant-system/authorino-58cd955675-wb76w"
Jul 21 17:19:27.644817 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.644690    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wb76w"
Jul 21 17:19:27.823230 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:27.823169    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wb76w"]
Jul 21 17:19:27.825959 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:19:27.825932    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe7d7eae_aaa9_4849_9d51_c63dc8bac9bb.slice/crio-ce4dd26683ddd1b9f3e5af4a107a01799f79e755266a75ce2dc50188f2109c98 WatchSource:0}: Error finding container ce4dd26683ddd1b9f3e5af4a107a01799f79e755266a75ce2dc50188f2109c98: Status 404 returned error can't find the container with id ce4dd26683ddd1b9f3e5af4a107a01799f79e755266a75ce2dc50188f2109c98
Jul 21 17:19:28.478625 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:28.478567    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wb76w" event={"ID":"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb","Type":"ContainerStarted","Data":"ce4dd26683ddd1b9f3e5af4a107a01799f79e755266a75ce2dc50188f2109c98"}
Jul 21 17:19:31.860734 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:31.860636    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wb76w"]
Jul 21 17:19:32.506158 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:32.506123    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts" event={"ID":"f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6","Type":"ContainerStarted","Data":"0ed75cc5463e833cec2e427e456c36bd35d88f7253819303505bfa0414ab6872"}
Jul 21 17:19:32.506373 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:32.506189    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:32.507585 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:32.507561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wb76w" event={"ID":"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb","Type":"ContainerStarted","Data":"f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6"}
Jul 21 17:19:32.508976 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:32.508950    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28" event={"ID":"f0374152-89cc-437b-81aa-6c09656923aa","Type":"ContainerStarted","Data":"fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3"}
Jul 21 17:19:32.509055 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:32.509002    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:32.527615 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:32.527568    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts" podStartSLOduration=2.135962281 podStartE2EDuration="6.527553479s" totalImagesPullingTime="4.391591198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:19:32.52723492 +0000 UTC m=+675.072551139" watchObservedRunningTime="2026-07-21 17:19:32.527553479 +0000 UTC m=+675.072869698"
Jul 21 17:19:32.550306 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:32.550260    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28" podStartSLOduration=1.7936210049999999 podStartE2EDuration="6.550244682s" totalImagesPullingTime="4.756623677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:19:32.54810088 +0000 UTC m=+675.093417095" watchObservedRunningTime="2026-07-21 17:19:32.550244682 +0000 UTC m=+675.095560896"
Jul 21 17:19:32.564354 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:32.564314    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wb76w" podStartSLOduration=1.706326199 podStartE2EDuration="5.564300845s" totalImagesPullingTime="3.857974646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:19:32.562866819 +0000 UTC m=+675.108183034" watchObservedRunningTime="2026-07-21 17:19:32.564300845 +0000 UTC m=+675.109617059"
Jul 21 17:19:33.514757 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:33.514725    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wb76w" podUID="be7d7eae-aaa9-4849-9d51-c63dc8bac9bb" containerName="authorino" containerID="cri-o://f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6" gracePeriod=30
Jul 21 17:19:33.760529 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:33.760508    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wb76w"
Jul 21 17:19:33.874390 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:33.874310    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjzzx\" (UniqueName: \"kubernetes.io/projected/be7d7eae-aaa9-4849-9d51-c63dc8bac9bb-kube-api-access-qjzzx\") pod \"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb\" (UID: \"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb\") "
Jul 21 17:19:33.876388 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:33.876360    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7d7eae-aaa9-4849-9d51-c63dc8bac9bb-kube-api-access-qjzzx" (OuterVolumeSpecName: "kube-api-access-qjzzx") pod "be7d7eae-aaa9-4849-9d51-c63dc8bac9bb" (UID: "be7d7eae-aaa9-4849-9d51-c63dc8bac9bb"). InnerVolumeSpecName "kube-api-access-qjzzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:19:33.975293 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:33.975259    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjzzx\" (UniqueName: \"kubernetes.io/projected/be7d7eae-aaa9-4849-9d51-c63dc8bac9bb-kube-api-access-qjzzx\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:19:34.521476 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.521434    2557 generic.go:356] "Generic (PLEG): container finished" podID="be7d7eae-aaa9-4849-9d51-c63dc8bac9bb" containerID="f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6" exitCode=0
Jul 21 17:19:34.521476 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.521469    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wb76w" event={"ID":"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb","Type":"ContainerDied","Data":"f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6"}
Jul 21 17:19:34.522097 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.521517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wb76w" event={"ID":"be7d7eae-aaa9-4849-9d51-c63dc8bac9bb","Type":"ContainerDied","Data":"ce4dd26683ddd1b9f3e5af4a107a01799f79e755266a75ce2dc50188f2109c98"}
Jul 21 17:19:34.522097 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.521536    2557 scope.go:117] "RemoveContainer" containerID="f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6"
Jul 21 17:19:34.522097 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.521478    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wb76w"
Jul 21 17:19:34.530628 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.530612    2557 scope.go:117] "RemoveContainer" containerID="f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6"
Jul 21 17:19:34.530888 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:19:34.530872    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6\": container with ID starting with f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6 not found: ID does not exist" containerID="f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6"
Jul 21 17:19:34.530936 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.530896    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6"} err="failed to get container status \"f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6\": rpc error: code = NotFound desc = could not find container \"f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6\": container with ID starting with f53106d5421624cde9cab785ab0d5710666f64fcbbc87e7d64662660373ca4d6 not found: ID does not exist"
Jul 21 17:19:34.539950 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.539929    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wb76w"]
Jul 21 17:19:34.543908 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:34.543889    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wb76w"]
Jul 21 17:19:36.064260 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:36.064228    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be7d7eae-aaa9-4849-9d51-c63dc8bac9bb" path="/var/lib/kubelet/pods/be7d7eae-aaa9-4849-9d51-c63dc8bac9bb/volumes"
Jul 21 17:19:43.515741 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:43.515714    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:43.516257 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:43.515780    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9cts"
Jul 21 17:19:43.591857 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:43.591818    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2tq28"]
Jul 21 17:19:43.592040 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:43.591982    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28" podUID="f0374152-89cc-437b-81aa-6c09656923aa" containerName="limitador" containerID="cri-o://fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3" gracePeriod=30
Jul 21 17:19:44.549173 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.549151    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:44.589518 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.589487    2557 generic.go:356] "Generic (PLEG): container finished" podID="f0374152-89cc-437b-81aa-6c09656923aa" containerID="fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3" exitCode=0
Jul 21 17:19:44.589682 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.589537    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28"
Jul 21 17:19:44.589682 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.589580    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28" event={"ID":"f0374152-89cc-437b-81aa-6c09656923aa","Type":"ContainerDied","Data":"fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3"}
Jul 21 17:19:44.589682 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.589636    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2tq28" event={"ID":"f0374152-89cc-437b-81aa-6c09656923aa","Type":"ContainerDied","Data":"923d0203701f6872cda8f1884a6068c7c7ac56bdd79a9230617d69afb50db36c"}
Jul 21 17:19:44.589682 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.589662    2557 scope.go:117] "RemoveContainer" containerID="fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3"
Jul 21 17:19:44.599428 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.599195    2557 scope.go:117] "RemoveContainer" containerID="fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3"
Jul 21 17:19:44.599537 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:19:44.599517    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3\": container with ID starting with fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3 not found: ID does not exist" containerID="fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3"
Jul 21 17:19:44.599600 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.599546    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3"} err="failed to get container status \"fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3\": rpc error: code = NotFound desc = could not find container \"fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3\": container with ID starting with fda87398b2a41b27431175bd4e1175a07604688640b6402e0190970f3a9954e3 not found: ID does not exist"
Jul 21 17:19:44.675772 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.675685    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mfgl\" (UniqueName: \"kubernetes.io/projected/f0374152-89cc-437b-81aa-6c09656923aa-kube-api-access-5mfgl\") pod \"f0374152-89cc-437b-81aa-6c09656923aa\" (UID: \"f0374152-89cc-437b-81aa-6c09656923aa\") "
Jul 21 17:19:44.675772 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.675728    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0374152-89cc-437b-81aa-6c09656923aa-config-file\") pod \"f0374152-89cc-437b-81aa-6c09656923aa\" (UID: \"f0374152-89cc-437b-81aa-6c09656923aa\") "
Jul 21 17:19:44.676203 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.676171    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0374152-89cc-437b-81aa-6c09656923aa-config-file" (OuterVolumeSpecName: "config-file") pod "f0374152-89cc-437b-81aa-6c09656923aa" (UID: "f0374152-89cc-437b-81aa-6c09656923aa"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:19:44.678045 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.678012    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0374152-89cc-437b-81aa-6c09656923aa-kube-api-access-5mfgl" (OuterVolumeSpecName: "kube-api-access-5mfgl") pod "f0374152-89cc-437b-81aa-6c09656923aa" (UID: "f0374152-89cc-437b-81aa-6c09656923aa"). InnerVolumeSpecName "kube-api-access-5mfgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:19:44.776812 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.776769    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mfgl\" (UniqueName: \"kubernetes.io/projected/f0374152-89cc-437b-81aa-6c09656923aa-kube-api-access-5mfgl\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:19:44.776988 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.776835    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0374152-89cc-437b-81aa-6c09656923aa-config-file\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:19:44.921146 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.921057    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2tq28"]
Jul 21 17:19:44.923162 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:44.923135    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2tq28"]
Jul 21 17:19:45.624950 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:45.624921    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:45.683658 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:45.683627    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:46.063974 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:46.063943    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0374152-89cc-437b-81aa-6c09656923aa" path="/var/lib/kubelet/pods/f0374152-89cc-437b-81aa-6c09656923aa/volumes"
Jul 21 17:19:47.749069 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:47.749037    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:47.851515 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:47.851481    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:19:48.220902 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:19:48.220869    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:00.820267 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:00.820233    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:01.046550 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.046519    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n8sm6"]
Jul 21 17:20:01.046952 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.046938    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be7d7eae-aaa9-4849-9d51-c63dc8bac9bb" containerName="authorino"
Jul 21 17:20:01.047003 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.046953    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7d7eae-aaa9-4849-9d51-c63dc8bac9bb" containerName="authorino"
Jul 21 17:20:01.047003 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.046982    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0374152-89cc-437b-81aa-6c09656923aa" containerName="limitador"
Jul 21 17:20:01.047003 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.046988    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0374152-89cc-437b-81aa-6c09656923aa" containerName="limitador"
Jul 21 17:20:01.047102 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.047054    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0374152-89cc-437b-81aa-6c09656923aa" containerName="limitador"
Jul 21 17:20:01.047102 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.047062    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="be7d7eae-aaa9-4849-9d51-c63dc8bac9bb" containerName="authorino"
Jul 21 17:20:01.055492 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.055470    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n8sm6"
Jul 21 17:20:01.059690 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.059663    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hlwrs\""
Jul 21 17:20:01.061307 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.061287    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n8sm6"]
Jul 21 17:20:01.121694 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.121611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qgl\" (UniqueName: \"kubernetes.io/projected/d5ba3293-8780-41af-ad7e-83aa7845db4c-kube-api-access-j2qgl\") pod \"authorino-5d4b67c446-n8sm6\" (UID: \"d5ba3293-8780-41af-ad7e-83aa7845db4c\") " pod="kuadrant-system/authorino-5d4b67c446-n8sm6"
Jul 21 17:20:01.222455 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.222412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qgl\" (UniqueName: \"kubernetes.io/projected/d5ba3293-8780-41af-ad7e-83aa7845db4c-kube-api-access-j2qgl\") pod \"authorino-5d4b67c446-n8sm6\" (UID: \"d5ba3293-8780-41af-ad7e-83aa7845db4c\") " pod="kuadrant-system/authorino-5d4b67c446-n8sm6"
Jul 21 17:20:01.234850 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.234791    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qgl\" (UniqueName: \"kubernetes.io/projected/d5ba3293-8780-41af-ad7e-83aa7845db4c-kube-api-access-j2qgl\") pod \"authorino-5d4b67c446-n8sm6\" (UID: \"d5ba3293-8780-41af-ad7e-83aa7845db4c\") " pod="kuadrant-system/authorino-5d4b67c446-n8sm6"
Jul 21 17:20:01.251897 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.251870    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:01.300259 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.300213    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n8sm6"]
Jul 21 17:20:01.300539 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.300525    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n8sm6"
Jul 21 17:20:01.339348 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.339309    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58df68c754-wd495"]
Jul 21 17:20:01.342454 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.342433    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58df68c754-wd495"
Jul 21 17:20:01.352489 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.352461    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58df68c754-wd495"]
Jul 21 17:20:01.424839 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.424710    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwt9z\" (UniqueName: \"kubernetes.io/projected/98bfac7a-3936-4dee-b742-6c41a4aeaab2-kube-api-access-lwt9z\") pod \"authorino-58df68c754-wd495\" (UID: \"98bfac7a-3936-4dee-b742-6c41a4aeaab2\") " pod="kuadrant-system/authorino-58df68c754-wd495"
Jul 21 17:20:01.445376 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.445348    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n8sm6"]
Jul 21 17:20:01.446293 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:20:01.446274    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5ba3293_8780_41af_ad7e_83aa7845db4c.slice/crio-5eb7433c806431c69c81fe3003e72a74bd986844e677cfe8741478fdd13b45b8 WatchSource:0}: Error finding container 5eb7433c806431c69c81fe3003e72a74bd986844e677cfe8741478fdd13b45b8: Status 404 returned error can't find the container with id 5eb7433c806431c69c81fe3003e72a74bd986844e677cfe8741478fdd13b45b8
Jul 21 17:20:01.496998 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.496968    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58df68c754-wd495"]
Jul 21 17:20:01.497274 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:20:01.497255    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lwt9z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-58df68c754-wd495" podUID="98bfac7a-3936-4dee-b742-6c41a4aeaab2"
Jul 21 17:20:01.525692 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.525664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwt9z\" (UniqueName: \"kubernetes.io/projected/98bfac7a-3936-4dee-b742-6c41a4aeaab2-kube-api-access-lwt9z\") pod \"authorino-58df68c754-wd495\" (UID: \"98bfac7a-3936-4dee-b742-6c41a4aeaab2\") " pod="kuadrant-system/authorino-58df68c754-wd495"
Jul 21 17:20:01.529934 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.529911    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9b77c98fd-dw7qs"]
Jul 21 17:20:01.537366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.534031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:20:01.537366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.537280    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 17:20:01.537366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.537288    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwt9z\" (UniqueName: \"kubernetes.io/projected/98bfac7a-3936-4dee-b742-6c41a4aeaab2-kube-api-access-lwt9z\") pod \"authorino-58df68c754-wd495\" (UID: \"98bfac7a-3936-4dee-b742-6c41a4aeaab2\") " pod="kuadrant-system/authorino-58df68c754-wd495"
Jul 21 17:20:01.543153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.543123    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9b77c98fd-dw7qs"]
Jul 21 17:20:01.627017 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.626979    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt5ss\" (UniqueName: \"kubernetes.io/projected/5ef17bad-788e-4d46-bce9-b37850e2929a-kube-api-access-lt5ss\") pod \"authorino-9b77c98fd-dw7qs\" (UID: \"5ef17bad-788e-4d46-bce9-b37850e2929a\") " pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:20:01.627017 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.627021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ef17bad-788e-4d46-bce9-b37850e2929a-tls-cert\") pod \"authorino-9b77c98fd-dw7qs\" (UID: \"5ef17bad-788e-4d46-bce9-b37850e2929a\") " pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:20:01.703468 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.703381    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n8sm6" event={"ID":"d5ba3293-8780-41af-ad7e-83aa7845db4c","Type":"ContainerStarted","Data":"5eb7433c806431c69c81fe3003e72a74bd986844e677cfe8741478fdd13b45b8"}
Jul 21 17:20:01.703624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.703474    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58df68c754-wd495"
Jul 21 17:20:01.709191 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.709170    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58df68c754-wd495"
Jul 21 17:20:01.728329 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.728303    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwt9z\" (UniqueName: \"kubernetes.io/projected/98bfac7a-3936-4dee-b742-6c41a4aeaab2-kube-api-access-lwt9z\") pod \"98bfac7a-3936-4dee-b742-6c41a4aeaab2\" (UID: \"98bfac7a-3936-4dee-b742-6c41a4aeaab2\") "
Jul 21 17:20:01.728504 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.728489    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt5ss\" (UniqueName: \"kubernetes.io/projected/5ef17bad-788e-4d46-bce9-b37850e2929a-kube-api-access-lt5ss\") pod \"authorino-9b77c98fd-dw7qs\" (UID: \"5ef17bad-788e-4d46-bce9-b37850e2929a\") " pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:20:01.728548 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.728519    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ef17bad-788e-4d46-bce9-b37850e2929a-tls-cert\") pod \"authorino-9b77c98fd-dw7qs\" (UID: \"5ef17bad-788e-4d46-bce9-b37850e2929a\") " pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:20:01.730520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.730489    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98bfac7a-3936-4dee-b742-6c41a4aeaab2-kube-api-access-lwt9z" (OuterVolumeSpecName: "kube-api-access-lwt9z") pod "98bfac7a-3936-4dee-b742-6c41a4aeaab2" (UID: "98bfac7a-3936-4dee-b742-6c41a4aeaab2"). InnerVolumeSpecName "kube-api-access-lwt9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:20:01.730872 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.730854    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ef17bad-788e-4d46-bce9-b37850e2929a-tls-cert\") pod \"authorino-9b77c98fd-dw7qs\" (UID: \"5ef17bad-788e-4d46-bce9-b37850e2929a\") " pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:20:01.738246 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.738224    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt5ss\" (UniqueName: \"kubernetes.io/projected/5ef17bad-788e-4d46-bce9-b37850e2929a-kube-api-access-lt5ss\") pod \"authorino-9b77c98fd-dw7qs\" (UID: \"5ef17bad-788e-4d46-bce9-b37850e2929a\") " pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:20:01.829773 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.829746    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwt9z\" (UniqueName: \"kubernetes.io/projected/98bfac7a-3936-4dee-b742-6c41a4aeaab2-kube-api-access-lwt9z\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:20:01.855633 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:01.855613    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:20:02.002668 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.002644    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9b77c98fd-dw7qs"]
Jul 21 17:20:02.007411 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:20:02.007367    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ef17bad_788e_4d46_bce9_b37850e2929a.slice/crio-d52e9c18d319f68f57b763e2c4fdb0b79f4f8d81fa004ce7558713f3dc35e14a WatchSource:0}: Error finding container d52e9c18d319f68f57b763e2c4fdb0b79f4f8d81fa004ce7558713f3dc35e14a: Status 404 returned error can't find the container with id d52e9c18d319f68f57b763e2c4fdb0b79f4f8d81fa004ce7558713f3dc35e14a
Jul 21 17:20:02.710617 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.710576    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n8sm6" event={"ID":"d5ba3293-8780-41af-ad7e-83aa7845db4c","Type":"ContainerStarted","Data":"497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd"}
Jul 21 17:20:02.710617 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.710602    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-n8sm6" podUID="d5ba3293-8780-41af-ad7e-83aa7845db4c" containerName="authorino" containerID="cri-o://497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd" gracePeriod=30
Jul 21 17:20:02.712225 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.712202    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b77c98fd-dw7qs" event={"ID":"5ef17bad-788e-4d46-bce9-b37850e2929a","Type":"ContainerStarted","Data":"8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7"}
Jul 21 17:20:02.712346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.712237    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b77c98fd-dw7qs" event={"ID":"5ef17bad-788e-4d46-bce9-b37850e2929a","Type":"ContainerStarted","Data":"d52e9c18d319f68f57b763e2c4fdb0b79f4f8d81fa004ce7558713f3dc35e14a"}
Jul 21 17:20:02.712346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.712250    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58df68c754-wd495"
Jul 21 17:20:02.730635 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.730596    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-n8sm6" podStartSLOduration=1.374059314 podStartE2EDuration="1.730581212s" totalImagesPullingTime="356.521898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:20:02.726995801 +0000 UTC m=+705.272312052" watchObservedRunningTime="2026-07-21 17:20:02.730581212 +0000 UTC m=+705.275897427"
Jul 21 17:20:02.753199 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.753173    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58df68c754-wd495"]
Jul 21 17:20:02.759690 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.759668    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58df68c754-wd495"]
Jul 21 17:20:02.953174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.953151    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n8sm6"
Jul 21 17:20:02.972627 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:02.972577    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9b77c98fd-dw7qs" podStartSLOduration=1.4675083789999999 podStartE2EDuration="1.972561498s" totalImagesPullingTime="505.053119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:20:02.778378925 +0000 UTC m=+705.323695140" watchObservedRunningTime="2026-07-21 17:20:02.972561498 +0000 UTC m=+705.517877732"
Jul 21 17:20:03.041731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.041694    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2qgl\" (UniqueName: \"kubernetes.io/projected/d5ba3293-8780-41af-ad7e-83aa7845db4c-kube-api-access-j2qgl\") pod \"d5ba3293-8780-41af-ad7e-83aa7845db4c\" (UID: \"d5ba3293-8780-41af-ad7e-83aa7845db4c\") "
Jul 21 17:20:03.043764 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.043742    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5ba3293-8780-41af-ad7e-83aa7845db4c-kube-api-access-j2qgl" (OuterVolumeSpecName: "kube-api-access-j2qgl") pod "d5ba3293-8780-41af-ad7e-83aa7845db4c" (UID: "d5ba3293-8780-41af-ad7e-83aa7845db4c"). InnerVolumeSpecName "kube-api-access-j2qgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:20:03.138628 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.138548    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:03.143198 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.143161    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2qgl\" (UniqueName: \"kubernetes.io/projected/d5ba3293-8780-41af-ad7e-83aa7845db4c-kube-api-access-j2qgl\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:20:03.719584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.719551    2557 generic.go:356] "Generic (PLEG): container finished" podID="d5ba3293-8780-41af-ad7e-83aa7845db4c" containerID="497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd" exitCode=0
Jul 21 17:20:03.719867 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.719593    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n8sm6"
Jul 21 17:20:03.719867 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.719636    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n8sm6" event={"ID":"d5ba3293-8780-41af-ad7e-83aa7845db4c","Type":"ContainerDied","Data":"497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd"}
Jul 21 17:20:03.719867 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.719679    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n8sm6" event={"ID":"d5ba3293-8780-41af-ad7e-83aa7845db4c","Type":"ContainerDied","Data":"5eb7433c806431c69c81fe3003e72a74bd986844e677cfe8741478fdd13b45b8"}
Jul 21 17:20:03.719867 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.719697    2557 scope.go:117] "RemoveContainer" containerID="497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd"
Jul 21 17:20:03.729231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.729213    2557 scope.go:117] "RemoveContainer" containerID="497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd"
Jul 21 17:20:03.729521 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:20:03.729502    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd\": container with ID starting with 497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd not found: ID does not exist" containerID="497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd"
Jul 21 17:20:03.729579 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.729530    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd"} err="failed to get container status \"497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd\": rpc error: code = NotFound desc = could not find container \"497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd\": container with ID starting with 497ca35722c1b4e11b0c7b99b04701ca5058b387b80f5c4f5374daec5192f8dd not found: ID does not exist"
Jul 21 17:20:03.741984 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.741955    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n8sm6"]
Jul 21 17:20:03.748366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:03.748343    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n8sm6"]
Jul 21 17:20:04.063117 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:04.063088    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98bfac7a-3936-4dee-b742-6c41a4aeaab2" path="/var/lib/kubelet/pods/98bfac7a-3936-4dee-b742-6c41a4aeaab2/volumes"
Jul 21 17:20:04.063490 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:04.063309    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5ba3293-8780-41af-ad7e-83aa7845db4c" path="/var/lib/kubelet/pods/d5ba3293-8780-41af-ad7e-83aa7845db4c/volumes"
Jul 21 17:20:07.419657 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:07.419624    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:07.515129 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:07.515094    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:07.607655 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:07.607624    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:07.670396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:07.670315    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:10.915384 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:10.915300    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:11.023162 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:11.023127    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:45.286276 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:45.286241    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:45.384497 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:45.384462    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:45.878456 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:45.878427    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:46.149841 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.149734    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:46.424346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.424251    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:46.516516 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.516481    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:46.538571 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.538537    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k2gxw"]
Jul 21 17:20:46.539079 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.539061    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5ba3293-8780-41af-ad7e-83aa7845db4c" containerName="authorino"
Jul 21 17:20:46.539192 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.539080    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5ba3293-8780-41af-ad7e-83aa7845db4c" containerName="authorino"
Jul 21 17:20:46.539248 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.539212    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5ba3293-8780-41af-ad7e-83aa7845db4c" containerName="authorino"
Jul 21 17:20:46.542399 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.542379    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:46.544963 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.544943    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 17:20:46.545309 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.545294    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8lcfh\""
Jul 21 17:20:46.550880 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.550860    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k2gxw"]
Jul 21 17:20:46.654918 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.654885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klk7q\" (UniqueName: \"kubernetes.io/projected/ee98c371-e852-4a8d-9e18-e22379e14e9c-kube-api-access-klk7q\") pod \"payload-processing-5bf47cd988-k2gxw\" (UID: \"ee98c371-e852-4a8d-9e18-e22379e14e9c\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:46.655079 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.654964    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee98c371-e852-4a8d-9e18-e22379e14e9c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k2gxw\" (UID: \"ee98c371-e852-4a8d-9e18-e22379e14e9c\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:46.662043 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.662000    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:20:46.756378 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.756277    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee98c371-e852-4a8d-9e18-e22379e14e9c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k2gxw\" (UID: \"ee98c371-e852-4a8d-9e18-e22379e14e9c\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:46.756559 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.756385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klk7q\" (UniqueName: \"kubernetes.io/projected/ee98c371-e852-4a8d-9e18-e22379e14e9c-kube-api-access-klk7q\") pod \"payload-processing-5bf47cd988-k2gxw\" (UID: \"ee98c371-e852-4a8d-9e18-e22379e14e9c\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:46.757047 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.757027    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee98c371-e852-4a8d-9e18-e22379e14e9c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k2gxw\" (UID: \"ee98c371-e852-4a8d-9e18-e22379e14e9c\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:46.764570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.764550    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klk7q\" (UniqueName: \"kubernetes.io/projected/ee98c371-e852-4a8d-9e18-e22379e14e9c-kube-api-access-klk7q\") pod \"payload-processing-5bf47cd988-k2gxw\" (UID: \"ee98c371-e852-4a8d-9e18-e22379e14e9c\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:46.853743 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.853704    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:46.987317 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.987290    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k2gxw"]
Jul 21 17:20:46.988842 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:20:46.988769    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee98c371_e852_4a8d_9e18_e22379e14e9c.slice/crio-947ca68a3ed447a3931c6ee4a314a3520b207e2bcd6e68768bfc69d827a9ba61 WatchSource:0}: Error finding container 947ca68a3ed447a3931c6ee4a314a3520b207e2bcd6e68768bfc69d827a9ba61: Status 404 returned error can't find the container with id 947ca68a3ed447a3931c6ee4a314a3520b207e2bcd6e68768bfc69d827a9ba61
Jul 21 17:20:46.990944 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:46.990929    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:20:47.990028 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:47.989990    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw" event={"ID":"ee98c371-e852-4a8d-9e18-e22379e14e9c","Type":"ContainerStarted","Data":"947ca68a3ed447a3931c6ee4a314a3520b207e2bcd6e68768bfc69d827a9ba61"}
Jul 21 17:20:48.998459 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:48.998423    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw" event={"ID":"ee98c371-e852-4a8d-9e18-e22379e14e9c","Type":"ContainerStarted","Data":"2216c62352df0ec70762a23bb127f83d5f79a451a60752e3f211278832aea6ee"}
Jul 21 17:20:48.998879 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:48.998521    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:20:49.018715 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:49.018669    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw" podStartSLOduration=1.163622236 podStartE2EDuration="3.018652571s" totalImagesPullingTime="1.855030335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:20:49.016074129 +0000 UTC m=+751.561390346" watchObservedRunningTime="2026-07-21 17:20:49.018652571 +0000 UTC m=+751.563968786"
Jul 21 17:20:49.091293 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:49.091259    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:55.035733 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:55.035700    2557 generic.go:356] "Generic (PLEG): container finished" podID="d8d8c43d-a4a0-43bb-a514-4382ef395cf5" containerID="30d5cb9d76ba61fd32020b6087a9aea3d9a735ea99824d7b921306200656b18f" exitCode=0
Jul 21 17:20:55.036284 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:55.035778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" event={"ID":"d8d8c43d-a4a0-43bb-a514-4382ef395cf5","Type":"ContainerDied","Data":"30d5cb9d76ba61fd32020b6087a9aea3d9a735ea99824d7b921306200656b18f"}
Jul 21 17:20:55.036359 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:55.036344    2557 scope.go:117] "RemoveContainer" containerID="30d5cb9d76ba61fd32020b6087a9aea3d9a735ea99824d7b921306200656b18f"
Jul 21 17:20:55.037346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:55.037317    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:20:55.037433 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:55.037386    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:20:55.037433 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:55.037418    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 17:20:56.044669 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:56.044634    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" event={"ID":"d8d8c43d-a4a0-43bb-a514-4382ef395cf5","Type":"ContainerStarted","Data":"3b3a4a67307b2a143f61c44afb90098d4a461e706ff1d6e54d6e41ad081e9c22"}
Jul 21 17:20:56.460289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:56.460184    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:20:56.483731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:56.483690    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:20:56.484994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:56.484968    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vkrff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 21 17:20:56.485151 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:56.485024    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" podUID="d8d8c43d-a4a0-43bb-a514-4382ef395cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 21 17:20:56.715878 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:56.715770    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:57.167540 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:57.167500    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:57.270585 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:57.270539    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:20:57.484486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:57.484394    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vkrff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 21 17:20:57.484486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:57.484449    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" podUID="d8d8c43d-a4a0-43bb-a514-4382ef395cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 21 17:20:58.483985 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:58.483900    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vkrff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 21 17:20:58.483985 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:58.483953    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" podUID="d8d8c43d-a4a0-43bb-a514-4382ef395cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 21 17:20:59.484613 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:59.484568    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vkrff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 21 17:20:59.485028 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:20:59.484640    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff" podUID="d8d8c43d-a4a0-43bb-a514-4382ef395cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 21 17:21:00.006985 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:00.006955    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-k2gxw"
Jul 21 17:21:00.488014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:00.487982    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:21:00.489226 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:00.489207    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vkrff"
Jul 21 17:21:02.997828 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:02.997783    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:21:03.606701 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:03.606664    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:21:09.313842 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.313783    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"]
Jul 21 17:21:09.320053 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.320027    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.324281 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.324253    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 17:21:09.324523 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.324504    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 17:21:09.324719 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.324702    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-78xwk\""
Jul 21 17:21:09.325007 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.324990    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 21 17:21:09.327921 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.327898    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"]
Jul 21 17:21:09.397866 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.397831    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:21:09.409367 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.409341    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.409468 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.409411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.409468 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.409459    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqslq\" (UniqueName: \"kubernetes.io/projected/e383e41d-135e-4d11-ab1c-51acfc0d7615-kube-api-access-dqslq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.409538 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.409528    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.409594 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.409554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e383e41d-135e-4d11-ab1c-51acfc0d7615-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.409594 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.409570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.510733 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.510700    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.510733 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.510734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e383e41d-135e-4d11-ab1c-51acfc0d7615-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.511031 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.510753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.511031 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.510888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.511031 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.510996    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.511193 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.511066    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqslq\" (UniqueName: \"kubernetes.io/projected/e383e41d-135e-4d11-ab1c-51acfc0d7615-kube-api-access-dqslq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.511193 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.511146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.511280 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.511238    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.511280 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.511264    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.513111 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.513091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e383e41d-135e-4d11-ab1c-51acfc0d7615-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.513356 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.513339    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e383e41d-135e-4d11-ab1c-51acfc0d7615-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.520138 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.520115    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqslq\" (UniqueName: \"kubernetes.io/projected/e383e41d-135e-4d11-ab1c-51acfc0d7615-kube-api-access-dqslq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qql4p\" (UID: \"e383e41d-135e-4d11-ab1c-51acfc0d7615\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.634613 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.634519    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:09.774866 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:09.774840    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"]
Jul 21 17:21:09.777308 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:21:09.777280    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode383e41d_135e_4d11_ab1c_51acfc0d7615.slice/crio-3facb6c611811d7b2ae60f1d904eb63e6a6ca7ccc097c5f4b2593da477627878 WatchSource:0}: Error finding container 3facb6c611811d7b2ae60f1d904eb63e6a6ca7ccc097c5f4b2593da477627878: Status 404 returned error can't find the container with id 3facb6c611811d7b2ae60f1d904eb63e6a6ca7ccc097c5f4b2593da477627878
Jul 21 17:21:10.135926 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:10.135840    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p" event={"ID":"e383e41d-135e-4d11-ab1c-51acfc0d7615","Type":"ContainerStarted","Data":"3facb6c611811d7b2ae60f1d904eb63e6a6ca7ccc097c5f4b2593da477627878"}
Jul 21 17:21:10.213522 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:10.213484    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:21:11.143287 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:11.143252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p" event={"ID":"e383e41d-135e-4d11-ab1c-51acfc0d7615","Type":"ContainerStarted","Data":"481fbe3cbd1b57f12787be144aac1224a32c1708a622e50a35ffda1b51cfccd2"}
Jul 21 17:21:11.162934 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:11.162878    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p" podStartSLOduration=0.982301987 podStartE2EDuration="2.162862637s" totalImagesPullingTime="1.18056065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:21:11.160649002 +0000 UTC m=+773.705965215" watchObservedRunningTime="2026-07-21 17:21:11.162862637 +0000 UTC m=+773.708178854"
Jul 21 17:21:17.738317 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:17.738284    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:21:18.927248 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:18.927218    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:21:19.635574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:19.635542    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:19.635877 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:19.635606    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:19.648775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:19.648745    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:20.210611 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:20.210589    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qql4p"
Jul 21 17:21:31.922003 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:31.921961    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"]
Jul 21 17:21:31.926123 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:31.926102    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:31.928965 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:31.928943    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 17:21:31.937284 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:31.937259    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"]
Jul 21 17:21:31.969460 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:31.969426    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:21:32.027918 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.027882    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.027918 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.027921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42835c3b-9516-492f-943d-3ffd100757e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.028147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.027969    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfpnp\" (UniqueName: \"kubernetes.io/projected/42835c3b-9516-492f-943d-3ffd100757e8-kube-api-access-zfpnp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.028147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.028001    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.028147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.028075    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.028147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.028101    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.128869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.128830    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfpnp\" (UniqueName: \"kubernetes.io/projected/42835c3b-9516-492f-943d-3ffd100757e8-kube-api-access-zfpnp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.128869 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.128876    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.129094 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.128923    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.129094 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.128951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.129094 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.128987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.129094 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.129002    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42835c3b-9516-492f-943d-3ffd100757e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.129365 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.129344    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.129431 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.129407    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.129473 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.129430    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.131286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.131269    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42835c3b-9516-492f-943d-3ffd100757e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.131465 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.131448    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42835c3b-9516-492f-943d-3ffd100757e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.139147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.139121    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfpnp\" (UniqueName: \"kubernetes.io/projected/42835c3b-9516-492f-943d-3ffd100757e8-kube-api-access-zfpnp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn\" (UID: \"42835c3b-9516-492f-943d-3ffd100757e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.237696 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.237593    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:32.380037 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:32.380003    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"]
Jul 21 17:21:32.380892 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:21:32.380861    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42835c3b_9516_492f_943d_3ffd100757e8.slice/crio-7f5761e98eb6f0bcd10c6b43350e96168d473f8bd5e0ba766553b94c64be4b3e WatchSource:0}: Error finding container 7f5761e98eb6f0bcd10c6b43350e96168d473f8bd5e0ba766553b94c64be4b3e: Status 404 returned error can't find the container with id 7f5761e98eb6f0bcd10c6b43350e96168d473f8bd5e0ba766553b94c64be4b3e
Jul 21 17:21:33.278741 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:33.278706    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn" event={"ID":"42835c3b-9516-492f-943d-3ffd100757e8","Type":"ContainerStarted","Data":"6ab785e04fb5289ac7489594f544bf336e8845982348551db7dc24aec4c5de02"}
Jul 21 17:21:33.279157 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:33.278767    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn" event={"ID":"42835c3b-9516-492f-943d-3ffd100757e8","Type":"ContainerStarted","Data":"7f5761e98eb6f0bcd10c6b43350e96168d473f8bd5e0ba766553b94c64be4b3e"}
Jul 21 17:21:33.300628 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:33.300567    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn" podStartSLOduration=2.113950707 podStartE2EDuration="2.300548207s" totalImagesPullingTime="186.5975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:21:33.297388238 +0000 UTC m=+795.842704466" watchObservedRunningTime="2026-07-21 17:21:33.300548207 +0000 UTC m=+795.845864425"
Jul 21 17:21:33.567408 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:33.567327    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:21:42.238731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:42.238651    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:42.238731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:42.238705    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:42.251275 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:42.251252    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:42.344409 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:42.344384    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn"
Jul 21 17:21:44.346706 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:44.346667    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:21:47.010035 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:47.009997    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:21:54.045356 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:54.045322    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:21:57.009868 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:21:57.009831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:22:48.998336 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:48.998296    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5784477f59-vqq58"]
Jul 21 17:22:49.001942 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.001924    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5784477f59-vqq58"
Jul 21 17:22:49.013361 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.013338    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5784477f59-vqq58"]
Jul 21 17:22:49.055099 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.055070    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbf87cf9-9d7a-486c-8528-ef14353fa175-tls-cert\") pod \"authorino-5784477f59-vqq58\" (UID: \"cbf87cf9-9d7a-486c-8528-ef14353fa175\") " pod="kuadrant-system/authorino-5784477f59-vqq58"
Jul 21 17:22:49.055256 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.055218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwl2\" (UniqueName: \"kubernetes.io/projected/cbf87cf9-9d7a-486c-8528-ef14353fa175-kube-api-access-fpwl2\") pod \"authorino-5784477f59-vqq58\" (UID: \"cbf87cf9-9d7a-486c-8528-ef14353fa175\") " pod="kuadrant-system/authorino-5784477f59-vqq58"
Jul 21 17:22:49.156065 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.156022    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwl2\" (UniqueName: \"kubernetes.io/projected/cbf87cf9-9d7a-486c-8528-ef14353fa175-kube-api-access-fpwl2\") pod \"authorino-5784477f59-vqq58\" (UID: \"cbf87cf9-9d7a-486c-8528-ef14353fa175\") " pod="kuadrant-system/authorino-5784477f59-vqq58"
Jul 21 17:22:49.156237 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.156083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbf87cf9-9d7a-486c-8528-ef14353fa175-tls-cert\") pod \"authorino-5784477f59-vqq58\" (UID: \"cbf87cf9-9d7a-486c-8528-ef14353fa175\") " pod="kuadrant-system/authorino-5784477f59-vqq58"
Jul 21 17:22:49.158570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.158548    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbf87cf9-9d7a-486c-8528-ef14353fa175-tls-cert\") pod \"authorino-5784477f59-vqq58\" (UID: \"cbf87cf9-9d7a-486c-8528-ef14353fa175\") " pod="kuadrant-system/authorino-5784477f59-vqq58"
Jul 21 17:22:49.164039 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.164012    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwl2\" (UniqueName: \"kubernetes.io/projected/cbf87cf9-9d7a-486c-8528-ef14353fa175-kube-api-access-fpwl2\") pod \"authorino-5784477f59-vqq58\" (UID: \"cbf87cf9-9d7a-486c-8528-ef14353fa175\") " pod="kuadrant-system/authorino-5784477f59-vqq58"
Jul 21 17:22:49.311291 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.311255    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5784477f59-vqq58"
Jul 21 17:22:49.443168 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.443137    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:22:49.457330 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.457303    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5784477f59-vqq58"]
Jul 21 17:22:49.461082 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:22:49.461051    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbf87cf9_9d7a_486c_8528_ef14353fa175.slice/crio-0d87194201c4500caf7745f31ef8dfb75320c361c554a4a99bd85f5e04be0097 WatchSource:0}: Error finding container 0d87194201c4500caf7745f31ef8dfb75320c361c554a4a99bd85f5e04be0097: Status 404 returned error can't find the container with id 0d87194201c4500caf7745f31ef8dfb75320c361c554a4a99bd85f5e04be0097
Jul 21 17:22:49.540811 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.540768    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:22:49.741498 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:49.741411    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5784477f59-vqq58" event={"ID":"cbf87cf9-9d7a-486c-8528-ef14353fa175","Type":"ContainerStarted","Data":"0d87194201c4500caf7745f31ef8dfb75320c361c554a4a99bd85f5e04be0097"}
Jul 21 17:22:50.564078 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:50.564041    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:22:50.661465 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:50.661429    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:22:50.751366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:50.751330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5784477f59-vqq58" event={"ID":"cbf87cf9-9d7a-486c-8528-ef14353fa175","Type":"ContainerStarted","Data":"f0c0e42d1a68dd2bd2d46516059aecb1045198c201f3065b39d3decc0228308d"}
Jul 21 17:22:50.774277 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:50.774197    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5784477f59-vqq58" podStartSLOduration=2.330809614 podStartE2EDuration="2.774175675s" totalImagesPullingTime="443.366061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:22:50.770764359 +0000 UTC m=+873.316080576" watchObservedRunningTime="2026-07-21 17:22:50.774175675 +0000 UTC m=+873.319491891"
Jul 21 17:22:50.808862 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:50.808332    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9b77c98fd-dw7qs"]
Jul 21 17:22:50.808862 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:50.808548    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-9b77c98fd-dw7qs" podUID="5ef17bad-788e-4d46-bce9-b37850e2929a" containerName="authorino" containerID="cri-o://8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7" gracePeriod=30
Jul 21 17:22:51.080968 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.080945    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:22:51.177486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.177402    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt5ss\" (UniqueName: \"kubernetes.io/projected/5ef17bad-788e-4d46-bce9-b37850e2929a-kube-api-access-lt5ss\") pod \"5ef17bad-788e-4d46-bce9-b37850e2929a\" (UID: \"5ef17bad-788e-4d46-bce9-b37850e2929a\") "
Jul 21 17:22:51.177631 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.177491    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ef17bad-788e-4d46-bce9-b37850e2929a-tls-cert\") pod \"5ef17bad-788e-4d46-bce9-b37850e2929a\" (UID: \"5ef17bad-788e-4d46-bce9-b37850e2929a\") "
Jul 21 17:22:51.179615 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.179583    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef17bad-788e-4d46-bce9-b37850e2929a-kube-api-access-lt5ss" (OuterVolumeSpecName: "kube-api-access-lt5ss") pod "5ef17bad-788e-4d46-bce9-b37850e2929a" (UID: "5ef17bad-788e-4d46-bce9-b37850e2929a"). InnerVolumeSpecName "kube-api-access-lt5ss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:22:51.189324 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.189296    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef17bad-788e-4d46-bce9-b37850e2929a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5ef17bad-788e-4d46-bce9-b37850e2929a" (UID: "5ef17bad-788e-4d46-bce9-b37850e2929a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:22:51.278350 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.278316    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt5ss\" (UniqueName: \"kubernetes.io/projected/5ef17bad-788e-4d46-bce9-b37850e2929a-kube-api-access-lt5ss\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:22:51.278350 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.278345    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ef17bad-788e-4d46-bce9-b37850e2929a-tls-cert\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:22:51.759505 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.759466    2557 generic.go:356] "Generic (PLEG): container finished" podID="5ef17bad-788e-4d46-bce9-b37850e2929a" containerID="8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7" exitCode=0
Jul 21 17:22:51.759505 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.759510    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b77c98fd-dw7qs"
Jul 21 17:22:51.760077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.759546    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b77c98fd-dw7qs" event={"ID":"5ef17bad-788e-4d46-bce9-b37850e2929a","Type":"ContainerDied","Data":"8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7"}
Jul 21 17:22:51.760077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.759589    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b77c98fd-dw7qs" event={"ID":"5ef17bad-788e-4d46-bce9-b37850e2929a","Type":"ContainerDied","Data":"d52e9c18d319f68f57b763e2c4fdb0b79f4f8d81fa004ce7558713f3dc35e14a"}
Jul 21 17:22:51.760077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.759605    2557 scope.go:117] "RemoveContainer" containerID="8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7"
Jul 21 17:22:51.769949 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.769917    2557 scope.go:117] "RemoveContainer" containerID="8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7"
Jul 21 17:22:51.770264 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:22:51.770242    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7\": container with ID starting with 8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7 not found: ID does not exist" containerID="8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7"
Jul 21 17:22:51.770325 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.770278    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7"} err="failed to get container status \"8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7\": rpc error: code = NotFound desc = could not find container \"8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7\": container with ID starting with 8a31d83496b48e7e2d3fe8ac9edd16182f8941fbda52ad51a54489405b8bacb7 not found: ID does not exist"
Jul 21 17:22:51.791067 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.791002    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9b77c98fd-dw7qs"]
Jul 21 17:22:51.794126 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:51.794099    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9b77c98fd-dw7qs"]
Jul 21 17:22:52.063537 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:22:52.063438    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef17bad-788e-4d46-bce9-b37850e2929a" path="/var/lib/kubelet/pods/5ef17bad-788e-4d46-bce9-b37850e2929a/volumes"
Jul 21 17:23:17.971755 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:23:17.971679    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:23:17.975595 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:23:17.975576    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:23:18.543062 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:23:18.543028    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:23:29.804234 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:23:29.804194    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:23:38.613721 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:23:38.613676    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:24:54.773765 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:24:54.773680    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:24:56.304104 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:24:56.304063    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:09.439266 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:09.439225    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:15.597136 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:15.597105    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:19.773167 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:19.773127    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:20.912992 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:20.912961    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:25:29.317182 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:29.317134    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:25:31.596560 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:31.596525    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:31.694223 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:31.694166    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:31.832838 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:31.832781    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:37.791751 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:37.791708    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:37.892615 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:37.892572    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:37.998756 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:37.998706    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:38.158202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:38.158052    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:44.249830 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:44.249774    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:25:44.312097 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:25:44.312049    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:26:00.603114 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:26:00.603077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:26:08.113883 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:26:08.113847    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:26:16.308352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:26:16.308246    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:26:28.519557 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:26:28.519517    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:26:38.418141 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:26:38.418101    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:26:47.681629 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:26:47.681592    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:26:50.629927 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:26:50.629881    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:27:01.708394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:27:01.708355    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:27:11.216709 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:27:11.216672    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:27:32.326234 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:27:32.326201    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:27:41.320625 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:27:41.320546    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:28:03.572671 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:03.572633    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:28:03.672815 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:03.672761    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:28:09.719544 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:09.719510    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:28:18.014089 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:18.014061    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:28:18.023377 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:18.023357    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:28:20.407885 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:20.407845    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:28:36.738644 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:36.738606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:28:46.513091 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:46.513059    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:28:53.156743 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:53.156707    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:28:56.015699 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:28:56.015663    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:29:05.420221 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:29:05.420189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:29:14.328045 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:29:14.327948    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:30:50.527048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:30:50.526954    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:31:02.828882 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:31:02.828852    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:31:11.826231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:31:11.826197    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:31:25.326431 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:31:25.326395    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:31:37.213836 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:31:37.213777    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:31:46.623818 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:31:46.623763    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:31:58.524502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:31:58.524469    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:32:01.108916 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:32:01.108888    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:32:07.823010 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:32:07.822972    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:32:17.423923 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:32:17.423845    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:32:21.712126 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:32:21.712088    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:32:29.732561 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:32:29.732515    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:32:38.616238 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:32:38.616203    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:32:49.325391 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:32:49.325354    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:33:13.420710 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:33:13.420667    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:33:18.055940 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:33:18.055911    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:33:18.069061 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:33:18.069038    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:33:20.744561 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:33:20.744523    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:33:43.774635 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:33:43.774552    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:33:54.062509 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:33:54.062463    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:33:57.218488 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:33:57.218454    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:34:01.038372 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:01.038331    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:34:11.416472 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:11.416430    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:34:17.192045 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:17.192015    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:34:17.264728 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:17.264692    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:34:32.925699 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:32.925663    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:34:34.044117 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:34.044084    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:34:36.721431 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:36.721401    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:34:49.739392 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:49.739350    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:34:59.621898 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:34:59.621865    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:35:11.617855 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:35:11.617756    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:35:25.536715 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:35:25.536680    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:35:34.325266 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:35:34.325221    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:35:40.534402 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:35:40.534358    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:35:50.304735 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:35:50.304698    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:35:52.084785 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:35:52.084695    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:35:52.184165 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:35:52.184127    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:36:01.708488 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:36:01.708438    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:36:14.513275 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:36:14.513241    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:36:23.715810 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:36:23.715766    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:36:33.416762 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:36:33.416719    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:36:42.607069 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:36:42.606973    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:36:55.902607 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:36:55.902568    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:37:04.714731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:37:04.714693    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:37:17.210924 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:37:17.210889    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:37:28.912008 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:37:28.911960    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:37:40.115281 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:37:40.115239    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:37:43.139205 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:37:43.139170    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:37:54.016557 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:37:54.016519    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:38:02.352863 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:02.352826    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:05.221768 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:05.221731    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:05.322749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:05.322708    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:05.665856 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:05.665817    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:06.905058 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:06.905017    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:38:11.467812 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:11.467721    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:11.573446 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:11.573407    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:11.707297 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:11.707257    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:12.049626 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:12.049585    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:12.277116 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:12.277078    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:14.132172 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:14.132133    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:14.231070 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:14.231032    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:14.327018 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:14.326987    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:14.893831 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:14.893766    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:14.994360 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:14.994321    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:17.006427 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:17.006393    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:38:18.100537 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:18.100507    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:38:18.111476 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:18.111450    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:38:39.728435 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.728398    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"]
Jul 21 17:38:39.728943 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.728928    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef17bad-788e-4d46-bce9-b37850e2929a" containerName="authorino"
Jul 21 17:38:39.728943 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.728944    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef17bad-788e-4d46-bce9-b37850e2929a" containerName="authorino"
Jul 21 17:38:39.729032 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.729024    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef17bad-788e-4d46-bce9-b37850e2929a" containerName="authorino"
Jul 21 17:38:39.732139 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.732123    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"
Jul 21 17:38:39.737013 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.736990    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:38:39.738036 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.738009    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:38:39.742557 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.742506    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"]
Jul 21 17:38:39.845278 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.845238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026c5ea6-137b-4c39-a2d0-cd263edb23a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf\" (UID: \"026c5ea6-137b-4c39-a2d0-cd263edb23a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"
Jul 21 17:38:39.946269 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.946236    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026c5ea6-137b-4c39-a2d0-cd263edb23a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf\" (UID: \"026c5ea6-137b-4c39-a2d0-cd263edb23a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"
Jul 21 17:38:39.946871 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:39.946850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026c5ea6-137b-4c39-a2d0-cd263edb23a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf\" (UID: \"026c5ea6-137b-4c39-a2d0-cd263edb23a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"
Jul 21 17:38:40.045027 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:40.044996    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"
Jul 21 17:38:40.399808 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:38:40.399767    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026c5ea6_137b_4c39_a2d0_cd263edb23a9.slice/crio-78718ad9dd126d5ddfb4909922e91bd2187584741c862fe88eaf01bd825d29b5 WatchSource:0}: Error finding container 78718ad9dd126d5ddfb4909922e91bd2187584741c862fe88eaf01bd825d29b5: Status 404 returned error can't find the container with id 78718ad9dd126d5ddfb4909922e91bd2187584741c862fe88eaf01bd825d29b5
Jul 21 17:38:40.399957 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:40.399933    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"]
Jul 21 17:38:40.401674 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:40.401660    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:38:40.587872 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:40.587829    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf" event={"ID":"026c5ea6-137b-4c39-a2d0-cd263edb23a9","Type":"ContainerStarted","Data":"78718ad9dd126d5ddfb4909922e91bd2187584741c862fe88eaf01bd825d29b5"}
Jul 21 17:38:43.610501 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:43.610404    2557 generic.go:356] "Generic (PLEG): container finished" podID="026c5ea6-137b-4c39-a2d0-cd263edb23a9" containerID="c8b1994349b705d5bb909ea306ec68e38cbf5c634c97199db912368463e5bc35" exitCode=0
Jul 21 17:38:43.610895 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:43.610492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf" event={"ID":"026c5ea6-137b-4c39-a2d0-cd263edb23a9","Type":"ContainerDied","Data":"c8b1994349b705d5bb909ea306ec68e38cbf5c634c97199db912368463e5bc35"}
Jul 21 17:38:44.766116 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:44.766090    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"
Jul 21 17:38:44.897545 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:44.897445    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026c5ea6-137b-4c39-a2d0-cd263edb23a9-maas-api-service-ca\") pod \"026c5ea6-137b-4c39-a2d0-cd263edb23a9\" (UID: \"026c5ea6-137b-4c39-a2d0-cd263edb23a9\") "
Jul 21 17:38:44.897857 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:44.897792    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/026c5ea6-137b-4c39-a2d0-cd263edb23a9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "026c5ea6-137b-4c39-a2d0-cd263edb23a9" (UID: "026c5ea6-137b-4c39-a2d0-cd263edb23a9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:38:44.998561 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:44.998526    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/026c5ea6-137b-4c39-a2d0-cd263edb23a9-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:38:45.623110 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:45.623079    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"
Jul 21 17:38:45.623295 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:45.623109    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf" event={"ID":"026c5ea6-137b-4c39-a2d0-cd263edb23a9","Type":"ContainerDied","Data":"78718ad9dd126d5ddfb4909922e91bd2187584741c862fe88eaf01bd825d29b5"}
Jul 21 17:38:45.623295 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:45.623161    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78718ad9dd126d5ddfb4909922e91bd2187584741c862fe88eaf01bd825d29b5"
Jul 21 17:38:50.143028 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:50.142985    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:53.213518 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:53.213480    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:38:54.809297 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:54.809258    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"]
Jul 21 17:38:54.814364 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:54.814337    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-01e22ac5-ksptf"]
Jul 21 17:38:54.820359 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:54.820333    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:54.980342 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:54.980308    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:55.171959 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:55.171869    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:55.416860 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:55.416791    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:55.516239 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:55.516204    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:55.642738 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:55.642700    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:55.937931 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:55.937822    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:56.063989 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:56.063962    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="026c5ea6-137b-4c39-a2d0-cd263edb23a9" path="/var/lib/kubelet/pods/026c5ea6-137b-4c39-a2d0-cd263edb23a9/volumes"
Jul 21 17:38:56.144588 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:56.144552    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:58.445037 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:58.444999    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:58.585568 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:58.585524    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:58.773178 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:58.773143    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:59.093941 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:59.093790    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:38:59.194532 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:38:59.194489    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:05.207381 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:05.207343    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:39:23.470531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.470487    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"]
Jul 21 17:39:23.471238 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.471218    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026c5ea6-137b-4c39-a2d0-cd263edb23a9" containerName="revoke-keys"
Jul 21 17:39:23.471339 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.471240    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="026c5ea6-137b-4c39-a2d0-cd263edb23a9" containerName="revoke-keys"
Jul 21 17:39:23.471394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.471374    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="026c5ea6-137b-4c39-a2d0-cd263edb23a9" containerName="revoke-keys"
Jul 21 17:39:23.474717 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.474697    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"
Jul 21 17:39:23.477628 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.477603    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:39:23.477763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.477612    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:39:23.482456 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.482433    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"]
Jul 21 17:39:23.484069 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.484046    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff7a536-d4e7-425b-8566-2a3531b902cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-07f072da-k42l7\" (UID: \"8ff7a536-d4e7-425b-8566-2a3531b902cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"
Jul 21 17:39:23.585146 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.585117    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff7a536-d4e7-425b-8566-2a3531b902cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-07f072da-k42l7\" (UID: \"8ff7a536-d4e7-425b-8566-2a3531b902cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"
Jul 21 17:39:23.585765 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.585744    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff7a536-d4e7-425b-8566-2a3531b902cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-07f072da-k42l7\" (UID: \"8ff7a536-d4e7-425b-8566-2a3531b902cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"
Jul 21 17:39:23.787546 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.787512    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"
Jul 21 17:39:23.929520 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:23.929488    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"]
Jul 21 17:39:23.931677 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:39:23.931652    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff7a536_d4e7_425b_8566_2a3531b902cc.slice/crio-fb6d5ce8b049690a3459b8d55f8d14763822c47f7e17d64605371c63267026d3 WatchSource:0}: Error finding container fb6d5ce8b049690a3459b8d55f8d14763822c47f7e17d64605371c63267026d3: Status 404 returned error can't find the container with id fb6d5ce8b049690a3459b8d55f8d14763822c47f7e17d64605371c63267026d3
Jul 21 17:39:24.860424 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:24.860387    2557 generic.go:356] "Generic (PLEG): container finished" podID="8ff7a536-d4e7-425b-8566-2a3531b902cc" containerID="cb2079da9186dd0957ab29b6394c89c522685106dc6136c5aee335023614f867" exitCode=0
Jul 21 17:39:24.860850 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:24.860483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7" event={"ID":"8ff7a536-d4e7-425b-8566-2a3531b902cc","Type":"ContainerDied","Data":"cb2079da9186dd0957ab29b6394c89c522685106dc6136c5aee335023614f867"}
Jul 21 17:39:24.860850 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:24.860573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7" event={"ID":"8ff7a536-d4e7-425b-8566-2a3531b902cc","Type":"ContainerStarted","Data":"fb6d5ce8b049690a3459b8d55f8d14763822c47f7e17d64605371c63267026d3"}
Jul 21 17:39:26.009417 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:26.009394    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"
Jul 21 17:39:26.107602 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:26.107566    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff7a536-d4e7-425b-8566-2a3531b902cc-maas-api-service-ca\") pod \"8ff7a536-d4e7-425b-8566-2a3531b902cc\" (UID: \"8ff7a536-d4e7-425b-8566-2a3531b902cc\") "
Jul 21 17:39:26.107982 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:26.107960    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff7a536-d4e7-425b-8566-2a3531b902cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8ff7a536-d4e7-425b-8566-2a3531b902cc" (UID: "8ff7a536-d4e7-425b-8566-2a3531b902cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:39:26.209150 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:26.209050    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff7a536-d4e7-425b-8566-2a3531b902cc-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:39:26.874519 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:26.874492    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"
Jul 21 17:39:26.874696 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:26.874533    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7" event={"ID":"8ff7a536-d4e7-425b-8566-2a3531b902cc","Type":"ContainerDied","Data":"fb6d5ce8b049690a3459b8d55f8d14763822c47f7e17d64605371c63267026d3"}
Jul 21 17:39:26.874696 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:26.874583    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb6d5ce8b049690a3459b8d55f8d14763822c47f7e17d64605371c63267026d3"
Jul 21 17:39:33.901051 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:33.900987    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:35.625227 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:35.625188    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:39:38.566982 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:38.566926    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:38.568004 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:38.567976    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"]
Jul 21 17:39:38.571028 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:38.571000    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07f072da-k42l7"]
Jul 21 17:39:38.767419 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:38.767382    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:39.017978 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:39.017945    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:39.270347 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:39.270236    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:39.712829 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:39.712726    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:39.817051 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:39.817012    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:40.064065 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:40.064034    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ff7a536-d4e7-425b-8566-2a3531b902cc" path="/var/lib/kubelet/pods/8ff7a536-d4e7-425b-8566-2a3531b902cc/volumes"
Jul 21 17:39:41.546639 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:41.546600    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:41.640692 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:41.640654    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:41.848589 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:41.848501    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:42.165397 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:42.165304    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:42.341033 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:42.340994    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:42.437476 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:42.437371    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:39:44.524768 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:39:44.524722    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:40:07.384740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.384703    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"]
Jul 21 17:40:07.389886 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.386025    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ff7a536-d4e7-425b-8566-2a3531b902cc" containerName="revoke-keys"
Jul 21 17:40:07.389886 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.386058    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ff7a536-d4e7-425b-8566-2a3531b902cc" containerName="revoke-keys"
Jul 21 17:40:07.389886 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.386349    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ff7a536-d4e7-425b-8566-2a3531b902cc" containerName="revoke-keys"
Jul 21 17:40:07.393024 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.392144    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"
Jul 21 17:40:07.395953 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.395926    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:40:07.396338 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.395977    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:40:07.398990 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.398967    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"]
Jul 21 17:40:07.424288 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.424254    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e784032-ab89-4b2f-a563-067621dd5954-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4\" (UID: \"7e784032-ab89-4b2f-a563-067621dd5954\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"
Jul 21 17:40:07.525484 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.525440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e784032-ab89-4b2f-a563-067621dd5954-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4\" (UID: \"7e784032-ab89-4b2f-a563-067621dd5954\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"
Jul 21 17:40:07.526095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.526075    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e784032-ab89-4b2f-a563-067621dd5954-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4\" (UID: \"7e784032-ab89-4b2f-a563-067621dd5954\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"
Jul 21 17:40:07.708107 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.708002    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"
Jul 21 17:40:07.856646 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:07.856615    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"]
Jul 21 17:40:07.858021 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:40:07.857994    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e784032_ab89_4b2f_a563_067621dd5954.slice/crio-0407852ae4d18c4f134dd88d1ba12eb545b3355e807a41c52eb68b21ad9d1487 WatchSource:0}: Error finding container 0407852ae4d18c4f134dd88d1ba12eb545b3355e807a41c52eb68b21ad9d1487: Status 404 returned error can't find the container with id 0407852ae4d18c4f134dd88d1ba12eb545b3355e807a41c52eb68b21ad9d1487
Jul 21 17:40:08.132780 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:08.132741    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4" event={"ID":"7e784032-ab89-4b2f-a563-067621dd5954","Type":"ContainerStarted","Data":"0407852ae4d18c4f134dd88d1ba12eb545b3355e807a41c52eb68b21ad9d1487"}
Jul 21 17:40:09.144485 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:09.144436    2557 generic.go:356] "Generic (PLEG): container finished" podID="7e784032-ab89-4b2f-a563-067621dd5954" containerID="4edd80b03a9864bbfd813f8e9ff59173de970f07e772f5df96ef9df8e9b4a342" exitCode=0
Jul 21 17:40:09.144903 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:09.144513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4" event={"ID":"7e784032-ab89-4b2f-a563-067621dd5954","Type":"ContainerDied","Data":"4edd80b03a9864bbfd813f8e9ff59173de970f07e772f5df96ef9df8e9b4a342"}
Jul 21 17:40:10.295488 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:10.295462    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"
Jul 21 17:40:10.352920 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:10.352889    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e784032-ab89-4b2f-a563-067621dd5954-maas-api-service-ca\") pod \"7e784032-ab89-4b2f-a563-067621dd5954\" (UID: \"7e784032-ab89-4b2f-a563-067621dd5954\") "
Jul 21 17:40:10.353299 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:10.353273    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e784032-ab89-4b2f-a563-067621dd5954-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e784032-ab89-4b2f-a563-067621dd5954" (UID: "7e784032-ab89-4b2f-a563-067621dd5954"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:40:10.453625 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:10.453530    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e784032-ab89-4b2f-a563-067621dd5954-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:40:11.158167 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:11.158134    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"
Jul 21 17:40:11.158357 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:11.158169    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4" event={"ID":"7e784032-ab89-4b2f-a563-067621dd5954","Type":"ContainerDied","Data":"0407852ae4d18c4f134dd88d1ba12eb545b3355e807a41c52eb68b21ad9d1487"}
Jul 21 17:40:11.158357 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:11.158221    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0407852ae4d18c4f134dd88d1ba12eb545b3355e807a41c52eb68b21ad9d1487"
Jul 21 17:40:17.789748 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:17.789678    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:18.843638 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:18.843603    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:18.944771 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:18.944739    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:20.512667 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:20.512629    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:40:22.461959 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:22.461911    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:22.463422 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:22.463393    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"]
Jul 21 17:40:22.466034 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:22.466011    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6b1d8ddb-r66g4"]
Jul 21 17:40:23.777333 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:23.777291    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:23.928753 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:23.928712    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:24.063478 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:24.063397    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e784032-ab89-4b2f-a563-067621dd5954" path="/var/lib/kubelet/pods/7e784032-ab89-4b2f-a563-067621dd5954/volumes"
Jul 21 17:40:24.157658 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:24.157618    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:24.465352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:24.465253    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:25.116229 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:25.116192    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:26.709134 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:26.709097    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:26.785234 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:26.785194    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:26.864182 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:26.864146    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:27.288753 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:27.288718    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:27.388472 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:27.388432    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:27.694525 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:27.694441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:30.206302 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:30.206265    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:40:34.538201 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:34.538153    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:34.761362 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:34.761318    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:40:51.592491 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.592446    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"]
Jul 21 17:40:51.592993 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.592941    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e784032-ab89-4b2f-a563-067621dd5954" containerName="revoke-keys"
Jul 21 17:40:51.592993 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.592955    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e784032-ab89-4b2f-a563-067621dd5954" containerName="revoke-keys"
Jul 21 17:40:51.593071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.593028    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e784032-ab89-4b2f-a563-067621dd5954" containerName="revoke-keys"
Jul 21 17:40:51.596181 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.596165    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"
Jul 21 17:40:51.598709 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.598687    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:40:51.598841 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.598730    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:40:51.603515 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.603489    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"]
Jul 21 17:40:51.671785 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.671747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c771342e-fce8-4c73-bda5-9e1dac304494-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-336913ae-824wx\" (UID: \"c771342e-fce8-4c73-bda5-9e1dac304494\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"
Jul 21 17:40:51.773181 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.773146    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c771342e-fce8-4c73-bda5-9e1dac304494-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-336913ae-824wx\" (UID: \"c771342e-fce8-4c73-bda5-9e1dac304494\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"
Jul 21 17:40:51.773782 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.773762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c771342e-fce8-4c73-bda5-9e1dac304494-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-336913ae-824wx\" (UID: \"c771342e-fce8-4c73-bda5-9e1dac304494\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"
Jul 21 17:40:51.909321 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:51.909228    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"
Jul 21 17:40:52.046855 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:52.046827    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"]
Jul 21 17:40:52.049738 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:40:52.049710    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc771342e_fce8_4c73_bda5_9e1dac304494.slice/crio-cc8e0d6c02d6496df61d50ac24f1e716d514a6b631a4654a27fc98bdbf23dde9 WatchSource:0}: Error finding container cc8e0d6c02d6496df61d50ac24f1e716d514a6b631a4654a27fc98bdbf23dde9: Status 404 returned error can't find the container with id cc8e0d6c02d6496df61d50ac24f1e716d514a6b631a4654a27fc98bdbf23dde9
Jul 21 17:40:52.431153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:52.431120    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx" event={"ID":"c771342e-fce8-4c73-bda5-9e1dac304494","Type":"ContainerStarted","Data":"2644a0deabab5668cf46de803a600f729d752af5495dcb03b7c1a7815b586bde"}
Jul 21 17:40:52.431330 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:52.431169    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx" event={"ID":"c771342e-fce8-4c73-bda5-9e1dac304494","Type":"ContainerStarted","Data":"cc8e0d6c02d6496df61d50ac24f1e716d514a6b631a4654a27fc98bdbf23dde9"}
Jul 21 17:40:52.448734 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:52.448678    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx" podStartSLOduration=1.448663461 podStartE2EDuration="1.448663461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:40:52.446888337 +0000 UTC m=+1954.992204553" watchObservedRunningTime="2026-07-21 17:40:52.448663461 +0000 UTC m=+1954.993979676"
Jul 21 17:40:53.444177 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:53.444132    2557 generic.go:356] "Generic (PLEG): container finished" podID="c771342e-fce8-4c73-bda5-9e1dac304494" containerID="2644a0deabab5668cf46de803a600f729d752af5495dcb03b7c1a7815b586bde" exitCode=0
Jul 21 17:40:53.444672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:53.444218    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx" event={"ID":"c771342e-fce8-4c73-bda5-9e1dac304494","Type":"ContainerDied","Data":"2644a0deabab5668cf46de803a600f729d752af5495dcb03b7c1a7815b586bde"}
Jul 21 17:40:54.596792 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:54.596760    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"
Jul 21 17:40:54.703131 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:54.703035    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c771342e-fce8-4c73-bda5-9e1dac304494-maas-api-service-ca\") pod \"c771342e-fce8-4c73-bda5-9e1dac304494\" (UID: \"c771342e-fce8-4c73-bda5-9e1dac304494\") "
Jul 21 17:40:54.703407 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:54.703384    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c771342e-fce8-4c73-bda5-9e1dac304494-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c771342e-fce8-4c73-bda5-9e1dac304494" (UID: "c771342e-fce8-4c73-bda5-9e1dac304494"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:40:54.804672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:54.804623    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c771342e-fce8-4c73-bda5-9e1dac304494-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:40:55.456860 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:55.456820    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"
Jul 21 17:40:55.456860 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:55.456843    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx" event={"ID":"c771342e-fce8-4c73-bda5-9e1dac304494","Type":"ContainerDied","Data":"cc8e0d6c02d6496df61d50ac24f1e716d514a6b631a4654a27fc98bdbf23dde9"}
Jul 21 17:40:55.457072 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:40:55.456889    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc8e0d6c02d6496df61d50ac24f1e716d514a6b631a4654a27fc98bdbf23dde9"
Jul 21 17:41:02.167326 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:02.167276    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:04.911775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:04.911733    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:41:06.661609 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:06.661572    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"]
Jul 21 17:41:06.663076 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:06.663049    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:06.664605 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:06.664580    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-336913ae-824wx"]
Jul 21 17:41:06.813182 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:06.813140    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:07.040739 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:07.040703    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:07.499718 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:07.499627    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:07.600053 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:07.600014    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:07.696898 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:07.696860    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:08.068783 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:08.068748    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c771342e-fce8-4c73-bda5-9e1dac304494" path="/var/lib/kubelet/pods/c771342e-fce8-4c73-bda5-9e1dac304494/volumes"
Jul 21 17:41:09.127942 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:09.127904    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:15.102842 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:15.102787    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:15.212375 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:15.212327    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:15.303866 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:15.303823    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:15.403569 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:15.403456    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:15.816012 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:15.815980    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:41.816150 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:41.816110    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:42.246269 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:42.246188    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:48.057665 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:48.057623    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:48.161819 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:48.161758    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:48.264959 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:48.264924    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:41:48.362263 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:41:48.362183    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:04.162206 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:04.162161    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:10.060101 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:10.060061    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:10.120737 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:10.120703    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:10.201363 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:10.201322    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:10.298633 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:10.298596    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:20.784095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:20.784058    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:21.573954 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:21.573914    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:28.269723 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:28.269673    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:28.371566 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:28.371525    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:28.471989 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:28.471953    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:28.569588 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:28.569502    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:32.416571 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:32.416536    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:42:32.474262 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:32.474222    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:32.576249 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:32.576215    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:34.432843 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:34.432783    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:34.534443 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:34.534404    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:34.631913 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:34.631879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:36.242666 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:36.242623    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:42.269187 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:42.269109    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:42.341558 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:42.341524    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:42.514744 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:42.514706    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:42:42.944522 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:42.944461    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:48.974846 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:48.974810    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:50.621433 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:50.621397    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:52.890259 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:52.890212    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:52.964239 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:52.964204    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:53.033043 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:53.033001    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:53.405564 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:53.405532    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:42:53.457746 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:53.457715    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:53.558596 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:53.558560    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:54.077542 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:54.077507    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:57.395892 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:57.395856    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:58.065447 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:58.065417    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:58.165157 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:58.165128    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:42:58.530420 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:42:58.530391    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:03.307017 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:03.306986    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:43:04.305861 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.305792    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:04.405980 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.405938    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:04.674556 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.674479    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"]
Jul 21 17:43:04.674958 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.674945    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c771342e-fce8-4c73-bda5-9e1dac304494" containerName="revoke-keys"
Jul 21 17:43:04.675005 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.674960    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c771342e-fce8-4c73-bda5-9e1dac304494" containerName="revoke-keys"
Jul 21 17:43:04.675041 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.675033    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c771342e-fce8-4c73-bda5-9e1dac304494" containerName="revoke-keys"
Jul 21 17:43:04.678347 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.678329    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"
Jul 21 17:43:04.680998 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.680970    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:43:04.681172 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.681000    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:43:04.686158 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.686130    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"]
Jul 21 17:43:04.792386 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.792343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1ce8684-14dd-4c34-b6db-618543adec18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp\" (UID: \"e1ce8684-14dd-4c34-b6db-618543adec18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"
Jul 21 17:43:04.893779 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.893743    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1ce8684-14dd-4c34-b6db-618543adec18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp\" (UID: \"e1ce8684-14dd-4c34-b6db-618543adec18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"
Jul 21 17:43:04.894346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.894327    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1ce8684-14dd-4c34-b6db-618543adec18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp\" (UID: \"e1ce8684-14dd-4c34-b6db-618543adec18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"
Jul 21 17:43:04.992235 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:04.992145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"
Jul 21 17:43:05.137511 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:05.137483    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"]
Jul 21 17:43:05.138915 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:43:05.138889    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ce8684_14dd_4c34_b6db_618543adec18.slice/crio-de1dfe0b8ef10572dc62dd61614f2a8d02dec32386b7acdff1d213d92c6346e6 WatchSource:0}: Error finding container de1dfe0b8ef10572dc62dd61614f2a8d02dec32386b7acdff1d213d92c6346e6: Status 404 returned error can't find the container with id de1dfe0b8ef10572dc62dd61614f2a8d02dec32386b7acdff1d213d92c6346e6
Jul 21 17:43:05.273614 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:05.273576    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp" event={"ID":"e1ce8684-14dd-4c34-b6db-618543adec18","Type":"ContainerStarted","Data":"de1dfe0b8ef10572dc62dd61614f2a8d02dec32386b7acdff1d213d92c6346e6"}
Jul 21 17:43:06.281820 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:06.281766    2557 generic.go:356] "Generic (PLEG): container finished" podID="e1ce8684-14dd-4c34-b6db-618543adec18" containerID="d418a804d1cbb6920be62cdd120d49960e7db92101513b56c786fc6bc54b9ae3" exitCode=0
Jul 21 17:43:06.282166 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:06.281832    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp" event={"ID":"e1ce8684-14dd-4c34-b6db-618543adec18","Type":"ContainerDied","Data":"d418a804d1cbb6920be62cdd120d49960e7db92101513b56c786fc6bc54b9ae3"}
Jul 21 17:43:07.430325 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:07.430298    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"
Jul 21 17:43:07.518244 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:07.518212    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1ce8684-14dd-4c34-b6db-618543adec18-maas-api-service-ca\") pod \"e1ce8684-14dd-4c34-b6db-618543adec18\" (UID: \"e1ce8684-14dd-4c34-b6db-618543adec18\") "
Jul 21 17:43:07.518551 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:07.518527    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1ce8684-14dd-4c34-b6db-618543adec18-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e1ce8684-14dd-4c34-b6db-618543adec18" (UID: "e1ce8684-14dd-4c34-b6db-618543adec18"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:43:07.619469 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:07.619384    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1ce8684-14dd-4c34-b6db-618543adec18-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:43:08.295682 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:08.295654    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"
Jul 21 17:43:08.295682 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:08.295671    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp" event={"ID":"e1ce8684-14dd-4c34-b6db-618543adec18","Type":"ContainerDied","Data":"de1dfe0b8ef10572dc62dd61614f2a8d02dec32386b7acdff1d213d92c6346e6"}
Jul 21 17:43:08.295905 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:08.295712    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de1dfe0b8ef10572dc62dd61614f2a8d02dec32386b7acdff1d213d92c6346e6"
Jul 21 17:43:15.141479 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:15.141440    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:18.005295 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:18.005263    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:43:18.142757 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:18.142727    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:43:18.154957 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:18.154933    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:43:19.753003 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:19.752973    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:19.759277 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:19.759252    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"]
Jul 21 17:43:19.761695 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:19.761674    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5151e12a-vdzgp"]
Jul 21 17:43:20.062761 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:20.062717    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1ce8684-14dd-4c34-b6db-618543adec18" path="/var/lib/kubelet/pods/e1ce8684-14dd-4c34-b6db-618543adec18/volumes"
Jul 21 17:43:20.166492 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:20.166462    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:26.433948 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:26.433909    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:26.490964 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:26.490905    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:26.698310 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:26.698194    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:26.922309 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:26.922275    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:27.036322 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:27.036282    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:27.135010 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:27.134976    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:27.262300 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:27.262251    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:33.326412 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:33.326376    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:33.428377 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:33.428343    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:33.526777 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:33.526737    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:33.685654 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:33.685564    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:39.708370 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:39.708332    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:39.768546 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:39.768512    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:46.550980 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:46.550945    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:46.856188 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:46.856086    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:47.422003 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:47.421962    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:50.128357 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:50.128320    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:50.231684 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:50.231654    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:50.345982 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:50.345947    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:50.526516 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:50.526485    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:50.795593 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:50.795505    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:50.896593 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:50.896561    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:54.669970 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:54.669931    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:43:57.100625 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:43:57.100592    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:44:02.429916 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:02.429878    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:44:05.915335 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:05.915301    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:44:21.818402 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:21.818328    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:44:28.091645 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.091614    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"]
Jul 21 17:44:28.092123 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.092066    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1ce8684-14dd-4c34-b6db-618543adec18" containerName="revoke-keys"
Jul 21 17:44:28.092123 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.092078    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ce8684-14dd-4c34-b6db-618543adec18" containerName="revoke-keys"
Jul 21 17:44:28.092200 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.092147    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1ce8684-14dd-4c34-b6db-618543adec18" containerName="revoke-keys"
Jul 21 17:44:28.095247 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.095232    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"
Jul 21 17:44:28.097766 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.097745    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:44:28.097919 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.097909    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:44:28.103645 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.103400    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"]
Jul 21 17:44:28.196366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.196337    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4badf63f-b539-48b0-9f5f-a5656ab4d8ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f446106b-w7wf5\" (UID: \"4badf63f-b539-48b0-9f5f-a5656ab4d8ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"
Jul 21 17:44:28.297528 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.297498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4badf63f-b539-48b0-9f5f-a5656ab4d8ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f446106b-w7wf5\" (UID: \"4badf63f-b539-48b0-9f5f-a5656ab4d8ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"
Jul 21 17:44:28.298123 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.298105    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4badf63f-b539-48b0-9f5f-a5656ab4d8ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f446106b-w7wf5\" (UID: \"4badf63f-b539-48b0-9f5f-a5656ab4d8ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"
Jul 21 17:44:28.407560 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.407489    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"
Jul 21 17:44:28.752248 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.752223    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"]
Jul 21 17:44:28.752708 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:44:28.752689    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4badf63f_b539_48b0_9f5f_a5656ab4d8ed.slice/crio-fa6fa805cdc32fe2e21acada8824687e9501598d01ff84197eda0873669cb03f WatchSource:0}: Error finding container fa6fa805cdc32fe2e21acada8824687e9501598d01ff84197eda0873669cb03f: Status 404 returned error can't find the container with id fa6fa805cdc32fe2e21acada8824687e9501598d01ff84197eda0873669cb03f
Jul 21 17:44:28.804325 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:28.804299    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5" event={"ID":"4badf63f-b539-48b0-9f5f-a5656ab4d8ed","Type":"ContainerStarted","Data":"fa6fa805cdc32fe2e21acada8824687e9501598d01ff84197eda0873669cb03f"}
Jul 21 17:44:29.812921 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:29.812889    2557 generic.go:356] "Generic (PLEG): container finished" podID="4badf63f-b539-48b0-9f5f-a5656ab4d8ed" containerID="f17b5e40470383e7f0e026cb37658b64177e01992cb2b201cb5dd9b963d865b9" exitCode=0
Jul 21 17:44:29.813323 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:29.812967    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5" event={"ID":"4badf63f-b539-48b0-9f5f-a5656ab4d8ed","Type":"ContainerDied","Data":"f17b5e40470383e7f0e026cb37658b64177e01992cb2b201cb5dd9b963d865b9"}
Jul 21 17:44:30.949453 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:30.949430    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"
Jul 21 17:44:31.025266 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:31.025241    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4badf63f-b539-48b0-9f5f-a5656ab4d8ed-maas-api-service-ca\") pod \"4badf63f-b539-48b0-9f5f-a5656ab4d8ed\" (UID: \"4badf63f-b539-48b0-9f5f-a5656ab4d8ed\") "
Jul 21 17:44:31.025576 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:31.025554    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4badf63f-b539-48b0-9f5f-a5656ab4d8ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4badf63f-b539-48b0-9f5f-a5656ab4d8ed" (UID: "4badf63f-b539-48b0-9f5f-a5656ab4d8ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:44:31.126850 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:31.126761    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4badf63f-b539-48b0-9f5f-a5656ab4d8ed-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:44:31.826840 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:31.826792    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"
Jul 21 17:44:31.827031 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:31.826834    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5" event={"ID":"4badf63f-b539-48b0-9f5f-a5656ab4d8ed","Type":"ContainerDied","Data":"fa6fa805cdc32fe2e21acada8824687e9501598d01ff84197eda0873669cb03f"}
Jul 21 17:44:31.827031 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:31.826886    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa6fa805cdc32fe2e21acada8824687e9501598d01ff84197eda0873669cb03f"
Jul 21 17:44:42.299426 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:42.299383    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:44:43.534038 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:43.533986    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:44:48.155103 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:48.155074    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:44:48.162953 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:48.162927    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"]
Jul 21 17:44:48.165611 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:48.165586    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f446106b-w7wf5"]
Jul 21 17:44:50.063089 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:50.063056    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4badf63f-b539-48b0-9f5f-a5656ab4d8ed" path="/var/lib/kubelet/pods/4badf63f-b539-48b0-9f5f-a5656ab4d8ed/volumes"
Jul 21 17:44:50.433340 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:50.433254    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:44:51.396218 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:51.396181    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:44:55.464223 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:44:55.464188    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:00.139725 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.139689    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj"]
Jul 21 17:45:00.140185 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.140171    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4badf63f-b539-48b0-9f5f-a5656ab4d8ed" containerName="revoke-keys"
Jul 21 17:45:00.140233 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.140187    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4badf63f-b539-48b0-9f5f-a5656ab4d8ed" containerName="revoke-keys"
Jul 21 17:45:00.140284 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.140274    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4badf63f-b539-48b0-9f5f-a5656ab4d8ed" containerName="revoke-keys"
Jul 21 17:45:00.143334 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.143320    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj"
Jul 21 17:45:00.146254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.146200    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:45:00.149389 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.149364    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj"]
Jul 21 17:45:00.155356 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.155332    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj"
Jul 21 17:45:00.294330 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:00.294302    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj"]
Jul 21 17:45:00.296683 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:45:00.296658    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e1218a_e083_4c10_8cb7_bbc08c587e87.slice/crio-efc92f937b2f5122097ecc56e7979eb1a6cde2d9083b8a39368fee1022916710 WatchSource:0}: Error finding container efc92f937b2f5122097ecc56e7979eb1a6cde2d9083b8a39368fee1022916710: Status 404 returned error can't find the container with id efc92f937b2f5122097ecc56e7979eb1a6cde2d9083b8a39368fee1022916710
Jul 21 17:45:01.012444 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:01.012412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj" event={"ID":"90e1218a-e083-4c10-8cb7-bbc08c587e87","Type":"ContainerStarted","Data":"26dca3e4871af1a2a7cd910530dab4243ad008fc2a6b6754ed2471aa22c5b25a"}
Jul 21 17:45:01.012636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:01.012473    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj" event={"ID":"90e1218a-e083-4c10-8cb7-bbc08c587e87","Type":"ContainerStarted","Data":"efc92f937b2f5122097ecc56e7979eb1a6cde2d9083b8a39368fee1022916710"}
Jul 21 17:45:01.029835 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:01.029771    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj" podStartSLOduration=1.029756322 podStartE2EDuration="1.029756322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:45:01.027253832 +0000 UTC m=+2203.572570049" watchObservedRunningTime="2026-07-21 17:45:01.029756322 +0000 UTC m=+2203.575072537"
Jul 21 17:45:02.019641 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:02.019606    2557 generic.go:356] "Generic (PLEG): container finished" podID="90e1218a-e083-4c10-8cb7-bbc08c587e87" containerID="26dca3e4871af1a2a7cd910530dab4243ad008fc2a6b6754ed2471aa22c5b25a" exitCode=0
Jul 21 17:45:02.020030 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:02.019693    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj" event={"ID":"90e1218a-e083-4c10-8cb7-bbc08c587e87","Type":"ContainerDied","Data":"26dca3e4871af1a2a7cd910530dab4243ad008fc2a6b6754ed2471aa22c5b25a"}
Jul 21 17:45:03.168570 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:03.168545    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj"
Jul 21 17:45:04.034500 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:04.034475    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj"
Jul 21 17:45:04.034681 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:04.034511    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744265-vmcwj" event={"ID":"90e1218a-e083-4c10-8cb7-bbc08c587e87","Type":"ContainerDied","Data":"efc92f937b2f5122097ecc56e7979eb1a6cde2d9083b8a39368fee1022916710"}
Jul 21 17:45:04.034681 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:04.034583    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efc92f937b2f5122097ecc56e7979eb1a6cde2d9083b8a39368fee1022916710"
Jul 21 17:45:18.242039 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:18.242012    2557 scope.go:117] "RemoveContainer" containerID="c8b1994349b705d5bb909ea306ec68e38cbf5c634c97199db912368463e5bc35"
Jul 21 17:45:19.698961 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:19.698925    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:19.802461 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:19.802425    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:31.584406 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:31.584361    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:32.939188 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:32.939114    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:38.607584 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:38.607542    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:38.661787 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:38.661747    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:38.967358 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:38.967269    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:39.143286 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:39.143230    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:40.243303 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:40.243267    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:40.341740 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:40.341704    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:40.442919 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:40.442885    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:41.199528 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:41.199498    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:41.298183 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:41.298147    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:41.398746 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:41.398714    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:42.498840 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:42.498809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:45:42.782017 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:42.781984    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:48.717952 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:48.717912    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:48.818829 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:48.818768    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:49.395901 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:49.395860    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:52.354583 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:52.354552    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:45:56.010717 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:56.010678    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:56.116012 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:56.115979    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:45:56.214894 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:45:56.214843    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:06.747742 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:06.747706    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:07.096282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:07.096248    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:18.264913 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:18.264883    2557 scope.go:117] "RemoveContainer" containerID="cb2079da9186dd0957ab29b6394c89c522685106dc6136c5aee335023614f867"
Jul 21 17:46:18.274221 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:18.274197    2557 scope.go:117] "RemoveContainer" containerID="4edd80b03a9864bbfd813f8e9ff59173de970f07e772f5df96ef9df8e9b4a342"
Jul 21 17:46:28.087620 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:28.087581    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:34.432211 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:34.432171    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:34.533208 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:34.533163    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:34.840175 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:34.840138    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:35.105731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:35.105639    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:35.401055 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:35.400964    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:37.900002 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:37.899969    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:37.977243 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:37.977208    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:38.035791 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:38.035757    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:38.310526 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:38.310487    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:38.456484 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:38.456439    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:38.558973 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:38.558923    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:42.304957 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:42.304921    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:42.641897 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:42.641782    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:42.950014 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:42.949920    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:43.104389 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:43.104352    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:43.502189 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:43.502158    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:46:45.830457 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:45.830419    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:45.950007 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:45.949975    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:46.030282 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:46.030241    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:46.207956 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:46.207835    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:46.513088 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:46.505848    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:46.654372 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:46.654314    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:50.369019 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:50.368979    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:52.100031 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:52.100002    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:46:54.312189 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:54.312139    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:54.939821 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:54.939766    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:59.210823 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:59.210766    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:46:59.311843 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:46:59.311782    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:47:05.016816 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:47:05.016760    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:47:07.439187 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:47:07.439150    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:47:07.539516 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:47:07.539474    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:47:15.120465 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:47:15.120379    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:47:18.306828 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:47:18.306769    2557 scope.go:117] "RemoveContainer" containerID="2644a0deabab5668cf46de803a600f729d752af5495dcb03b7c1a7815b586bde"
Jul 21 17:47:34.908856 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:47:34.908823    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:47:38.806219 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:47:38.806182    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:47:52.900782 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:47:52.900738    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:48:05.568033 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:05.567994    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:07.425502 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:07.425457    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:18.184010 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:18.183978    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:48:18.199280 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:18.199260    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:48:30.748398 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:30.748351    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:41.122934 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:41.122861    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:42.008481 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.008419    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:42.128375 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.128336    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"]
Jul 21 17:48:42.129050 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.129030    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e1218a-e083-4c10-8cb7-bbc08c587e87" containerName="cleanup"
Jul 21 17:48:42.129050 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.129051    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e1218a-e083-4c10-8cb7-bbc08c587e87" containerName="cleanup"
Jul 21 17:48:42.129216 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.129152    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="90e1218a-e083-4c10-8cb7-bbc08c587e87" containerName="cleanup"
Jul 21 17:48:42.132374 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.132353    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"
Jul 21 17:48:42.134958 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.134932    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:48:42.135068 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.135023    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:48:42.141308 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.141286    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"]
Jul 21 17:48:42.241883 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.241851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71784055-009d-4589-bf44-8b442dfcf1d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9\" (UID: \"71784055-009d-4589-bf44-8b442dfcf1d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"
Jul 21 17:48:42.343259 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.343169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71784055-009d-4589-bf44-8b442dfcf1d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9\" (UID: \"71784055-009d-4589-bf44-8b442dfcf1d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"
Jul 21 17:48:42.343786 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.343766    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71784055-009d-4589-bf44-8b442dfcf1d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9\" (UID: \"71784055-009d-4589-bf44-8b442dfcf1d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"
Jul 21 17:48:42.443910 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.443880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"
Jul 21 17:48:42.581537 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.581508    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"]
Jul 21 17:48:42.583178 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:48:42.583151    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71784055_009d_4589_bf44_8b442dfcf1d0.slice/crio-e98814b454f6584ae6a23ffabafd19d786ea43c0cae35d13d9422e5881767fc6 WatchSource:0}: Error finding container e98814b454f6584ae6a23ffabafd19d786ea43c0cae35d13d9422e5881767fc6: Status 404 returned error can't find the container with id e98814b454f6584ae6a23ffabafd19d786ea43c0cae35d13d9422e5881767fc6
Jul 21 17:48:42.725553 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.725526    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:42.834096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:42.834065    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:43.390538 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:43.390505    2557 generic.go:356] "Generic (PLEG): container finished" podID="71784055-009d-4589-bf44-8b442dfcf1d0" containerID="9afadb2c9267f28ac8b3d0047aa627eb67a28389a2f477a0d66089bd2ff0fff2" exitCode=0
Jul 21 17:48:43.390900 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:43.390559    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9" event={"ID":"71784055-009d-4589-bf44-8b442dfcf1d0","Type":"ContainerDied","Data":"9afadb2c9267f28ac8b3d0047aa627eb67a28389a2f477a0d66089bd2ff0fff2"}
Jul 21 17:48:43.390900 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:43.390601    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9" event={"ID":"71784055-009d-4589-bf44-8b442dfcf1d0","Type":"ContainerStarted","Data":"e98814b454f6584ae6a23ffabafd19d786ea43c0cae35d13d9422e5881767fc6"}
Jul 21 17:48:44.538301 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:44.538275    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"
Jul 21 17:48:44.563885 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:44.563858    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71784055-009d-4589-bf44-8b442dfcf1d0-maas-api-service-ca\") pod \"71784055-009d-4589-bf44-8b442dfcf1d0\" (UID: \"71784055-009d-4589-bf44-8b442dfcf1d0\") "
Jul 21 17:48:44.564179 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:44.564158    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71784055-009d-4589-bf44-8b442dfcf1d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71784055-009d-4589-bf44-8b442dfcf1d0" (UID: "71784055-009d-4589-bf44-8b442dfcf1d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:48:44.564268 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:44.564255    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71784055-009d-4589-bf44-8b442dfcf1d0-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:48:45.406692 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:45.406664    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"
Jul 21 17:48:45.406893 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:45.406706    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9" event={"ID":"71784055-009d-4589-bf44-8b442dfcf1d0","Type":"ContainerDied","Data":"e98814b454f6584ae6a23ffabafd19d786ea43c0cae35d13d9422e5881767fc6"}
Jul 21 17:48:45.406893 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:45.406755    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e98814b454f6584ae6a23ffabafd19d786ea43c0cae35d13d9422e5881767fc6"
Jul 21 17:48:47.905485 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:47.905449    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:48:52.543201 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:52.543171    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:57.196529 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:57.196479    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:57.214767 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:57.214742    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"]
Jul 21 17:48:57.217366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:57.217345    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1fcb9-rsvt9"]
Jul 21 17:48:57.301504 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:57.301472    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:48:57.602104 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:57.602063    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:48:58.063137 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:48:58.063104    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71784055-009d-4589-bf44-8b442dfcf1d0" path="/var/lib/kubelet/pods/71784055-009d-4589-bf44-8b442dfcf1d0/volumes"
Jul 21 17:49:03.729221 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:03.729185    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:03.787201 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:03.787162    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:04.010769 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.010733    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:04.289126 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.289013    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:04.430636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.430602    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"]
Jul 21 17:49:04.431153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.431134    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71784055-009d-4589-bf44-8b442dfcf1d0" containerName="revoke-keys"
Jul 21 17:49:04.431153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.431154    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="71784055-009d-4589-bf44-8b442dfcf1d0" containerName="revoke-keys"
Jul 21 17:49:04.431321 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.431291    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="71784055-009d-4589-bf44-8b442dfcf1d0" containerName="revoke-keys"
Jul 21 17:49:04.434771 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.434751    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"
Jul 21 17:49:04.437245 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.437223    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:49:04.437352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.437290    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:49:04.444025 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.444003    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"]
Jul 21 17:49:04.557547 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.557459    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/150a7e62-efab-4f0a-8480-c3797c657f98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm\" (UID: \"150a7e62-efab-4f0a-8480-c3797c657f98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"
Jul 21 17:49:04.658652 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.658619    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/150a7e62-efab-4f0a-8480-c3797c657f98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm\" (UID: \"150a7e62-efab-4f0a-8480-c3797c657f98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"
Jul 21 17:49:04.659255 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.659236    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/150a7e62-efab-4f0a-8480-c3797c657f98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm\" (UID: \"150a7e62-efab-4f0a-8480-c3797c657f98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"
Jul 21 17:49:04.746683 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.746653    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"
Jul 21 17:49:04.882480 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.882453    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"]
Jul 21 17:49:04.884450 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:49:04.884425    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150a7e62_efab_4f0a_8480_c3797c657f98.slice/crio-230bc0d40c102a8a48bc57a5019c25380e47c27b5ab134af5e428cdc173dee6a WatchSource:0}: Error finding container 230bc0d40c102a8a48bc57a5019c25380e47c27b5ab134af5e428cdc173dee6a: Status 404 returned error can't find the container with id 230bc0d40c102a8a48bc57a5019c25380e47c27b5ab134af5e428cdc173dee6a
Jul 21 17:49:04.918283 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:04.918255    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:05.019095 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:05.019055    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:05.528746 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:05.528706    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm" event={"ID":"150a7e62-efab-4f0a-8480-c3797c657f98","Type":"ContainerStarted","Data":"fe582677978ab18bf30484aee52aaa19a804ed262a6b844cdc663810d8f25aff"}
Jul 21 17:49:05.528989 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:05.528779    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm" event={"ID":"150a7e62-efab-4f0a-8480-c3797c657f98","Type":"ContainerStarted","Data":"230bc0d40c102a8a48bc57a5019c25380e47c27b5ab134af5e428cdc173dee6a"}
Jul 21 17:49:05.547909 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:05.547860    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm" podStartSLOduration=1.547846493 podStartE2EDuration="1.547846493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:49:05.544636955 +0000 UTC m=+2448.089953170" watchObservedRunningTime="2026-07-21 17:49:05.547846493 +0000 UTC m=+2448.093162709"
Jul 21 17:49:06.536562 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:06.536522    2557 generic.go:356] "Generic (PLEG): container finished" podID="150a7e62-efab-4f0a-8480-c3797c657f98" containerID="fe582677978ab18bf30484aee52aaa19a804ed262a6b844cdc663810d8f25aff" exitCode=0
Jul 21 17:49:06.537042 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:06.536614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm" event={"ID":"150a7e62-efab-4f0a-8480-c3797c657f98","Type":"ContainerDied","Data":"fe582677978ab18bf30484aee52aaa19a804ed262a6b844cdc663810d8f25aff"}
Jul 21 17:49:07.685639 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:07.685616    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"
Jul 21 17:49:07.790638 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:07.790603    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/150a7e62-efab-4f0a-8480-c3797c657f98-maas-api-service-ca\") pod \"150a7e62-efab-4f0a-8480-c3797c657f98\" (UID: \"150a7e62-efab-4f0a-8480-c3797c657f98\") "
Jul 21 17:49:07.790994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:07.790969    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/150a7e62-efab-4f0a-8480-c3797c657f98-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "150a7e62-efab-4f0a-8480-c3797c657f98" (UID: "150a7e62-efab-4f0a-8480-c3797c657f98"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:49:07.891901 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:07.891787    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/150a7e62-efab-4f0a-8480-c3797c657f98-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:49:08.550653 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:08.550622    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"
Jul 21 17:49:08.550827 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:08.550675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm" event={"ID":"150a7e62-efab-4f0a-8480-c3797c657f98","Type":"ContainerDied","Data":"230bc0d40c102a8a48bc57a5019c25380e47c27b5ab134af5e428cdc173dee6a"}
Jul 21 17:49:08.550827 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:08.550721    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="230bc0d40c102a8a48bc57a5019c25380e47c27b5ab134af5e428cdc173dee6a"
Jul 21 17:49:14.852158 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:14.852118    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:17.607538 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:17.607504    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:49:18.342591 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:18.342557    2557 scope.go:117] "RemoveContainer" containerID="d418a804d1cbb6920be62cdd120d49960e7db92101513b56c786fc6bc54b9ae3"
Jul 21 17:49:19.502163 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:19.502135    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"]
Jul 21 17:49:19.504691 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:19.504667    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-95fd83-vrhnm"]
Jul 21 17:49:19.505481 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:19.505455    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:19.899081 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:19.899055    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:20.063479 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:20.063444    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150a7e62-efab-4f0a-8480-c3797c657f98" path="/var/lib/kubelet/pods/150a7e62-efab-4f0a-8480-c3797c657f98/volumes"
Jul 21 17:49:26.229488 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:26.229450    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:26.292430 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:26.292397    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:26.515611 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:26.515575    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:26.789642 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:26.789549    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:27.158099 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:27.158000    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:27.497532 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:27.497450    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:27.818513 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:27.818473    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:30.659422 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:30.659380    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:30.757643 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:30.757608    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:30.864166 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:30.864130    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:31.083297 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:31.083261    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:31.308391 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:31.308356    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:31.409590 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:31.409501    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:33.402487 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:33.402453    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:49:35.223451 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:35.223414    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:35.820188 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:35.820155    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:36.156071 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:36.155975    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:36.251791 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:36.251739    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:39.648505 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:39.648436    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:39.741322 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:39.741286    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:39.870915 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:39.870878    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:40.207269 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:40.207236    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:40.313577 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:40.313543    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:40.413788 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:40.413749    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:44.204485 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:44.204431    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:49.417231 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:49.417200    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:49:52.103681 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.103649    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:52.226267 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.226233    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:49:52.594138 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.594107    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"]
Jul 21 17:49:52.594563 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.594551    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="150a7e62-efab-4f0a-8480-c3797c657f98" containerName="revoke-keys"
Jul 21 17:49:52.594615 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.594565    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="150a7e62-efab-4f0a-8480-c3797c657f98" containerName="revoke-keys"
Jul 21 17:49:52.594653 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.594642    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="150a7e62-efab-4f0a-8480-c3797c657f98" containerName="revoke-keys"
Jul 21 17:49:52.599163 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.599145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"
Jul 21 17:49:52.602769 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.602752    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:49:52.603477 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.603462    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:49:52.610446 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.610419    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"]
Jul 21 17:49:52.749061 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.749029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ffb23e-5be4-466c-9bd5-68a78e0b7367-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-54b201-9dz6x\" (UID: \"d6ffb23e-5be4-466c-9bd5-68a78e0b7367\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"
Jul 21 17:49:52.850178 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.850091    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ffb23e-5be4-466c-9bd5-68a78e0b7367-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-54b201-9dz6x\" (UID: \"d6ffb23e-5be4-466c-9bd5-68a78e0b7367\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"
Jul 21 17:49:52.850715 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.850695    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ffb23e-5be4-466c-9bd5-68a78e0b7367-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-54b201-9dz6x\" (UID: \"d6ffb23e-5be4-466c-9bd5-68a78e0b7367\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"
Jul 21 17:49:52.910719 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:52.910685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"
Jul 21 17:49:53.053988 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:53.053964    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"]
Jul 21 17:49:53.054684 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:49:53.054662    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ffb23e_5be4_466c_9bd5_68a78e0b7367.slice/crio-babd15d1e3268a23b96379f7b05d49a752157ce544e7fc68700e9475ee16f909 WatchSource:0}: Error finding container babd15d1e3268a23b96379f7b05d49a752157ce544e7fc68700e9475ee16f909: Status 404 returned error can't find the container with id babd15d1e3268a23b96379f7b05d49a752157ce544e7fc68700e9475ee16f909
Jul 21 17:49:53.844550 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:53.844519    2557 generic.go:356] "Generic (PLEG): container finished" podID="d6ffb23e-5be4-466c-9bd5-68a78e0b7367" containerID="ab9244802b32bee0b8508f0dead40de9e9f91e23260b3c9b1cdc4a68738d3ef3" exitCode=0
Jul 21 17:49:53.844905 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:53.844573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x" event={"ID":"d6ffb23e-5be4-466c-9bd5-68a78e0b7367","Type":"ContainerDied","Data":"ab9244802b32bee0b8508f0dead40de9e9f91e23260b3c9b1cdc4a68738d3ef3"}
Jul 21 17:49:53.844905 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:53.844623    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x" event={"ID":"d6ffb23e-5be4-466c-9bd5-68a78e0b7367","Type":"ContainerStarted","Data":"babd15d1e3268a23b96379f7b05d49a752157ce544e7fc68700e9475ee16f909"}
Jul 21 17:49:55.002894 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:55.002870    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"
Jul 21 17:49:55.172338 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:55.172254    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ffb23e-5be4-466c-9bd5-68a78e0b7367-maas-api-service-ca\") pod \"d6ffb23e-5be4-466c-9bd5-68a78e0b7367\" (UID: \"d6ffb23e-5be4-466c-9bd5-68a78e0b7367\") "
Jul 21 17:49:55.172618 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:55.172595    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6ffb23e-5be4-466c-9bd5-68a78e0b7367-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d6ffb23e-5be4-466c-9bd5-68a78e0b7367" (UID: "d6ffb23e-5be4-466c-9bd5-68a78e0b7367"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:49:55.273372 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:55.273333    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ffb23e-5be4-466c-9bd5-68a78e0b7367-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:49:55.858322 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:55.858286    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"
Jul 21 17:49:55.858489 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:55.858318    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x" event={"ID":"d6ffb23e-5be4-466c-9bd5-68a78e0b7367","Type":"ContainerDied","Data":"babd15d1e3268a23b96379f7b05d49a752157ce544e7fc68700e9475ee16f909"}
Jul 21 17:49:55.858489 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:55.858362    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="babd15d1e3268a23b96379f7b05d49a752157ce544e7fc68700e9475ee16f909"
Jul 21 17:49:58.839184 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:49:58.839154    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:02.209394 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:02.209360    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:02.311932 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:02.311901    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:08.029434 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:08.029368    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:12.686396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:12.686188    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:12.687789 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:12.687765    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"]
Jul 21 17:50:12.690811 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:12.690780    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-54b201-9dz6x"]
Jul 21 17:50:13.164206 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:13.164173    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:14.016539 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:14.016508    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:50:14.063038 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:14.063007    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6ffb23e-5be4-466c-9bd5-68a78e0b7367" path="/var/lib/kubelet/pods/d6ffb23e-5be4-466c-9bd5-68a78e0b7367/volumes"
Jul 21 17:50:19.177267 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.177224    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:19.244081 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.244023    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:19.498336 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.498236    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:19.745423 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.745384    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:19.890388 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.890355    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"]
Jul 21 17:50:19.890836 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.890822    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ffb23e-5be4-466c-9bd5-68a78e0b7367" containerName="revoke-keys"
Jul 21 17:50:19.890896 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.890838    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ffb23e-5be4-466c-9bd5-68a78e0b7367" containerName="revoke-keys"
Jul 21 17:50:19.890932 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.890917    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6ffb23e-5be4-466c-9bd5-68a78e0b7367" containerName="revoke-keys"
Jul 21 17:50:19.895329 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.895313    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"
Jul 21 17:50:19.898617 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.898597    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:50:19.898812 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.898780    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:50:19.905684 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:19.905662    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"]
Jul 21 17:50:20.003142 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:20.003113    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcb8beb-a10a-45ca-b412-8fad90f01699-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb\" (UID: \"cdcb8beb-a10a-45ca-b412-8fad90f01699\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"
Jul 21 17:50:20.104128 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:20.104099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcb8beb-a10a-45ca-b412-8fad90f01699-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb\" (UID: \"cdcb8beb-a10a-45ca-b412-8fad90f01699\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"
Jul 21 17:50:20.104737 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:20.104716    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcb8beb-a10a-45ca-b412-8fad90f01699-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb\" (UID: \"cdcb8beb-a10a-45ca-b412-8fad90f01699\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"
Jul 21 17:50:20.208166 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:20.208096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"
Jul 21 17:50:20.350406 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:20.350383    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"]
Jul 21 17:50:20.352568 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:50:20.352540    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdcb8beb_a10a_45ca_b412_8fad90f01699.slice/crio-fef4db05db81f1b0ea38b41de852643cdab95e8e61be3fd4158f2d7736eb7922 WatchSource:0}: Error finding container fef4db05db81f1b0ea38b41de852643cdab95e8e61be3fd4158f2d7736eb7922: Status 404 returned error can't find the container with id fef4db05db81f1b0ea38b41de852643cdab95e8e61be3fd4158f2d7736eb7922
Jul 21 17:50:21.018548 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:21.018512    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb" event={"ID":"cdcb8beb-a10a-45ca-b412-8fad90f01699","Type":"ContainerStarted","Data":"b32065f8338cc8acc3675be72c545cda5b66032b7e92fb183ca76c9655c8f33d"}
Jul 21 17:50:21.018719 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:21.018568    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb" event={"ID":"cdcb8beb-a10a-45ca-b412-8fad90f01699","Type":"ContainerStarted","Data":"fef4db05db81f1b0ea38b41de852643cdab95e8e61be3fd4158f2d7736eb7922"}
Jul 21 17:50:21.038961 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:21.038907    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb" podStartSLOduration=2.038891623 podStartE2EDuration="2.038891623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:50:21.036837779 +0000 UTC m=+2523.582153992" watchObservedRunningTime="2026-07-21 17:50:21.038891623 +0000 UTC m=+2523.584207892"
Jul 21 17:50:21.094734 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:21.094707    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:21.217061 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:21.217028    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:21.944077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:21.944038    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:22.026901 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:22.026871    2557 generic.go:356] "Generic (PLEG): container finished" podID="cdcb8beb-a10a-45ca-b412-8fad90f01699" containerID="b32065f8338cc8acc3675be72c545cda5b66032b7e92fb183ca76c9655c8f33d" exitCode=0
Jul 21 17:50:22.027077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:22.026962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb" event={"ID":"cdcb8beb-a10a-45ca-b412-8fad90f01699","Type":"ContainerDied","Data":"b32065f8338cc8acc3675be72c545cda5b66032b7e92fb183ca76c9655c8f33d"}
Jul 21 17:50:22.050819 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:22.047098    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:23.172731 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:23.172707    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"
Jul 21 17:50:23.229958 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:23.229925    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcb8beb-a10a-45ca-b412-8fad90f01699-maas-api-service-ca\") pod \"cdcb8beb-a10a-45ca-b412-8fad90f01699\" (UID: \"cdcb8beb-a10a-45ca-b412-8fad90f01699\") "
Jul 21 17:50:23.230274 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:23.230252    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdcb8beb-a10a-45ca-b412-8fad90f01699-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cdcb8beb-a10a-45ca-b412-8fad90f01699" (UID: "cdcb8beb-a10a-45ca-b412-8fad90f01699"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:50:23.331064 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:23.330981    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcb8beb-a10a-45ca-b412-8fad90f01699-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:50:24.040723 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:24.040686    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb" event={"ID":"cdcb8beb-a10a-45ca-b412-8fad90f01699","Type":"ContainerDied","Data":"fef4db05db81f1b0ea38b41de852643cdab95e8e61be3fd4158f2d7736eb7922"}
Jul 21 17:50:24.040929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:24.040739    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fef4db05db81f1b0ea38b41de852643cdab95e8e61be3fd4158f2d7736eb7922"
Jul 21 17:50:24.040929 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:24.040698    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"
Jul 21 17:50:35.358910 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:35.358869    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:39.130346 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:39.130313    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:50:40.029568 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:40.029531    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:40.064187 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:40.064159    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"]
Jul 21 17:50:40.064187 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:40.064194    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-eb37d3-2zsxb"]
Jul 21 17:50:40.502289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:40.502195    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:42.062677 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:42.062640    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdcb8beb-a10a-45ca-b412-8fad90f01699" path="/var/lib/kubelet/pods/cdcb8beb-a10a-45ca-b412-8fad90f01699/volumes"
Jul 21 17:50:46.625534 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:46.625500    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:46.720930 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:46.720876    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:46.941465 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:46.941377    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:47.208489 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:47.208394    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:47.577608 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:47.577545    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:47.928965 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:47.928875    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:48.041336 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:48.041305    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:51.084138 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:51.084100    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:51.184467 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:51.184427    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:51.379276 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:51.379190    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:51.471284 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:51.471241    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:51.897225 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:51.897184    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:51.991572 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:51.991535    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:55.488752 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:55.488715    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:55.849956 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:55.849920    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:56.215624 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:56.215525    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:56.365976 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:56.365944    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:56.707069 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:56.707029    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:50:59.052197 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:59.052164    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:59.164761 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:59.164713    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:59.256068 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:59.256032    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:59.580543 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:59.580504    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:59.767219 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:59.767185    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:50:59.866077 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:50:59.866044    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:51:03.564297 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:03.564256    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:51:09.405628 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:09.405590    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:51:12.699987 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:12.699950    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:51:12.799157 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:12.799118    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:51:18.374717 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:18.374612    2557 scope.go:117] "RemoveContainer" containerID="f17b5e40470383e7f0e026cb37658b64177e01992cb2b201cb5dd9b963d865b9"
Jul 21 17:51:20.683009 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:20.682973    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:51:20.819140 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:20.819100    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:51:20.913269 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:20.913235    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:51:24.242715 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:24.242684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:51:50.254995 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:50.254904    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:51:53.523591 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:53.523561    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:51:54.561180 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:51:54.561144    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:52:01.371461 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:52:01.371426    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:52:01.432526 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:52:01.432493    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:52:13.144631 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:52:13.144589    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:52:31.021198 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:52:31.021166    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:52:45.401244 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:52:45.401212    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:53:02.813287 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:53:02.813251    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:53:18.226458 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:53:18.226379    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:53:18.244368 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:53:18.244344    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:53:21.908249 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:53:21.908214    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:53:40.001362 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:53:40.001324    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:53:55.138685 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:53:55.138646    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:53:57.905875 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:53:57.905836    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:53:58.417914 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:53:58.417883    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:54:03.546411 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:54:03.546380    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:54:14.404706 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:54:14.404667    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:54:27.950061 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:54:27.950024    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:54:31.611877 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:54:31.611845    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:54:50.614406 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:54:50.614313    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:55:06.906681 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:06.906636    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:55:12.954268 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:12.954235    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:55:13.740209 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:13.740166    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:55:16.239994 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:16.239960    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:55:18.426608 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:18.426578    2557 scope.go:117] "RemoveContainer" containerID="9afadb2c9267f28ac8b3d0047aa627eb67a28389a2f477a0d66089bd2ff0fff2"
Jul 21 17:55:18.438382 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:18.438361    2557 scope.go:117] "RemoveContainer" containerID="fe582677978ab18bf30484aee52aaa19a804ed262a6b844cdc663810d8f25aff"
Jul 21 17:55:21.842048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:21.842012    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:55:21.946109 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:21.946071    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:55:25.512419 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:25.512384    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:55:38.221036 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:38.221003    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:55:39.752704 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:39.752671    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:55:42.914019 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:42.913983    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:55:57.120677 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:55:57.120644    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:56:03.281303 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:03.281263    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:12.198856 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:12.198767    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:56:13.439736 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:13.439699    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:14.098780 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:14.098748    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:18.015489 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:18.015455    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:18.466380 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:18.466235    2557 scope.go:117] "RemoveContainer" containerID="ab9244802b32bee0b8508f0dead40de9e9f91e23260b3c9b1cdc4a68738d3ef3"
Jul 21 17:56:18.822008 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:18.821976    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:19.878641 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:19.878607    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-139734843168944"]
Jul 21 17:56:19.879112 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:19.879098    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdcb8beb-a10a-45ca-b412-8fad90f01699" containerName="revoke-keys"
Jul 21 17:56:19.879112 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:19.879113    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdcb8beb-a10a-45ca-b412-8fad90f01699" containerName="revoke-keys"
Jul 21 17:56:19.879202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:19.879193    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdcb8beb-a10a-45ca-b412-8fad90f01699" containerName="revoke-keys"
Jul 21 17:56:19.883668 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:19.883652    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843168944"
Jul 21 17:56:19.886664 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:19.886638    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4xn5q\""
Jul 21 17:56:19.888943 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:19.888920    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843168944"]
Jul 21 17:56:19.943788 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:19.943751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb2kq\" (UniqueName: \"kubernetes.io/projected/df539a7e-df30-42ea-8dfb-9830a49f070b-kube-api-access-fb2kq\") pod \"test-curl-7409-139734843168944\" (UID: \"df539a7e-df30-42ea-8dfb-9830a49f070b\") " pod="opendatahub/test-curl-7409-139734843168944"
Jul 21 17:56:20.044430 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:20.044396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb2kq\" (UniqueName: \"kubernetes.io/projected/df539a7e-df30-42ea-8dfb-9830a49f070b-kube-api-access-fb2kq\") pod \"test-curl-7409-139734843168944\" (UID: \"df539a7e-df30-42ea-8dfb-9830a49f070b\") " pod="opendatahub/test-curl-7409-139734843168944"
Jul 21 17:56:20.053393 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:20.053367    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb2kq\" (UniqueName: \"kubernetes.io/projected/df539a7e-df30-42ea-8dfb-9830a49f070b-kube-api-access-fb2kq\") pod \"test-curl-7409-139734843168944\" (UID: \"df539a7e-df30-42ea-8dfb-9830a49f070b\") " pod="opendatahub/test-curl-7409-139734843168944"
Jul 21 17:56:20.195380 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:20.195311    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843168944"
Jul 21 17:56:20.345479 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:20.345452    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843168944"]
Jul 21 17:56:20.347293 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:56:20.347267    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf539a7e_df30_42ea_8dfb_9830a49f070b.slice/crio-47f9f5291beb6f73ed7b95c73dd1c375617a1798dc444ead5d3a6f0caecd5969 WatchSource:0}: Error finding container 47f9f5291beb6f73ed7b95c73dd1c375617a1798dc444ead5d3a6f0caecd5969: Status 404 returned error can't find the container with id 47f9f5291beb6f73ed7b95c73dd1c375617a1798dc444ead5d3a6f0caecd5969
Jul 21 17:56:20.349007 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:20.348988    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:56:21.273670 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:21.273634    2557 generic.go:356] "Generic (PLEG): container finished" podID="df539a7e-df30-42ea-8dfb-9830a49f070b" containerID="3af40a596872cdcc5eda0cd74ac2098bf27d3db09fb9a2771bf61b0be69cd027" exitCode=0
Jul 21 17:56:21.274069 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:21.273725    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843168944" event={"ID":"df539a7e-df30-42ea-8dfb-9830a49f070b","Type":"ContainerDied","Data":"3af40a596872cdcc5eda0cd74ac2098bf27d3db09fb9a2771bf61b0be69cd027"}
Jul 21 17:56:21.274069 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:21.273768    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843168944" event={"ID":"df539a7e-df30-42ea-8dfb-9830a49f070b","Type":"ContainerStarted","Data":"47f9f5291beb6f73ed7b95c73dd1c375617a1798dc444ead5d3a6f0caecd5969"}
Jul 21 17:56:21.611112 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:21.611081    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:21.712128 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:21.712095    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:22.426333 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.426310    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843168944"
Jul 21 17:56:22.447235 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.447209    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-139734843168944_df539a7e-df30-42ea-8dfb-9830a49f070b/test-curl-7409-139734843168944/0.log"
Jul 21 17:56:22.473484 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.473457    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-139734843168944"]
Jul 21 17:56:22.477246 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.477221    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-139734843168944"]
Jul 21 17:56:22.571718 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.571633    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb2kq\" (UniqueName: \"kubernetes.io/projected/df539a7e-df30-42ea-8dfb-9830a49f070b-kube-api-access-fb2kq\") pod \"df539a7e-df30-42ea-8dfb-9830a49f070b\" (UID: \"df539a7e-df30-42ea-8dfb-9830a49f070b\") "
Jul 21 17:56:22.573978 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.573948    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df539a7e-df30-42ea-8dfb-9830a49f070b-kube-api-access-fb2kq" (OuterVolumeSpecName: "kube-api-access-fb2kq") pod "df539a7e-df30-42ea-8dfb-9830a49f070b" (UID: "df539a7e-df30-42ea-8dfb-9830a49f070b"). InnerVolumeSpecName "kube-api-access-fb2kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:56:22.607275 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.607242    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-139734843175856"]
Jul 21 17:56:22.607708 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.607695    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df539a7e-df30-42ea-8dfb-9830a49f070b" containerName="test-curl-7409-139734843168944"
Jul 21 17:56:22.607755 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.607709    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="df539a7e-df30-42ea-8dfb-9830a49f070b" containerName="test-curl-7409-139734843168944"
Jul 21 17:56:22.607814 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.607789    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="df539a7e-df30-42ea-8dfb-9830a49f070b" containerName="test-curl-7409-139734843168944"
Jul 21 17:56:22.611008 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.610992    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843175856"
Jul 21 17:56:22.618232 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.618206    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843175856"]
Jul 21 17:56:22.672877 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.672844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tccbm\" (UniqueName: \"kubernetes.io/projected/97213722-4758-4f39-97dc-32eae1186c53-kube-api-access-tccbm\") pod \"test-curl-7409-139734843175856\" (UID: \"97213722-4758-4f39-97dc-32eae1186c53\") " pod="opendatahub/test-curl-7409-139734843175856"
Jul 21 17:56:22.673049 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.673021    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb2kq\" (UniqueName: \"kubernetes.io/projected/df539a7e-df30-42ea-8dfb-9830a49f070b-kube-api-access-fb2kq\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:56:22.773898 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.773861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tccbm\" (UniqueName: \"kubernetes.io/projected/97213722-4758-4f39-97dc-32eae1186c53-kube-api-access-tccbm\") pod \"test-curl-7409-139734843175856\" (UID: \"97213722-4758-4f39-97dc-32eae1186c53\") " pod="opendatahub/test-curl-7409-139734843175856"
Jul 21 17:56:22.782147 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.782122    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tccbm\" (UniqueName: \"kubernetes.io/projected/97213722-4758-4f39-97dc-32eae1186c53-kube-api-access-tccbm\") pod \"test-curl-7409-139734843175856\" (UID: \"97213722-4758-4f39-97dc-32eae1186c53\") " pod="opendatahub/test-curl-7409-139734843175856"
Jul 21 17:56:22.921382 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:22.921298    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843175856"
Jul 21 17:56:23.055592 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:23.055560    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843175856"]
Jul 21 17:56:23.056590 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:56:23.056567    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97213722_4758_4f39_97dc_32eae1186c53.slice/crio-5e352fb3f06c80473ceff909a1d50928dabbbe23f4100e380bee190ce0d46a9c WatchSource:0}: Error finding container 5e352fb3f06c80473ceff909a1d50928dabbbe23f4100e380bee190ce0d46a9c: Status 404 returned error can't find the container with id 5e352fb3f06c80473ceff909a1d50928dabbbe23f4100e380bee190ce0d46a9c
Jul 21 17:56:23.286493 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:23.286465    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843168944"
Jul 21 17:56:23.286667 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:23.286508    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47f9f5291beb6f73ed7b95c73dd1c375617a1798dc444ead5d3a6f0caecd5969"
Jul 21 17:56:23.287694 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:23.287669    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843175856" event={"ID":"97213722-4758-4f39-97dc-32eae1186c53","Type":"ContainerStarted","Data":"5e352fb3f06c80473ceff909a1d50928dabbbe23f4100e380bee190ce0d46a9c"}
Jul 21 17:56:23.297445 ip-10-0-128-12 kubenswrapper[2557]: E0721 17:56:23.297421    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7409-139734843168944\" is forbidden: User \"system:node:ip-10-0-128-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-12.ec2.internal' and this object" podUID="df539a7e-df30-42ea-8dfb-9830a49f070b" pod="opendatahub/test-curl-7409-139734843168944"
Jul 21 17:56:24.063527 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:24.063496    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df539a7e-df30-42ea-8dfb-9830a49f070b" path="/var/lib/kubelet/pods/df539a7e-df30-42ea-8dfb-9830a49f070b/volumes"
Jul 21 17:56:24.294313 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:24.294284    2557 generic.go:356] "Generic (PLEG): container finished" podID="97213722-4758-4f39-97dc-32eae1186c53" containerID="b4817745811a55e7fbf6c4bcebe97a009a62a060cc0d8e849a5f19cb4bfb87a7" exitCode=0
Jul 21 17:56:24.294479 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:24.294340    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843175856" event={"ID":"97213722-4758-4f39-97dc-32eae1186c53","Type":"ContainerDied","Data":"b4817745811a55e7fbf6c4bcebe97a009a62a060cc0d8e849a5f19cb4bfb87a7"}
Jul 21 17:56:25.429640 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.429616    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843175856"
Jul 21 17:56:25.450811 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.450778    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-139734843175856_97213722-4758-4f39-97dc-32eae1186c53/test-curl-7409-139734843175856/0.log"
Jul 21 17:56:25.474905 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.474870    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-139734843175856"]
Jul 21 17:56:25.478861 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.478840    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-139734843175856"]
Jul 21 17:56:25.500428 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.500407    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tccbm\" (UniqueName: \"kubernetes.io/projected/97213722-4758-4f39-97dc-32eae1186c53-kube-api-access-tccbm\") pod \"97213722-4758-4f39-97dc-32eae1186c53\" (UID: \"97213722-4758-4f39-97dc-32eae1186c53\") "
Jul 21 17:56:25.502347 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.502327    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97213722-4758-4f39-97dc-32eae1186c53-kube-api-access-tccbm" (OuterVolumeSpecName: "kube-api-access-tccbm") pod "97213722-4758-4f39-97dc-32eae1186c53" (UID: "97213722-4758-4f39-97dc-32eae1186c53"). InnerVolumeSpecName "kube-api-access-tccbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:56:25.601588 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.601512    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tccbm\" (UniqueName: \"kubernetes.io/projected/97213722-4758-4f39-97dc-32eae1186c53-kube-api-access-tccbm\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:56:25.653023 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.652986    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:25.653494 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.653480    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97213722-4758-4f39-97dc-32eae1186c53" containerName="test-curl-7409-139734843175856"
Jul 21 17:56:25.653533 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.653495    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="97213722-4758-4f39-97dc-32eae1186c53" containerName="test-curl-7409-139734843175856"
Jul 21 17:56:25.653582 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.653573    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="97213722-4758-4f39-97dc-32eae1186c53" containerName="test-curl-7409-139734843175856"
Jul 21 17:56:25.656841 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.656823    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:25.662237 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.662207    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:25.803181 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.803147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrcd2\" (UniqueName: \"kubernetes.io/projected/96c2dd47-e3dd-4769-821e-5c906925acb2-kube-api-access-rrcd2\") pod \"test-curl-7409-139734843208736\" (UID: \"96c2dd47-e3dd-4769-821e-5c906925acb2\") " pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:25.904663 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.904576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrcd2\" (UniqueName: \"kubernetes.io/projected/96c2dd47-e3dd-4769-821e-5c906925acb2-kube-api-access-rrcd2\") pod \"test-curl-7409-139734843208736\" (UID: \"96c2dd47-e3dd-4769-821e-5c906925acb2\") " pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:25.913340 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.913311    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrcd2\" (UniqueName: \"kubernetes.io/projected/96c2dd47-e3dd-4769-821e-5c906925acb2-kube-api-access-rrcd2\") pod \"test-curl-7409-139734843208736\" (UID: \"96c2dd47-e3dd-4769-821e-5c906925acb2\") " pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:25.968366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:25.968344    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:26.065773 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:26.065741    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97213722-4758-4f39-97dc-32eae1186c53" path="/var/lib/kubelet/pods/97213722-4758-4f39-97dc-32eae1186c53/volumes"
Jul 21 17:56:26.104708 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:26.104684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:26.106124 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:56:26.106100    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96c2dd47_e3dd_4769_821e_5c906925acb2.slice/crio-4c13af28926752c46546896fd0688542dab18e07c6429d6b07fa9e3bea24a733 WatchSource:0}: Error finding container 4c13af28926752c46546896fd0688542dab18e07c6429d6b07fa9e3bea24a733: Status 404 returned error can't find the container with id 4c13af28926752c46546896fd0688542dab18e07c6429d6b07fa9e3bea24a733
Jul 21 17:56:26.307673 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:26.307643    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843175856"
Jul 21 17:56:26.307887 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:26.307673    2557 scope.go:117] "RemoveContainer" containerID="b4817745811a55e7fbf6c4bcebe97a009a62a060cc0d8e849a5f19cb4bfb87a7"
Jul 21 17:56:26.309217 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:26.309188    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843208736" event={"ID":"96c2dd47-e3dd-4769-821e-5c906925acb2","Type":"ContainerStarted","Data":"4c13af28926752c46546896fd0688542dab18e07c6429d6b07fa9e3bea24a733"}
Jul 21 17:56:27.318356 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:27.318314    2557 generic.go:356] "Generic (PLEG): container finished" podID="96c2dd47-e3dd-4769-821e-5c906925acb2" containerID="257f5eaa5a824bdf9689cf92c525d2e7b2efd4a80d3f084cf3ec021cfc7069db" exitCode=0
Jul 21 17:56:27.318782 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:27.318376    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843208736" event={"ID":"96c2dd47-e3dd-4769-821e-5c906925acb2","Type":"ContainerDied","Data":"257f5eaa5a824bdf9689cf92c525d2e7b2efd4a80d3f084cf3ec021cfc7069db"}
Jul 21 17:56:28.454639 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.454616    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:28.475427 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.475404    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-139734843208736_96c2dd47-e3dd-4769-821e-5c906925acb2/test-curl-7409-139734843208736/0.log"
Jul 21 17:56:28.500150 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.500123    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:28.504582 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.504557    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:28.529595 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.529570    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrcd2\" (UniqueName: \"kubernetes.io/projected/96c2dd47-e3dd-4769-821e-5c906925acb2-kube-api-access-rrcd2\") pod \"96c2dd47-e3dd-4769-821e-5c906925acb2\" (UID: \"96c2dd47-e3dd-4769-821e-5c906925acb2\") "
Jul 21 17:56:28.531559 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.531537    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c2dd47-e3dd-4769-821e-5c906925acb2-kube-api-access-rrcd2" (OuterVolumeSpecName: "kube-api-access-rrcd2") pod "96c2dd47-e3dd-4769-821e-5c906925acb2" (UID: "96c2dd47-e3dd-4769-821e-5c906925acb2"). InnerVolumeSpecName "kube-api-access-rrcd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:56:28.625320 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.625228    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:28.625726 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.625712    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c2dd47-e3dd-4769-821e-5c906925acb2" containerName="test-curl-7409-139734843208736"
Jul 21 17:56:28.625781 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.625727    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c2dd47-e3dd-4769-821e-5c906925acb2" containerName="test-curl-7409-139734843208736"
Jul 21 17:56:28.625843 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.625820    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c2dd47-e3dd-4769-821e-5c906925acb2" containerName="test-curl-7409-139734843208736"
Jul 21 17:56:28.628885 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.628867    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:28.630753 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.630731    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrcd2\" (UniqueName: \"kubernetes.io/projected/96c2dd47-e3dd-4769-821e-5c906925acb2-kube-api-access-rrcd2\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:56:28.636840 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.636778    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:28.731937 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.731907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mxr\" (UniqueName: \"kubernetes.io/projected/b2ad68b1-c395-42dc-b3fb-9917c0662ad2-kube-api-access-82mxr\") pod \"test-curl-7409-139734843208736\" (UID: \"b2ad68b1-c395-42dc-b3fb-9917c0662ad2\") " pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:28.832885 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.832846    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mxr\" (UniqueName: \"kubernetes.io/projected/b2ad68b1-c395-42dc-b3fb-9917c0662ad2-kube-api-access-82mxr\") pod \"test-curl-7409-139734843208736\" (UID: \"b2ad68b1-c395-42dc-b3fb-9917c0662ad2\") " pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:28.841827 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.841769    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mxr\" (UniqueName: \"kubernetes.io/projected/b2ad68b1-c395-42dc-b3fb-9917c0662ad2-kube-api-access-82mxr\") pod \"test-curl-7409-139734843208736\" (UID: \"b2ad68b1-c395-42dc-b3fb-9917c0662ad2\") " pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:28.939821 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:28.939726    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:29.089292 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:56:29.089173    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2ad68b1_c395_42dc_b3fb_9917c0662ad2.slice/crio-022bb0c543c441a27a04004a50aed28423242ef727ad867ad92960426ba1ae4f WatchSource:0}: Error finding container 022bb0c543c441a27a04004a50aed28423242ef727ad867ad92960426ba1ae4f: Status 404 returned error can't find the container with id 022bb0c543c441a27a04004a50aed28423242ef727ad867ad92960426ba1ae4f
Jul 21 17:56:29.089552 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:29.089524    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:29.331634 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:29.331608    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:29.331634 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:29.331633    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c13af28926752c46546896fd0688542dab18e07c6429d6b07fa9e3bea24a733"
Jul 21 17:56:29.332892 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:29.332860    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843208736" event={"ID":"b2ad68b1-c395-42dc-b3fb-9917c0662ad2","Type":"ContainerStarted","Data":"022bb0c543c441a27a04004a50aed28423242ef727ad867ad92960426ba1ae4f"}
Jul 21 17:56:29.343048 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:29.343020    2557 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7409-139734843208736" oldPodUID="96c2dd47-e3dd-4769-821e-5c906925acb2" podUID="b2ad68b1-c395-42dc-b3fb-9917c0662ad2"
Jul 21 17:56:29.999529 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:29.999499    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:56:30.064746 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:30.064715    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c2dd47-e3dd-4769-821e-5c906925acb2" path="/var/lib/kubelet/pods/96c2dd47-e3dd-4769-821e-5c906925acb2/volumes"
Jul 21 17:56:30.341388 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:30.341357    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2ad68b1-c395-42dc-b3fb-9917c0662ad2" containerID="e7cfbe0cf1b8d7a5ccadbcd493d30bd33e47a3e3a7bf10bcb2c5c753ab84ff6b" exitCode=0
Jul 21 17:56:30.341574 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:30.341391    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843208736" event={"ID":"b2ad68b1-c395-42dc-b3fb-9917c0662ad2","Type":"ContainerDied","Data":"e7cfbe0cf1b8d7a5ccadbcd493d30bd33e47a3e3a7bf10bcb2c5c753ab84ff6b"}
Jul 21 17:56:31.494425 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.494398    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:31.514567 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.514538    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-139734843208736_b2ad68b1-c395-42dc-b3fb-9917c0662ad2/test-curl-7409-139734843208736/0.log"
Jul 21 17:56:31.541775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.541741    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:31.545360 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.545335    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-139734843208736"]
Jul 21 17:56:31.663159 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.663068    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82mxr\" (UniqueName: \"kubernetes.io/projected/b2ad68b1-c395-42dc-b3fb-9917c0662ad2-kube-api-access-82mxr\") pod \"b2ad68b1-c395-42dc-b3fb-9917c0662ad2\" (UID: \"b2ad68b1-c395-42dc-b3fb-9917c0662ad2\") "
Jul 21 17:56:31.665308 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.665279    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ad68b1-c395-42dc-b3fb-9917c0662ad2-kube-api-access-82mxr" (OuterVolumeSpecName: "kube-api-access-82mxr") pod "b2ad68b1-c395-42dc-b3fb-9917c0662ad2" (UID: "b2ad68b1-c395-42dc-b3fb-9917c0662ad2"). InnerVolumeSpecName "kube-api-access-82mxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:56:31.669114 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.669090    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:31.669545 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.669531    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ad68b1-c395-42dc-b3fb-9917c0662ad2" containerName="test-curl-7409-139734843208736"
Jul 21 17:56:31.669594 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.669547    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ad68b1-c395-42dc-b3fb-9917c0662ad2" containerName="test-curl-7409-139734843208736"
Jul 21 17:56:31.669933 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.669636    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ad68b1-c395-42dc-b3fb-9917c0662ad2" containerName="test-curl-7409-139734843208736"
Jul 21 17:56:31.672703 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.672678    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:31.680226 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.680199    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:31.764613 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.764576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz5f8\" (UniqueName: \"kubernetes.io/projected/5efb25ec-8749-46f8-a74f-3d84424f64f7-kube-api-access-xz5f8\") pod \"test-curl-7409-139734843209744\" (UID: \"5efb25ec-8749-46f8-a74f-3d84424f64f7\") " pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:31.764763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.764726    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82mxr\" (UniqueName: \"kubernetes.io/projected/b2ad68b1-c395-42dc-b3fb-9917c0662ad2-kube-api-access-82mxr\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:56:31.865619 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.865590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz5f8\" (UniqueName: \"kubernetes.io/projected/5efb25ec-8749-46f8-a74f-3d84424f64f7-kube-api-access-xz5f8\") pod \"test-curl-7409-139734843209744\" (UID: \"5efb25ec-8749-46f8-a74f-3d84424f64f7\") " pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:31.875229 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.875200    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz5f8\" (UniqueName: \"kubernetes.io/projected/5efb25ec-8749-46f8-a74f-3d84424f64f7-kube-api-access-xz5f8\") pod \"test-curl-7409-139734843209744\" (UID: \"5efb25ec-8749-46f8-a74f-3d84424f64f7\") " pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:31.983189 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:31.983104    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:32.064776 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:32.064741    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ad68b1-c395-42dc-b3fb-9917c0662ad2" path="/var/lib/kubelet/pods/b2ad68b1-c395-42dc-b3fb-9917c0662ad2/volumes"
Jul 21 17:56:32.124530 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:32.124507    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:32.125997 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:56:32.125971    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5efb25ec_8749_46f8_a74f_3d84424f64f7.slice/crio-338b59294402ca38a521070fe623386eae318e5a97dd0d5cf40aee5367a151d0 WatchSource:0}: Error finding container 338b59294402ca38a521070fe623386eae318e5a97dd0d5cf40aee5367a151d0: Status 404 returned error can't find the container with id 338b59294402ca38a521070fe623386eae318e5a97dd0d5cf40aee5367a151d0
Jul 21 17:56:32.355163 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:32.355135    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843208736"
Jul 21 17:56:32.355163 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:32.355156    2557 scope.go:117] "RemoveContainer" containerID="e7cfbe0cf1b8d7a5ccadbcd493d30bd33e47a3e3a7bf10bcb2c5c753ab84ff6b"
Jul 21 17:56:32.356775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:32.356746    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843209744" event={"ID":"5efb25ec-8749-46f8-a74f-3d84424f64f7","Type":"ContainerStarted","Data":"338b59294402ca38a521070fe623386eae318e5a97dd0d5cf40aee5367a151d0"}
Jul 21 17:56:33.366156 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:33.366118    2557 generic.go:356] "Generic (PLEG): container finished" podID="5efb25ec-8749-46f8-a74f-3d84424f64f7" containerID="6a8e60a422b14718a66447b2b100aa428344e1a390ce0fbf5ec6f7eca40c2220" exitCode=0
Jul 21 17:56:33.366529 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:33.366205    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843209744" event={"ID":"5efb25ec-8749-46f8-a74f-3d84424f64f7","Type":"ContainerDied","Data":"6a8e60a422b14718a66447b2b100aa428344e1a390ce0fbf5ec6f7eca40c2220"}
Jul 21 17:56:34.517063 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.517039    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:34.542218 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.542187    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-139734843209744_5efb25ec-8749-46f8-a74f-3d84424f64f7/test-curl-7409-139734843209744/0.log"
Jul 21 17:56:34.572236 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.572209    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:34.574608 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.574585    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:34.692075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.691986    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz5f8\" (UniqueName: \"kubernetes.io/projected/5efb25ec-8749-46f8-a74f-3d84424f64f7-kube-api-access-xz5f8\") pod \"5efb25ec-8749-46f8-a74f-3d84424f64f7\" (UID: \"5efb25ec-8749-46f8-a74f-3d84424f64f7\") "
Jul 21 17:56:34.694052 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.694024    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5efb25ec-8749-46f8-a74f-3d84424f64f7-kube-api-access-xz5f8" (OuterVolumeSpecName: "kube-api-access-xz5f8") pod "5efb25ec-8749-46f8-a74f-3d84424f64f7" (UID: "5efb25ec-8749-46f8-a74f-3d84424f64f7"). InnerVolumeSpecName "kube-api-access-xz5f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:56:34.706712 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.706685    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:34.707219 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.707202    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5efb25ec-8749-46f8-a74f-3d84424f64f7" containerName="test-curl-7409-139734843209744"
Jul 21 17:56:34.707307 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.707221    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5efb25ec-8749-46f8-a74f-3d84424f64f7" containerName="test-curl-7409-139734843209744"
Jul 21 17:56:34.707365 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.707322    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5efb25ec-8749-46f8-a74f-3d84424f64f7" containerName="test-curl-7409-139734843209744"
Jul 21 17:56:34.710486 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.710469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:34.716027 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.716008    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:34.793248 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.793217    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf42v\" (UniqueName: \"kubernetes.io/projected/1fa9b9d1-773d-4b96-bf45-1674c54c3656-kube-api-access-vf42v\") pod \"test-curl-7409-139734843209744\" (UID: \"1fa9b9d1-773d-4b96-bf45-1674c54c3656\") " pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:34.793423 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.793353    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz5f8\" (UniqueName: \"kubernetes.io/projected/5efb25ec-8749-46f8-a74f-3d84424f64f7-kube-api-access-xz5f8\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:56:34.894206 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.894173    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf42v\" (UniqueName: \"kubernetes.io/projected/1fa9b9d1-773d-4b96-bf45-1674c54c3656-kube-api-access-vf42v\") pod \"test-curl-7409-139734843209744\" (UID: \"1fa9b9d1-773d-4b96-bf45-1674c54c3656\") " pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:34.904088 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:34.904059    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf42v\" (UniqueName: \"kubernetes.io/projected/1fa9b9d1-773d-4b96-bf45-1674c54c3656-kube-api-access-vf42v\") pod \"test-curl-7409-139734843209744\" (UID: \"1fa9b9d1-773d-4b96-bf45-1674c54c3656\") " pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:35.022096 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:35.022071    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:35.174201 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:35.174178    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:35.175491 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:56:35.175470    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fa9b9d1_773d_4b96_bf45_1674c54c3656.slice/crio-ba66e4e2343d34e4d6807ee74136371781d41b5a9acd226b193f5af5906b333f WatchSource:0}: Error finding container ba66e4e2343d34e4d6807ee74136371781d41b5a9acd226b193f5af5906b333f: Status 404 returned error can't find the container with id ba66e4e2343d34e4d6807ee74136371781d41b5a9acd226b193f5af5906b333f
Jul 21 17:56:35.379578 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:35.379486    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843209744" event={"ID":"1fa9b9d1-773d-4b96-bf45-1674c54c3656","Type":"ContainerStarted","Data":"ba66e4e2343d34e4d6807ee74136371781d41b5a9acd226b193f5af5906b333f"}
Jul 21 17:56:35.380793 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:35.380774    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="338b59294402ca38a521070fe623386eae318e5a97dd0d5cf40aee5367a151d0"
Jul 21 17:56:35.380927 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:35.380822    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:35.393422 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:35.393394    2557 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7409-139734843209744" oldPodUID="5efb25ec-8749-46f8-a74f-3d84424f64f7" podUID="1fa9b9d1-773d-4b96-bf45-1674c54c3656"
Jul 21 17:56:36.063035 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:36.063004    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5efb25ec-8749-46f8-a74f-3d84424f64f7" path="/var/lib/kubelet/pods/5efb25ec-8749-46f8-a74f-3d84424f64f7/volumes"
Jul 21 17:56:36.388940 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:36.388856    2557 generic.go:356] "Generic (PLEG): container finished" podID="1fa9b9d1-773d-4b96-bf45-1674c54c3656" containerID="7fb634b119080972cf22a51417d0a5c5ecf1f68c267277bf715c26374d91c9e8" exitCode=0
Jul 21 17:56:36.389084 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:36.388951    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-139734843209744" event={"ID":"1fa9b9d1-773d-4b96-bf45-1674c54c3656","Type":"ContainerDied","Data":"7fb634b119080972cf22a51417d0a5c5ecf1f68c267277bf715c26374d91c9e8"}
Jul 21 17:56:37.544775 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.544748    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:37.566749 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.566718    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-139734843209744_1fa9b9d1-773d-4b96-bf45-1674c54c3656/test-curl-7409-139734843209744/0.log"
Jul 21 17:56:37.592482 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.592437    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:37.596358 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.596333    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-139734843209744"]
Jul 21 17:56:37.722257 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.722168    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf42v\" (UniqueName: \"kubernetes.io/projected/1fa9b9d1-773d-4b96-bf45-1674c54c3656-kube-api-access-vf42v\") pod \"1fa9b9d1-773d-4b96-bf45-1674c54c3656\" (UID: \"1fa9b9d1-773d-4b96-bf45-1674c54c3656\") "
Jul 21 17:56:37.724293 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.724268    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa9b9d1-773d-4b96-bf45-1674c54c3656-kube-api-access-vf42v" (OuterVolumeSpecName: "kube-api-access-vf42v") pod "1fa9b9d1-773d-4b96-bf45-1674c54c3656" (UID: "1fa9b9d1-773d-4b96-bf45-1674c54c3656"). InnerVolumeSpecName "kube-api-access-vf42v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:56:37.784727 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.784690    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"]
Jul 21 17:56:37.785233 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.785219    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa9b9d1-773d-4b96-bf45-1674c54c3656" containerName="test-curl-7409-139734843209744"
Jul 21 17:56:37.785290 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.785235    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa9b9d1-773d-4b96-bf45-1674c54c3656" containerName="test-curl-7409-139734843209744"
Jul 21 17:56:37.785324 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.785312    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa9b9d1-773d-4b96-bf45-1674c54c3656" containerName="test-curl-7409-139734843209744"
Jul 21 17:56:37.788538 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.788524    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"
Jul 21 17:56:37.791310 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.791289    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:56:37.791424 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.791319    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:56:37.796161 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.796009    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"]
Jul 21 17:56:37.823592 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.823556    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf42v\" (UniqueName: \"kubernetes.io/projected/1fa9b9d1-773d-4b96-bf45-1674c54c3656-kube-api-access-vf42v\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:56:37.924254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:37.924211    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7d270a-48fa-4938-8a78-2667cd49b334-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-43413b-nbjch\" (UID: \"8e7d270a-48fa-4938-8a78-2667cd49b334\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"
Jul 21 17:56:38.025046 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.025012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7d270a-48fa-4938-8a78-2667cd49b334-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-43413b-nbjch\" (UID: \"8e7d270a-48fa-4938-8a78-2667cd49b334\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"
Jul 21 17:56:38.025681 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.025654    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7d270a-48fa-4938-8a78-2667cd49b334-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-43413b-nbjch\" (UID: \"8e7d270a-48fa-4938-8a78-2667cd49b334\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"
Jul 21 17:56:38.064112 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.064078    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa9b9d1-773d-4b96-bf45-1674c54c3656" path="/var/lib/kubelet/pods/1fa9b9d1-773d-4b96-bf45-1674c54c3656/volumes"
Jul 21 17:56:38.099828 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.099782    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"
Jul 21 17:56:38.272303 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.272274    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:38.373243 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.373148    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:38.402898 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.402872    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-139734843209744"
Jul 21 17:56:38.402898 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.402889    2557 scope.go:117] "RemoveContainer" containerID="7fb634b119080972cf22a51417d0a5c5ecf1f68c267277bf715c26374d91c9e8"
Jul 21 17:56:38.450991 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:38.450971    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"]
Jul 21 17:56:38.453690 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:56:38.453666    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7d270a_48fa_4938_8a78_2667cd49b334.slice/crio-5b8fa4e7956a8d6fbb3e39e7887de803e60cda8ca1c2abb63360949505d11b3f WatchSource:0}: Error finding container 5b8fa4e7956a8d6fbb3e39e7887de803e60cda8ca1c2abb63360949505d11b3f: Status 404 returned error can't find the container with id 5b8fa4e7956a8d6fbb3e39e7887de803e60cda8ca1c2abb63360949505d11b3f
Jul 21 17:56:39.410651 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:39.410615    2557 generic.go:356] "Generic (PLEG): container finished" podID="8e7d270a-48fa-4938-8a78-2667cd49b334" containerID="cbb3d0a59bf5fe209b83e9aaf68711b34ac6370269a10f695329980a56c73b1d" exitCode=0
Jul 21 17:56:39.411108 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:39.410707    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch" event={"ID":"8e7d270a-48fa-4938-8a78-2667cd49b334","Type":"ContainerDied","Data":"cbb3d0a59bf5fe209b83e9aaf68711b34ac6370269a10f695329980a56c73b1d"}
Jul 21 17:56:39.411108 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:39.410764    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch" event={"ID":"8e7d270a-48fa-4938-8a78-2667cd49b334","Type":"ContainerStarted","Data":"5b8fa4e7956a8d6fbb3e39e7887de803e60cda8ca1c2abb63360949505d11b3f"}
Jul 21 17:56:40.575342 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:40.575314    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"
Jul 21 17:56:40.749378 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:40.749291    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7d270a-48fa-4938-8a78-2667cd49b334-maas-api-service-ca\") pod \"8e7d270a-48fa-4938-8a78-2667cd49b334\" (UID: \"8e7d270a-48fa-4938-8a78-2667cd49b334\") "
Jul 21 17:56:40.749678 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:40.749652    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e7d270a-48fa-4938-8a78-2667cd49b334-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e7d270a-48fa-4938-8a78-2667cd49b334" (UID: "8e7d270a-48fa-4938-8a78-2667cd49b334"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:56:40.850937 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:40.850901    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7d270a-48fa-4938-8a78-2667cd49b334-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:56:41.426059 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:41.426023    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"
Jul 21 17:56:41.426254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:41.426053    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch" event={"ID":"8e7d270a-48fa-4938-8a78-2667cd49b334","Type":"ContainerDied","Data":"5b8fa4e7956a8d6fbb3e39e7887de803e60cda8ca1c2abb63360949505d11b3f"}
Jul 21 17:56:41.426254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:41.426111    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b8fa4e7956a8d6fbb3e39e7887de803e60cda8ca1c2abb63360949505d11b3f"
Jul 21 17:56:48.243831 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:48.243778    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:51.612243 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:51.612210    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:56:52.854676 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:52.854639    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:52.867187 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:52.867160    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"]
Jul 21 17:56:52.869879 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:52.869857    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-43413b-nbjch"]
Jul 21 17:56:53.293131 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:53.293101    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:54.063818 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:54.063774    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e7d270a-48fa-4938-8a78-2667cd49b334" path="/var/lib/kubelet/pods/8e7d270a-48fa-4938-8a78-2667cd49b334/volumes"
Jul 21 17:56:59.383634 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:59.383596    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:59.485125 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:59.485089    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:59.678515 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:59.678423    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:56:59.931651 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:56:59.931569    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:00.063287 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.063258    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"]
Jul 21 17:57:00.063904 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.063883    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e7d270a-48fa-4938-8a78-2667cd49b334" containerName="revoke-keys"
Jul 21 17:57:00.063985 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.063907    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e7d270a-48fa-4938-8a78-2667cd49b334" containerName="revoke-keys"
Jul 21 17:57:00.064089 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.064049    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e7d270a-48fa-4938-8a78-2667cd49b334" containerName="revoke-keys"
Jul 21 17:57:00.067559 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.067538    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"
Jul 21 17:57:00.067688 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.067591    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"]
Jul 21 17:57:00.070465 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.070312    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:57:00.070465 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.070337    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:57:00.133267 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.133236    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/823a40b1-35a2-48b3-b619-513e6aa71fe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx\" (UID: \"823a40b1-35a2-48b3-b619-513e6aa71fe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"
Jul 21 17:57:00.234353 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.234261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/823a40b1-35a2-48b3-b619-513e6aa71fe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx\" (UID: \"823a40b1-35a2-48b3-b619-513e6aa71fe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"
Jul 21 17:57:00.234911 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.234893    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/823a40b1-35a2-48b3-b619-513e6aa71fe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx\" (UID: \"823a40b1-35a2-48b3-b619-513e6aa71fe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"
Jul 21 17:57:00.379362 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.379329    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"
Jul 21 17:57:00.520250 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.520210    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"]
Jul 21 17:57:00.521094 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:57:00.521065    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823a40b1_35a2_48b3_b619_513e6aa71fe3.slice/crio-11fc50f6c68cb12a53699f6fcc59aee11cb18bab7fcf7b12ee4e2610bdbeca67 WatchSource:0}: Error finding container 11fc50f6c68cb12a53699f6fcc59aee11cb18bab7fcf7b12ee4e2610bdbeca67: Status 404 returned error can't find the container with id 11fc50f6c68cb12a53699f6fcc59aee11cb18bab7fcf7b12ee4e2610bdbeca67
Jul 21 17:57:00.547943 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.547917    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx" event={"ID":"823a40b1-35a2-48b3-b619-513e6aa71fe3","Type":"ContainerStarted","Data":"11fc50f6c68cb12a53699f6fcc59aee11cb18bab7fcf7b12ee4e2610bdbeca67"}
Jul 21 17:57:00.665180 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.665121    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:00.763425 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:00.763398    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:01.555589 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:01.555550    2557 generic.go:356] "Generic (PLEG): container finished" podID="823a40b1-35a2-48b3-b619-513e6aa71fe3" containerID="475cba19f6dd81280d960c5b89ac3ccdd53ed594745447843a14e6639e6181f0" exitCode=0
Jul 21 17:57:01.556023 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:01.555593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx" event={"ID":"823a40b1-35a2-48b3-b619-513e6aa71fe3","Type":"ContainerDied","Data":"475cba19f6dd81280d960c5b89ac3ccdd53ed594745447843a14e6639e6181f0"}
Jul 21 17:57:02.708701 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:02.708675    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"
Jul 21 17:57:02.760932 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:02.760908    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/823a40b1-35a2-48b3-b619-513e6aa71fe3-maas-api-service-ca\") pod \"823a40b1-35a2-48b3-b619-513e6aa71fe3\" (UID: \"823a40b1-35a2-48b3-b619-513e6aa71fe3\") "
Jul 21 17:57:02.761223 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:02.761202    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/823a40b1-35a2-48b3-b619-513e6aa71fe3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "823a40b1-35a2-48b3-b619-513e6aa71fe3" (UID: "823a40b1-35a2-48b3-b619-513e6aa71fe3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:57:02.861599 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:02.861532    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/823a40b1-35a2-48b3-b619-513e6aa71fe3-maas-api-service-ca\") on node \"ip-10-0-128-12.ec2.internal\" DevicePath \"\""
Jul 21 17:57:03.568947 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:03.568914    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx" event={"ID":"823a40b1-35a2-48b3-b619-513e6aa71fe3","Type":"ContainerDied","Data":"11fc50f6c68cb12a53699f6fcc59aee11cb18bab7fcf7b12ee4e2610bdbeca67"}
Jul 21 17:57:03.568947 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:03.568940    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"
Jul 21 17:57:03.569163 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:03.568965    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11fc50f6c68cb12a53699f6fcc59aee11cb18bab7fcf7b12ee4e2610bdbeca67"
Jul 21 17:57:10.465309 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:10.465273    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:13.015825 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:13.010601    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9cts"]
Jul 21 17:57:15.127506 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:15.127470    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:15.133139 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:15.133110    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"]
Jul 21 17:57:15.136513 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:15.136489    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-046b27-9sbbx"]
Jul 21 17:57:15.535089 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:15.535059    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:16.063123 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:16.063088    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="823a40b1-35a2-48b3-b619-513e6aa71fe3" path="/var/lib/kubelet/pods/823a40b1-35a2-48b3-b619-513e6aa71fe3/volumes"
Jul 21 17:57:18.491531 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:18.491500    2557 scope.go:117] "RemoveContainer" containerID="b32065f8338cc8acc3675be72c545cda5b66032b7e92fb183ca76c9655c8f33d"
Jul 21 17:57:21.494730 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:21.494695    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:21.591920 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:21.591893    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:21.776851 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:21.776790    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:21.992168 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:21.992137    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:22.431348 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:22.431319    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5784477f59-vqq58_cbf87cf9-9d7a-486c-8528-ef14353fa175/authorino/0.log"
Jul 21 17:57:27.968396 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:27.968365    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ntshb_250df1ec-526e-4b29-92eb-e7f313b98e78/manager/0.log"
Jul 21 17:57:28.096306 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:28.096273    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kbcc9_03ad371c-9de4-4517-b8fb-bac1e92b1cf6/manager/0.log"
Jul 21 17:57:28.491153 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:28.491123    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-grs4z_a5d0173d-18d7-4c2a-8fd4-d4d5cacea268/manager/0.log"
Jul 21 17:57:28.733125 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:28.733095    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b498688-jbqh9_c9ae3577-b618-4eaa-abe2-2121f4f72b93/copy-manifests/0.log"
Jul 21 17:57:28.739312 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:28.739293    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b498688-jbqh9_c9ae3577-b618-4eaa-abe2-2121f4f72b93/manager/0.log"
Jul 21 17:57:29.474660 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:29.474631    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744265-vmcwj_90e1218a-e083-4c10-8cb7-bbc08c587e87/cleanup/0.log"
Jul 21 17:57:30.423010 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.422985    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl_14db8b79-3e88-4828-b6ed-d1b7290daf1a/extract/0.log"
Jul 21 17:57:30.429373 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.429356    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl_14db8b79-3e88-4828-b6ed-d1b7290daf1a/util/0.log"
Jul 21 17:57:30.437352 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.437330    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl_14db8b79-3e88-4828-b6ed-d1b7290daf1a/pull/0.log"
Jul 21 17:57:30.558703 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.558679    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6_086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5/util/0.log"
Jul 21 17:57:30.565100 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.565081    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6_086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5/pull/0.log"
Jul 21 17:57:30.571491 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.571474    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6_086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5/extract/0.log"
Jul 21 17:57:30.690430 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.690356    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v_f33210c4-7c8e-424c-aebc-61810093ea66/util/0.log"
Jul 21 17:57:30.696999 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.696963    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v_f33210c4-7c8e-424c-aebc-61810093ea66/pull/0.log"
Jul 21 17:57:30.703338 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.703321    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v_f33210c4-7c8e-424c-aebc-61810093ea66/extract/0.log"
Jul 21 17:57:30.822294 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.822266    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds_9818638a-1ec7-40a9-a647-ad2c1effe2a5/pull/0.log"
Jul 21 17:57:30.829270 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.829232    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds_9818638a-1ec7-40a9-a647-ad2c1effe2a5/extract/0.log"
Jul 21 17:57:30.835677 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.835657    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds_9818638a-1ec7-40a9-a647-ad2c1effe2a5/util/0.log"
Jul 21 17:57:30.959541 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:30.959459    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5784477f59-vqq58_cbf87cf9-9d7a-486c-8528-ef14353fa175/authorino/0.log"
Jul 21 17:57:31.077254 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:31.077228    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9js2j_e5bb7f5d-4188-4360-8c19-d7e665975825/manager/0.log"
Jul 21 17:57:31.195403 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:31.195372    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c99nf_7357fbe9-fbf5-4494-9d06-e94f593a9447/manager/0.log"
Jul 21 17:57:31.434403 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:31.434365    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rgd48_ec5b0357-6b99-4c0f-a59d-9f9a7c06c678/registry-server/0.log"
Jul 21 17:57:31.688204 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:31.688129    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t9cts_f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6/limitador/0.log"
Jul 21 17:57:31.811180 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:31.811153    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-df9g5_510284b6-8834-4737-a2a3-d17a341e630c/manager/0.log"
Jul 21 17:57:32.545132 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:32.545101    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589694fdcc-g598v_a5b33372-5b1a-4b1f-84c5-a0b859f57c0f/kube-auth-proxy/0.log"
Jul 21 17:57:32.674477 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:32.674449    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vkrff_d8d8c43d-a4a0-43bb-a514-4382ef395cf5/istio-proxy/1.log"
Jul 21 17:57:32.919983 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:32.919905    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k2gxw_ee98c371-e852-4a8d-9e18-e22379e14e9c/payload-processing/0.log"
Jul 21 17:57:33.042753 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:33.042727    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-845cf5c4d4-jccm6_def9337f-f934-459d-8b37-48fefebb839b/router/0.log"
Jul 21 17:57:33.508507 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:33.508480    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qql4p_e383e41d-135e-4d11-ab1c-51acfc0d7615/main/0.log"
Jul 21 17:57:33.738813 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:33.738783    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs5pxn_42835c3b-9516-492f-943d-3ffd100757e8/main/0.log"
Jul 21 17:57:39.371577 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.371506    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rjthx/must-gather-s9sx2"]
Jul 21 17:57:39.372130 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.372110    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="823a40b1-35a2-48b3-b619-513e6aa71fe3" containerName="revoke-keys"
Jul 21 17:57:39.372130 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.372129    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="823a40b1-35a2-48b3-b619-513e6aa71fe3" containerName="revoke-keys"
Jul 21 17:57:39.372271 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.372206    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="823a40b1-35a2-48b3-b619-513e6aa71fe3" containerName="revoke-keys"
Jul 21 17:57:39.377547 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.377520    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjthx/must-gather-s9sx2"
Jul 21 17:57:39.382366 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.382334    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjthx\"/\"kube-root-ca.crt\""
Jul 21 17:57:39.382523 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.382497    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjthx\"/\"openshift-service-ca.crt\""
Jul 21 17:57:39.382696 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.382523    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rjthx\"/\"default-dockercfg-d9sl7\""
Jul 21 17:57:39.387065 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.387039    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:39.387519 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.387327    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjthx/must-gather-s9sx2"]
Jul 21 17:57:39.520080 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.520047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/51cfee07-356b-4e2e-aeb8-7e8eccff7782-must-gather-output\") pod \"must-gather-s9sx2\" (UID: \"51cfee07-356b-4e2e-aeb8-7e8eccff7782\") " pod="openshift-must-gather-rjthx/must-gather-s9sx2"
Jul 21 17:57:39.520266 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.520122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbqht\" (UniqueName: \"kubernetes.io/projected/51cfee07-356b-4e2e-aeb8-7e8eccff7782-kube-api-access-pbqht\") pod \"must-gather-s9sx2\" (UID: \"51cfee07-356b-4e2e-aeb8-7e8eccff7782\") " pod="openshift-must-gather-rjthx/must-gather-s9sx2"
Jul 21 17:57:39.620664 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.620638    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbqht\" (UniqueName: \"kubernetes.io/projected/51cfee07-356b-4e2e-aeb8-7e8eccff7782-kube-api-access-pbqht\") pod \"must-gather-s9sx2\" (UID: \"51cfee07-356b-4e2e-aeb8-7e8eccff7782\") " pod="openshift-must-gather-rjthx/must-gather-s9sx2"
Jul 21 17:57:39.620890 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.620727    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/51cfee07-356b-4e2e-aeb8-7e8eccff7782-must-gather-output\") pod \"must-gather-s9sx2\" (UID: \"51cfee07-356b-4e2e-aeb8-7e8eccff7782\") " pod="openshift-must-gather-rjthx/must-gather-s9sx2"
Jul 21 17:57:39.621083 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.621065    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/51cfee07-356b-4e2e-aeb8-7e8eccff7782-must-gather-output\") pod \"must-gather-s9sx2\" (UID: \"51cfee07-356b-4e2e-aeb8-7e8eccff7782\") " pod="openshift-must-gather-rjthx/must-gather-s9sx2"
Jul 21 17:57:39.629541 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.629490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbqht\" (UniqueName: \"kubernetes.io/projected/51cfee07-356b-4e2e-aeb8-7e8eccff7782-kube-api-access-pbqht\") pod \"must-gather-s9sx2\" (UID: \"51cfee07-356b-4e2e-aeb8-7e8eccff7782\") " pod="openshift-must-gather-rjthx/must-gather-s9sx2"
Jul 21 17:57:39.690263 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:39.690239    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjthx/must-gather-s9sx2"
Jul 21 17:57:40.033440 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:40.033417    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjthx/must-gather-s9sx2"]
Jul 21 17:57:40.035655 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:57:40.035626    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51cfee07_356b_4e2e_aeb8_7e8eccff7782.slice/crio-4a1fecadb2656049189d41f8a52e04e2a79aa2b71fe51b5d8d3122b5e5e41dd7 WatchSource:0}: Error finding container 4a1fecadb2656049189d41f8a52e04e2a79aa2b71fe51b5d8d3122b5e5e41dd7: Status 404 returned error can't find the container with id 4a1fecadb2656049189d41f8a52e04e2a79aa2b71fe51b5d8d3122b5e5e41dd7
Jul 21 17:57:40.798919 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:40.798885    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjthx/must-gather-s9sx2" event={"ID":"51cfee07-356b-4e2e-aeb8-7e8eccff7782","Type":"ContainerStarted","Data":"4a1fecadb2656049189d41f8a52e04e2a79aa2b71fe51b5d8d3122b5e5e41dd7"}
Jul 21 17:57:41.350415 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:41.350324    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log" limit=1024
Jul 21 17:57:41.812688 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:41.812644    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjthx/must-gather-s9sx2" event={"ID":"51cfee07-356b-4e2e-aeb8-7e8eccff7782","Type":"ContainerStarted","Data":"721e9a7fbd7d15a34c91ec73a3138b18e51ef43ec2c03c309732ec362aebc5f8"}
Jul 21 17:57:41.813200 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:41.812721    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjthx/must-gather-s9sx2" event={"ID":"51cfee07-356b-4e2e-aeb8-7e8eccff7782","Type":"ContainerStarted","Data":"abf1a9775939454c469e621df55efa44709e2aee8097c767660f791f6290b7a4"}
Jul 21 17:57:41.832763 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:41.832703    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rjthx/must-gather-s9sx2" podStartSLOduration=1.8044728220000001 podStartE2EDuration="2.832679884s" totalImagesPullingTime="1.028207062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:57:41.829454897 +0000 UTC m=+2964.374771115" watchObservedRunningTime="2026-07-21 17:57:41.832679884 +0000 UTC m=+2964.377996101"
Jul 21 17:57:42.740343 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:42.740309    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qgrwt_2f972653-5525-4d5e-9224-9909fce9fd2b/global-pull-secret-syncer/0.log"
Jul 21 17:57:42.930424 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:42.930391    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-25s6x_93368af1-63b0-4112-ae5a-b6e20d16e7c4/konnectivity-agent/0.log"
Jul 21 17:57:43.106337 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:43.106305    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-12.ec2.internal_76884c21cf54c80d0a792e713b054514/haproxy/0.log"
Jul 21 17:57:47.599908 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.599846    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl_14db8b79-3e88-4828-b6ed-d1b7290daf1a/extract/0.log"
Jul 21 17:57:47.625676 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.625641    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl_14db8b79-3e88-4828-b6ed-d1b7290daf1a/util/0.log"
Jul 21 17:57:47.649453 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.649384    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759st9hl_14db8b79-3e88-4828-b6ed-d1b7290daf1a/pull/0.log"
Jul 21 17:57:47.696672 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.696647    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6_086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5/extract/0.log"
Jul 21 17:57:47.722905 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.722855    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6_086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5/util/0.log"
Jul 21 17:57:47.748350 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.748258    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p4lx6_086d0064-7137-4e1c-8bb3-e9ab6fb3d7a5/pull/0.log"
Jul 21 17:57:47.774849 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.774825    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v_f33210c4-7c8e-424c-aebc-61810093ea66/extract/0.log"
Jul 21 17:57:47.796812 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.796760    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v_f33210c4-7c8e-424c-aebc-61810093ea66/util/0.log"
Jul 21 17:57:47.817999 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.817970    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9f5v_f33210c4-7c8e-424c-aebc-61810093ea66/pull/0.log"
Jul 21 17:57:47.849445 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.849420    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds_9818638a-1ec7-40a9-a647-ad2c1effe2a5/extract/0.log"
Jul 21 17:57:47.874872 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.874774    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds_9818638a-1ec7-40a9-a647-ad2c1effe2a5/util/0.log"
Jul 21 17:57:47.898636 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:47.898585    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bzds_9818638a-1ec7-40a9-a647-ad2c1effe2a5/pull/0.log"
Jul 21 17:57:48.388592 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:48.388443    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5784477f59-vqq58_cbf87cf9-9d7a-486c-8528-ef14353fa175/authorino/0.log"
Jul 21 17:57:48.429916 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:48.429887    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9js2j_e5bb7f5d-4188-4360-8c19-d7e665975825/manager/0.log"
Jul 21 17:57:48.459177 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:48.459144    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c99nf_7357fbe9-fbf5-4494-9d06-e94f593a9447/manager/0.log"
Jul 21 17:57:48.541248 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:48.539741    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rgd48_ec5b0357-6b99-4c0f-a59d-9f9a7c06c678/registry-server/0.log"
Jul 21 17:57:48.821051 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:48.821029    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t9cts_f4c99ebf-ead7-4ac6-895c-5fb0417fbdb6/limitador/0.log"
Jul 21 17:57:48.913297 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:48.913263    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-df9g5_510284b6-8834-4737-a2a3-d17a341e630c/manager/0.log"
Jul 21 17:57:50.607859 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.607827    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52e85ff2-7bf2-48fa-bded-192ec43001b7/alertmanager/0.log"
Jul 21 17:57:50.640646 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.640609    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52e85ff2-7bf2-48fa-bded-192ec43001b7/config-reloader/0.log"
Jul 21 17:57:50.674367 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.674342    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52e85ff2-7bf2-48fa-bded-192ec43001b7/kube-rbac-proxy-web/0.log"
Jul 21 17:57:50.703905 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.703869    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52e85ff2-7bf2-48fa-bded-192ec43001b7/kube-rbac-proxy/0.log"
Jul 21 17:57:50.731224 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.731192    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52e85ff2-7bf2-48fa-bded-192ec43001b7/kube-rbac-proxy-metric/0.log"
Jul 21 17:57:50.757285 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.757256    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52e85ff2-7bf2-48fa-bded-192ec43001b7/prom-label-proxy/0.log"
Jul 21 17:57:50.782452 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.782392    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52e85ff2-7bf2-48fa-bded-192ec43001b7/init-config-reloader/0.log"
Jul 21 17:57:50.826697 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.826661    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-98dq9_8bea0c27-d9f7-4143-955b-7c983b87bb83/cluster-monitoring-operator/0.log"
Jul 21 17:57:50.999920 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:50.999811    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6slht_3dfe3f99-704d-446a-9c96-2ac817ac8862/node-exporter/0.log"
Jul 21 17:57:51.023785 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.023758    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6slht_3dfe3f99-704d-446a-9c96-2ac817ac8862/kube-rbac-proxy/0.log"
Jul 21 17:57:51.052992 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.052964    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6slht_3dfe3f99-704d-446a-9c96-2ac817ac8862/init-textfile/0.log"
Jul 21 17:57:51.222088 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.222052    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2n8gd_2d727275-ef70-410c-a2b8-fe2a8e33b314/kube-rbac-proxy-main/0.log"
Jul 21 17:57:51.243162 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.243135    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2n8gd_2d727275-ef70-410c-a2b8-fe2a8e33b314/kube-rbac-proxy-self/0.log"
Jul 21 17:57:51.265017 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.264989    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2n8gd_2d727275-ef70-410c-a2b8-fe2a8e33b314/openshift-state-metrics/0.log"
Jul 21 17:57:51.539425 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.539334    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86c85674fb-w42w8_7cec437a-5761-4a17-a410-c5781d307c82/telemeter-client/0.log"
Jul 21 17:57:51.561863 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.561828    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86c85674fb-w42w8_7cec437a-5761-4a17-a410-c5781d307c82/reload/0.log"
Jul 21 17:57:51.604616 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.604589    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86c85674fb-w42w8_7cec437a-5761-4a17-a410-c5781d307c82/kube-rbac-proxy/0.log"
Jul 21 17:57:51.639251 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.639218    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64df46c956-w4vxp_caf085d5-373d-4a00-a157-ec5894037b19/thanos-query/0.log"
Jul 21 17:57:51.666333 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.666299    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64df46c956-w4vxp_caf085d5-373d-4a00-a157-ec5894037b19/kube-rbac-proxy-web/0.log"
Jul 21 17:57:51.689818 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.689777    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64df46c956-w4vxp_caf085d5-373d-4a00-a157-ec5894037b19/kube-rbac-proxy/0.log"
Jul 21 17:57:51.717010 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.716984    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64df46c956-w4vxp_caf085d5-373d-4a00-a157-ec5894037b19/prom-label-proxy/0.log"
Jul 21 17:57:51.746403 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.746380    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64df46c956-w4vxp_caf085d5-373d-4a00-a157-ec5894037b19/kube-rbac-proxy-rules/0.log"
Jul 21 17:57:51.780133 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:51.780105    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64df46c956-w4vxp_caf085d5-373d-4a00-a157-ec5894037b19/kube-rbac-proxy-metrics/0.log"
Jul 21 17:57:52.673402 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.673367    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"]
Jul 21 17:57:52.682202 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.682167    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.684289 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.684263    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"]
Jul 21 17:57:52.784521 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.784485    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-podres\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.785674 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.785648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grdp7\" (UniqueName: \"kubernetes.io/projected/5e912f5a-c095-47c0-89e0-f0c5016ee39c-kube-api-access-grdp7\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.785944 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.785926    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-lib-modules\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.786118 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.786100    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-sys\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.786247 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.786234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-proc\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.887817 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.887758    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-podres\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.888011 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.887837    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grdp7\" (UniqueName: \"kubernetes.io/projected/5e912f5a-c095-47c0-89e0-f0c5016ee39c-kube-api-access-grdp7\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.888011 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.887995    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-podres\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.888140 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.888099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-lib-modules\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.888207 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.888141    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-sys\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.888207 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.888165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-proc\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.888317 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.888288    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-proc\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.888703 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.888673    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-sys\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.888789 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.888776    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e912f5a-c095-47c0-89e0-f0c5016ee39c-lib-modules\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.899136 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.899104    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grdp7\" (UniqueName: \"kubernetes.io/projected/5e912f5a-c095-47c0-89e0-f0c5016ee39c-kube-api-access-grdp7\") pod \"perf-node-gather-daemonset-v9lxp\" (UID: \"5e912f5a-c095-47c0-89e0-f0c5016ee39c\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:52.960134 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:52.960057    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-nqshv_dc70ee41-4830-4a4b-aa7f-c7ec6c9f1386/networking-console-plugin/0.log"
Jul 21 17:57:53.013585 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:53.013552    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:53.211232 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:53.211142    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"]
Jul 21 17:57:53.211723 ip-10-0-128-12 kubenswrapper[2557]: W0721 17:57:53.211697    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5e912f5a_c095_47c0_89e0_f0c5016ee39c.slice/crio-e3730fae676206d65e00af47bcf3290d18f75858d90fd6f8348a48209ea0e12f WatchSource:0}: Error finding container e3730fae676206d65e00af47bcf3290d18f75858d90fd6f8348a48209ea0e12f: Status 404 returned error can't find the container with id e3730fae676206d65e00af47bcf3290d18f75858d90fd6f8348a48209ea0e12f
Jul 21 17:57:53.582298 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:53.582272    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/2.log"
Jul 21 17:57:53.589190 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:53.589160    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q6qqz_e8d01263-b1fa-4a45-9057-8306bdc979bf/console-operator/3.log"
Jul 21 17:57:53.929348 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:53.929309    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp" event={"ID":"5e912f5a-c095-47c0-89e0-f0c5016ee39c","Type":"ContainerStarted","Data":"bf8047df7d9607534b2ce00922b7b8730cd29987222dc571a1feec19552a0fc9"}
Jul 21 17:57:53.929829 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:53.929378    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp" event={"ID":"5e912f5a-c095-47c0-89e0-f0c5016ee39c","Type":"ContainerStarted","Data":"e3730fae676206d65e00af47bcf3290d18f75858d90fd6f8348a48209ea0e12f"}
Jul 21 17:57:53.930279 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:53.930249    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:57:53.948539 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:53.948474    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp" podStartSLOduration=1.948453612 podStartE2EDuration="1.948453612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:57:53.946370211 +0000 UTC m=+2976.491686429" watchObservedRunningTime="2026-07-21 17:57:53.948453612 +0000 UTC m=+2976.493769810"
Jul 21 17:57:54.049379 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:54.049350    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f9b57567d-fn7kb_cd31a091-7984-4f50-8898-8cfc030e5366/console/0.log"
Jul 21 17:57:54.091703 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:54.091670    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-7rvqh_a268cceb-162a-4e0f-8f07-5c24e5852c0b/download-server/0.log"
Jul 21 17:57:54.669152 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:54.669105    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-plghv_06f7649a-5707-4b5f-a85e-905eb0acc197/volume-data-source-validator/0.log"
Jul 21 17:57:55.696139 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:55.696114    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98jqh_5b27e994-0051-495a-b48a-5120b8015a64/dns/0.log"
Jul 21 17:57:55.721174 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:55.721138    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98jqh_5b27e994-0051-495a-b48a-5120b8015a64/kube-rbac-proxy/0.log"
Jul 21 17:57:55.858076 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:55.858041    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcjjl_a071c9e9-5ae5-4311-891e-c82a81a2c399/dns-node-resolver/0.log"
Jul 21 17:57:56.470015 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:56.469990    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q6ndw_246c4c15-60a5-4442-bb07-779b13563b24/node-ca/0.log"
Jul 21 17:57:57.683887 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:57.683857    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589694fdcc-g598v_a5b33372-5b1a-4b1f-84c5-a0b859f57c0f/kube-auth-proxy/0.log"
Jul 21 17:57:57.713201 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:57.713171    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vkrff_d8d8c43d-a4a0-43bb-a514-4382ef395cf5/istio-proxy/0.log"
Jul 21 17:57:57.746926 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:57.746897    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vkrff_d8d8c43d-a4a0-43bb-a514-4382ef395cf5/istio-proxy/1.log"
Jul 21 17:57:57.811497 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:57.811467    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k2gxw_ee98c371-e852-4a8d-9e18-e22379e14e9c/payload-processing/0.log"
Jul 21 17:57:57.834893 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:57.834857    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-845cf5c4d4-jccm6_def9337f-f934-459d-8b37-48fefebb839b/router/0.log"
Jul 21 17:57:58.525132 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:58.525102    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8m7dl_d2e057ac-8523-4d53-9cb8-ed807e1e5194/serve-healthcheck-canary/0.log"
Jul 21 17:57:59.052308 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:59.052020    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xjsbs_5d8a8927-d3b5-41f8-8007-bf6a84be1b2b/insights-operator/0.log"
Jul 21 17:57:59.053765 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:59.053741    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xjsbs_5d8a8927-d3b5-41f8-8007-bf6a84be1b2b/insights-operator/1.log"
Jul 21 17:57:59.220884 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:59.220856    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mpphq_89f1fd8f-7f73-4f5d-9a77-649051dca787/kube-rbac-proxy/0.log"
Jul 21 17:57:59.246151 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:59.246126    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mpphq_89f1fd8f-7f73-4f5d-9a77-649051dca787/exporter/0.log"
Jul 21 17:57:59.268884 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:57:59.268857    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mpphq_89f1fd8f-7f73-4f5d-9a77-649051dca787/extractor/0.log"
Jul 21 17:58:00.959075 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:00.959049    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-v9lxp"
Jul 21 17:58:01.415345 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:01.415318    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ntshb_250df1ec-526e-4b29-92eb-e7f313b98e78/manager/0.log"
Jul 21 17:58:01.642191 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:01.642156    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kbcc9_03ad371c-9de4-4517-b8fb-bac1e92b1cf6/manager/0.log"
Jul 21 17:58:01.860103 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:01.860076    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-grs4z_a5d0173d-18d7-4c2a-8fd4-d4d5cacea268/manager/0.log"
Jul 21 17:58:01.941475 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:01.941446    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b498688-jbqh9_c9ae3577-b618-4eaa-abe2-2121f4f72b93/manager/0.log"
Jul 21 17:58:01.965906 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:01.965881    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b498688-jbqh9_c9ae3577-b618-4eaa-abe2-2121f4f72b93/copy-manifests/0.log"
Jul 21 17:58:03.367317 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:03.367282    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589694fdcc-g598v_a5b33372-5b1a-4b1f-84c5-a0b859f57c0f/kube-auth-proxy/0.log"
Jul 21 17:58:03.392056 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:03.392024    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vkrff_d8d8c43d-a4a0-43bb-a514-4382ef395cf5/istio-proxy/0.log"
Jul 21 17:58:03.430923 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:03.430890    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vkrff_d8d8c43d-a4a0-43bb-a514-4382ef395cf5/istio-proxy/1.log"
Jul 21 17:58:03.475578 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:03.475549    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k2gxw_ee98c371-e852-4a8d-9e18-e22379e14e9c/payload-processing/0.log"
Jul 21 17:58:03.487865 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:03.487843    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-845cf5c4d4-jccm6_def9337f-f934-459d-8b37-48fefebb839b/router/0.log"
Jul 21 17:58:03.498363 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:03.498327    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ncvcp_fc4cb18c-4c3d-4eba-ab51-df9ab3e0e898/openshift-lws-operator/0.log"
Jul 21 17:58:05.044741 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:05.044705    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589694fdcc-g598v_a5b33372-5b1a-4b1f-84c5-a0b859f57c0f/kube-auth-proxy/0.log"
Jul 21 17:58:05.071488 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:05.071048    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vkrff_d8d8c43d-a4a0-43bb-a514-4382ef395cf5/istio-proxy/0.log"
Jul 21 17:58:05.107697 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:05.107668    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vkrff_d8d8c43d-a4a0-43bb-a514-4382ef395cf5/istio-proxy/1.log"
Jul 21 17:58:05.152735 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:05.152694    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k2gxw_ee98c371-e852-4a8d-9e18-e22379e14e9c/payload-processing/0.log"
Jul 21 17:58:05.169201 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:05.169173    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-845cf5c4d4-jccm6_def9337f-f934-459d-8b37-48fefebb839b/router/0.log"
Jul 21 17:58:08.988572 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:08.988535    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-h8zcm_ec1c3e14-09d1-45aa-9a91-617d9ed3a976/kube-storage-version-migrator-operator/1.log"
Jul 21 17:58:08.989461 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:08.989440    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-h8zcm_ec1c3e14-09d1-45aa-9a91-617d9ed3a976/kube-storage-version-migrator-operator/0.log"
Jul 21 17:58:10.196141 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:10.196110    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5vrp5_3e406a77-f8af-4928-ad04-9cb21b97185e/kube-multus/0.log"
Jul 21 17:58:10.448621 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:10.448552    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgr88_3b83efff-645b-49a3-a4de-1097a9f5594b/kube-multus-additional-cni-plugins/0.log"
Jul 21 17:58:10.487553 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:10.487527    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgr88_3b83efff-645b-49a3-a4de-1097a9f5594b/egress-router-binary-copy/0.log"
Jul 21 17:58:10.513792 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:10.513766    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgr88_3b83efff-645b-49a3-a4de-1097a9f5594b/cni-plugins/0.log"
Jul 21 17:58:10.539911 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:10.539887    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgr88_3b83efff-645b-49a3-a4de-1097a9f5594b/bond-cni-plugin/0.log"
Jul 21 17:58:10.566120 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:10.566095    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgr88_3b83efff-645b-49a3-a4de-1097a9f5594b/routeoverride-cni/0.log"
Jul 21 17:58:10.612108 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:10.612086    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgr88_3b83efff-645b-49a3-a4de-1097a9f5594b/whereabouts-cni-bincopy/0.log"
Jul 21 17:58:10.643972 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:10.643951    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgr88_3b83efff-645b-49a3-a4de-1097a9f5594b/whereabouts-cni/0.log"
Jul 21 17:58:11.081258 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:11.081221    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rlz7d_3f8bef54-e3ac-4056-9f92-6a0dd382d2c7/network-metrics-daemon/0.log"
Jul 21 17:58:11.106038 ip-10-0-128-12 kubenswrapper[2557]: I0721 17:58:11.106017    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rlz7d_3f8bef54-e3ac-4056-9f92-6a0dd382d2c7/kube-rbac-proxy/0.log"