Jul 16 22:33:37.338783 ip-10-0-134-116 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 22:33:37.733544 ip-10-0-134-116 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 22:33:37.733544 ip-10-0-134-116 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 22:33:37.733544 ip-10-0-134-116 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 22:33:37.733544 ip-10-0-134-116 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 22:33:37.733544 ip-10-0-134-116 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 22:33:37.734256 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.733608    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 22:33:37.738243 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738224    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:33:37.738243 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738242    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:33:37.738243 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738246    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738250    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738253    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738256    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738258    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738262    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738265    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738267    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738270    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738272    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738275    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738277    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738280    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738282    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738285    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738287    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738291    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738293    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738296    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738298    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:33:37.738349 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738301    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738303    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738306    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738308    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738311    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738313    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738316    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738318    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738321    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738323    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738326    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738330    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738334    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738338    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738353    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738356    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738359    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738362    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738365    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:33:37.738835 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738368    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738370    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738373    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738375    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738378    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738380    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738383    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738385    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738388    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738390    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738392    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738395    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738398    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738401    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738403    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738405    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738408    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738410    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738413    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738431    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:33:37.739287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738436    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738440    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738443    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738448    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738452    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738455    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738458    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738460    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738463    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738465    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738469    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738474    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738478    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738480    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738483    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738485    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738489    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738492    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738496    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:33:37.739822 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738499    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738502    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738504    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738507    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738510    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738512    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738515    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738517    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738520    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738522    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738525    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738529    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738531    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738534    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738536    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738539    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738542    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738545    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.738548    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:33:37.740287 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739257    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739264    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739267    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739270    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739273    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739276    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739279    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739281    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739284    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739286    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739289    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739292    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739294    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739297    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739299    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739302    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739304    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739307    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739309    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739312    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:33:37.740757 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739314    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739317    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739319    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739322    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739324    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739326    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739329    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739331    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739333    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739336    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739339    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739342    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739345    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739347    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739350    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739352    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739355    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739357    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739360    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739363    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:33:37.741246 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739365    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739368    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739371    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739373    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739375    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739378    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739380    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739383    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739385    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739387    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739390    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739392    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739395    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739397    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739399    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739401    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739406    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739409    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739413    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739435    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:33:37.741762 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739439    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739442    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739445    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739448    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739452    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739455    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739458    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739460    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739463    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739466    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739469    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739472    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739475    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739478    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739481    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739484    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739488    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739492    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739494    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:33:37.742254 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739497    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739500    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739503    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739506    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739509    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739512    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739515    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739518    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739520    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739523    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739525    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739528    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739530    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739533    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739535    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739538    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739540    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739543    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739546    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:33:37.742728 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739548    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739918    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739922    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739925    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739928    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739931    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739934    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739936    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739939    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739941    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739943    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739946    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739949    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739951    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739954    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739958    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739962    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739966    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739969    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:33:37.743270 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739972    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739975    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739979    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739981    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739984    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739986    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739989    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739991    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739994    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739996    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.739999    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740001    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740004    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740006    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740009    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740011    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740014    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740016    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740018    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740022    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:33:37.743770 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740025    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740027    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740030    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740033    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740045    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740048    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740051    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740054    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740057    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740059    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740062    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740065    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740067    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740070    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740073    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740076    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740079    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740081    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740084    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:33:37.744261 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740086    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740089    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740092    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740094    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740097    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740099    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740102    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740105    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740107    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740109    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740112    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740114    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740117    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740121    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740123    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740126    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740128    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740131    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740133    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740135    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:33:37.744795 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740138    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740140    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740143    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740145    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740148    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740150    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740152    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740155    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740157    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740160    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740162    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740165    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740167    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740172    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740174    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740177    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740179    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740182    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740184    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:33:37.745274 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740187    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740189    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740192    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740255    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740264    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740270    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740274    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740279    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740282    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740286    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740291    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740294    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740297    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740301    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740304    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740307    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740310    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740313    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740315    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740318    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740321    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740325    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740328    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 22:33:37.745771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740331    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740334    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740337    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740341    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740344    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740347    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740350    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740353    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740356    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740359    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740362    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740365    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740368    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740373    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740375    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740378    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740381    2558 flags.go:64] FLAG: --enable-server="true"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740384    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740389    2558 flags.go:64] FLAG: --event-burst="100"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740392    2558 flags.go:64] FLAG: --event-qps="50"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740395    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740398    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740400    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740404    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 22:33:37.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740407    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740410    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740412    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740428    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740431    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740434    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740437    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740440    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740443    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740446    2558 flags.go:64] FLAG: --feature-gates=""
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740450    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740454    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740457    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740460    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740463    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740466    2558 flags.go:64] FLAG: --help="false"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740469    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-134-116.ec2.internal"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740472    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740474    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740477    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740481    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740485    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740488    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 22:33:37.746882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740491    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740494    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740497    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740501    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740504    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740506    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740509    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740512    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740515    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740518    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740520    2558 flags.go:64] FLAG: --lock-file=""
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740523    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740526    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740529    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740534    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740537    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740539    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740542    2558 flags.go:64] FLAG: --logging-format="text"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740545    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740548    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740551    2558 flags.go:64] FLAG: --manifest-url=""
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740554    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740558    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740561    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740565    2558 flags.go:64] FLAG: --max-pods="110"
Jul 16 22:33:37.747782 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740567    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740570    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740573    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740576    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740579    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740583    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740586    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740593    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740596    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740599    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740601    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740605    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740610    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740613    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740616    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740619    2558 flags.go:64] FLAG: --port="10250"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740622    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740625    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0875ffd97d75439e7"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740628    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740630    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740633    2558 flags.go:64] FLAG: --register-node="true"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740636    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740639    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740642    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 16 22:33:37.748910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740645    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740647    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740651    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740654    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740657    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740659    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740662    2558 flags.go:64] FLAG: --runonce="false"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740665    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740668    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740671    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740673    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740676    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740679    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740683    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740686    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740689    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740691    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740694    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740697    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740699    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740703    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740705    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740710    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740713    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740716    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 22:33:37.749955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740720    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740722    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740725    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740727    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740730    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740733    2558 flags.go:64] FLAG: --v="2"
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740737    2558 flags.go:64] FLAG: --version="false"
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740741    2558 flags.go:64] FLAG: --vmodule=""
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740745    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.740748    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740912    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740916    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740919    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740922    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740925    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740928    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740930    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740933    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740935    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740938    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740942    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740945    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:33:37.751028 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740948    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740950    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740953    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740955    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740958    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740960    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740964    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740966    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740969    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740971    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740974    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740976    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740978    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740981    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740984    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740986    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740989    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740994    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.740998    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:33:37.751764 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741000    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741003    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741006    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741009    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741011    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741013    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741016    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741018    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741021    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741024    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741026    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741030    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741032    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741035    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741037    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741040    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741042    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741044    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741047    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741049    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:33:37.752564 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741052    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741055    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741057    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741060    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741062    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741065    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741067    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741069    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741072    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741074    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741081    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741084    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741087    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741090    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741092    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741095    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741098    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741100    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741103    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741105    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:33:37.753245 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741108    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741110    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741113    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741117    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741119    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741123    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741126    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741129    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741131    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741134    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741136    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741141    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741144    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741147    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741149    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741152    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741155    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741158    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741161    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:33:37.753849 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741163    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741166    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741168    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741172    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741175    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741177    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741180    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741182    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.741185    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.741745    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.749478    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.749498    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.749517    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.749526    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749611    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:33:37.754309 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749619    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749624    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749629    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749633    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749638    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749643    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749648    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749652    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749656    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749660    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749665    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749669    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749674    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749678    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749684    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749689    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749693    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749697    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749701    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:33:37.754715 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749705    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749709    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749713    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749717    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749722    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749726    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749730    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749735    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749739    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749745    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749750    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749755    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749759    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749763    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749768    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749772    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749776    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749781    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749785    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749789    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:33:37.755167 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749793    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749797    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749801    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749806    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749812    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749817    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749822    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749827    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749831    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749835    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749839    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749843    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749847    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749851    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749855    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749859    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749863    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749868    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749871    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:33:37.755676 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749878    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749884    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749890    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749896    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749900    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749904    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749908    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749912    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749916    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749921    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749925    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749929    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749933    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749937    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749941    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749945    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749950    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749954    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749957    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749961    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:33:37.756166 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749965    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749969    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749972    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749977    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749981    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749985    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749989    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749993    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.749997    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750001    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750005    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750010    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750014    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750018    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750023    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750028    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750032    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750037    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750041    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:33:37.756686 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750045    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.750054    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750238    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750248    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750252    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750257    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750261    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750268    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750274    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750278    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750283    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750288    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750292    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750296    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:33:37.757146 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750300    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750304    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750308    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750312    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750316    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750320    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750324    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750329    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750333    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750337    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750341    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750345    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750349    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750354    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750358    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750363    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750368    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750372    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750377    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750381    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:33:37.757516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750385    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750389    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750393    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750397    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750402    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750406    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750410    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750437    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750442    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750447    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750451    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750455    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750459    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750463    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750467    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750472    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750476    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750480    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750484    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750489    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:33:37.758092 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750493    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750497    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750501    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750505    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750509    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750514    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750521    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750526    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750531    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750536    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750540    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750544    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750548    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750552    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750556    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750560    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750565    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750569    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750573    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750577    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:33:37.758885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750581    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750585    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750590    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750593    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750598    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750602    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750606    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750610    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750614    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750618    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750622    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750626    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750630    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750634    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750638    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750642    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750645    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750650    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750658    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750663    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:33:37.759544 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750668    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750673    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750679    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750684    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750688    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750693    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:37.750697    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.750705    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.750876    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.753569    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.754901    2558 server.go:1019] "Starting client certificate rotation"
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.755001    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.755728    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 22:33:37.760071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.757118    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 22:33:37.761335 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.761317    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 22:33:37.770892 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.770871    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 16 22:33:37.775608 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.775589    2558 log.go:25] "Validated CRI v1 image API"
Jul 16 22:33:37.776460 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.776446    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 22:33:37.781745 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.781703    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a556b89a-34d8-4cf1-9071-f09f0459b381:/dev/nvme0n1p3 ea9abc9c-a620-4eac-be2f-b2c65b20507c:/dev/nvme0n1p4]
Jul 16 22:33:37.781790 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.781746    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 22:33:37.786992 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.786887    2558 manager.go:216] Machine: {Timestamp:2026-07-16 22:33:37.785392937 +0000 UTC m=+0.329216188 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103209 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bf8fb204dd6925fb1e1d06d70db79 SystemUUID:ec2bf8fb-204d-d692-5fb1-e1d06d70db79 BootID:074face9-01d3-4886-85de-83e88e23fec5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:e6:2f:97:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:e6:2f:97:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:f5:79:58:d8:b7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 22:33:37.786992 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.786988    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 22:33:37.787099 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.787072    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 22:33:37.788777 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.788748    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 22:33:37.788915 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.788779    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 22:33:37.789618 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.789607    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 22:33:37.789657 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.789621    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 22:33:37.789657 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.789632    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 22:33:37.790117 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.790107    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 22:33:37.791076 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.791050    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 22:33:37.791357 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.791343    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 22:33:37.794158 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794144    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 22:33:37.794338 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794326    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 22:33:37.794411 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794366    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 22:33:37.794411 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794380    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 22:33:37.794411 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794401    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 22:33:37.794556 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794433    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 16 22:33:37.794556 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794447    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 22:33:37.794831 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794816    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 22:33:37.794899 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.794839    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 22:33:37.798141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.798122    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 22:33:37.799862 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.799850    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 22:33:37.799899 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.799881    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 22:33:37.801145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801134    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 22:33:37.801145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801150    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 22:33:37.801145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801156    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 22:33:37.801145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801161    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 22:33:37.801145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801170    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 22:33:37.801145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801177    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 22:33:37.801382 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801185    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 22:33:37.801382 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801191    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 22:33:37.801382 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801197    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 22:33:37.801382 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801204    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 22:33:37.801382 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801220    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 22:33:37.801382 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801226    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 22:33:37.801979 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801968    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 22:33:37.802011 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.801980    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 22:33:37.805365 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.805353    2558 server.go:1268] "Started kubelet"
Jul 16 22:33:37.808925 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.805493    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 22:33:37.809250 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.805478    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 22:33:37.809351 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.809289    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 22:33:37.809954 ip-10-0-134-116 systemd[1]: Started Kubernetes Kubelet.
Jul 16 22:33:37.813109 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.811081    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 22:33:37.813109 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.813037    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 22:33:37.813109 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.813080    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 22:33:37.813326 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.813190    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 22:33:37.813326 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.813234    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 22:33:37.815256 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.815234    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 22:33:37.818327 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.817155    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-116.ec2.internal.18c2e5ef2ce585f5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-116.ec2.internal,UID:ip-10-0-134-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-116.ec2.internal,},FirstTimestamp:2026-07-16 22:33:37.805321717 +0000 UTC m=+0.349144968,LastTimestamp:2026-07-16 22:33:37.805321717 +0000 UTC m=+0.349144968,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-116.ec2.internal,}"
Jul 16 22:33:37.819799 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.819783    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 22:33:37.819799 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.819788    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 22:33:37.820149 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.820069    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:37.820650 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.820632    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 22:33:37.820650 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.820650    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 22:33:37.820771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.820717    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 22:33:37.820771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.820746    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 22:33:37.820771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.820757    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 22:33:37.821993 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.821977    2558 factory.go:55] Registering systemd factory
Jul 16 22:33:37.822082 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.822028    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 16 22:33:37.822322 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.822308    2558 factory.go:153] Registering CRI-O factory
Jul 16 22:33:37.822397 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.822325    2558 factory.go:223] Registration of the crio container factory successfully
Jul 16 22:33:37.822397 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.822376    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 22:33:37.822500 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.822400    2558 factory.go:103] Registering Raw factory
Jul 16 22:33:37.822500 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.822433    2558 manager.go:1196] Started watching for new ooms in manager
Jul 16 22:33:37.823050 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.823037    2558 manager.go:349] Starting recovery of all containers
Jul 16 22:33:37.826208 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.826157    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 22:33:37.826332 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.826311    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 22:33:37.833207 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.833038    2558 manager.go:354] Recovery completed
Jul 16 22:33:37.837807 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.837794    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:33:37.839678 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.839658    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:33:37.839752 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.839695    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:33:37.839752 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.839707    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:33:37.840296 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.840282    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 22:33:37.840296 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.840293    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 22:33:37.840296 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.840296    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:33:37.840446 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.840309    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 22:33:37.841006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.840992    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:33:37.841063 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.841017    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:33:37.841063 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.841026    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:33:37.841649 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.841627    2558 policy_none.go:49] "None policy: Start"
Jul 16 22:33:37.841730 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.841676    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 22:33:37.841730 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.841693    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 22:33:37.841947 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.841699    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-116.ec2.internal.18c2e5ef2ef1c62c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-116.ec2.internal,UID:ip-10-0-134-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-116.ec2.internal,},FirstTimestamp:2026-07-16 22:33:37.83967902 +0000 UTC m=+0.383502273,LastTimestamp:2026-07-16 22:33:37.83967902 +0000 UTC m=+0.383502273,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-116.ec2.internal,}"
Jul 16 22:33:37.842959 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.842941    2558 policy_none.go:47] "Start"
Jul 16 22:33:37.851193 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.851113    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-116.ec2.internal.18c2e5ef2ef21be1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-116.ec2.internal,UID:ip-10-0-134-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-116.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-116.ec2.internal,},FirstTimestamp:2026-07-16 22:33:37.839700961 +0000 UTC m=+0.383524212,LastTimestamp:2026-07-16 22:33:37.839700961 +0000 UTC m=+0.383524212,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-116.ec2.internal,}"
Jul 16 22:33:37.860438 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.860311    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-116.ec2.internal.18c2e5ef2ef24435  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-116.ec2.internal,UID:ip-10-0-134-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-116.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-116.ec2.internal,},FirstTimestamp:2026-07-16 22:33:37.839711285 +0000 UTC m=+0.383534535,LastTimestamp:2026-07-16 22:33:37.839711285 +0000 UTC m=+0.383534535,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-116.ec2.internal,}"
Jul 16 22:33:37.870302 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.870224    2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-116.ec2.internal.18c2e5ef2ef1c62c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-116.ec2.internal.18c2e5ef2ef1c62c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-116.ec2.internal,UID:ip-10-0-134-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-116.ec2.internal,},FirstTimestamp:2026-07-16 22:33:37.83967902 +0000 UTC m=+0.383502273,LastTimestamp:2026-07-16 22:33:37.841005222 +0000 UTC m=+0.384828473,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-116.ec2.internal,}"
Jul 16 22:33:37.872280 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.872261    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rdgg9"
Jul 16 22:33:37.878628 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.878600    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rdgg9"
Jul 16 22:33:37.880737 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.880661    2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-116.ec2.internal.18c2e5ef2ef21be1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-116.ec2.internal.18c2e5ef2ef21be1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-116.ec2.internal,UID:ip-10-0-134-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-116.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-116.ec2.internal,},FirstTimestamp:2026-07-16 22:33:37.839700961 +0000 UTC m=+0.383524212,LastTimestamp:2026-07-16 22:33:37.841021433 +0000 UTC m=+0.384844684,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-116.ec2.internal,}"
Jul 16 22:33:37.888072 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.888059    2558 manager.go:337] "Starting Device Plugin manager"
Jul 16 22:33:37.888152 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.888091    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 22:33:37.888152 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.888101    2558 server.go:87] "Starting device plugin registration server"
Jul 16 22:33:37.888368 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.888355    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 22:33:37.888433 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.888370    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 22:33:37.888672 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.888523    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 22:33:37.888672 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.888608    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 22:33:37.888672 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.888616    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 22:33:37.889177 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.889154    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 22:33:37.889253 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.889209    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:37.988752 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.988669    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:33:37.989969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.989778    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:33:37.989969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.989808    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:33:37.989969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.989824    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:33:37.989969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.989858    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-116.ec2.internal"
Jul 16 22:33:37.998332 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:37.998315    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-116.ec2.internal"
Jul 16 22:33:37.998384 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:37.998340    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-116.ec2.internal\": node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:38.011746 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.011705    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 22:33:38.013064 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.013045    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 22:33:38.013182 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.013078    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 22:33:38.013182 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.013099    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 22:33:38.013182 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.013128    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 22:33:38.015643 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.015627    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:33:38.065938 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.065911    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:38.114032 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.113992    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"]
Jul 16 22:33:38.114136 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.114085    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:33:38.115113 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.115093    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:33:38.115223 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.115129    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:33:38.115223 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.115144    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:33:38.116465 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.116449    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:33:38.116553 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.116535    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.116605 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.116573    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:33:38.117585 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.117570    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:33:38.117686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.117584    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:33:38.117686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.117610    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:33:38.117686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.117620    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:33:38.117686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.117592    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:33:38.117686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.117680    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:33:38.118878 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.118865    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.118990 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.118892    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:33:38.120378 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.120364    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:33:38.120455 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.120388    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:33:38.120455 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.120398    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:33:38.122564 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.122549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88d6ec5757daa63bd60da436a7f378c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal\" (UID: \"c88d6ec5757daa63bd60da436a7f378c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.122564 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.122571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c12da327df9dbbcb86dad1e1fb06c721-config\") pod \"kube-apiserver-proxy-ip-10-0-134-116.ec2.internal\" (UID: \"c12da327df9dbbcb86dad1e1fb06c721\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.122665 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.122587    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c88d6ec5757daa63bd60da436a7f378c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal\" (UID: \"c88d6ec5757daa63bd60da436a7f378c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.136024 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.136004    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-116.ec2.internal\" not found" node="ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.139562 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.139545    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-116.ec2.internal\" not found" node="ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.167029 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.166998    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:38.222800 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.222774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c12da327df9dbbcb86dad1e1fb06c721-config\") pod \"kube-apiserver-proxy-ip-10-0-134-116.ec2.internal\" (UID: \"c12da327df9dbbcb86dad1e1fb06c721\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.222889 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.222803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c88d6ec5757daa63bd60da436a7f378c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal\" (UID: \"c88d6ec5757daa63bd60da436a7f378c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.222889 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.222820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88d6ec5757daa63bd60da436a7f378c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal\" (UID: \"c88d6ec5757daa63bd60da436a7f378c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.222889 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.222874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88d6ec5757daa63bd60da436a7f378c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal\" (UID: \"c88d6ec5757daa63bd60da436a7f378c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.222889 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.222882    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c88d6ec5757daa63bd60da436a7f378c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal\" (UID: \"c88d6ec5757daa63bd60da436a7f378c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.223017 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.222874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c12da327df9dbbcb86dad1e1fb06c721-config\") pod \"kube-apiserver-proxy-ip-10-0-134-116.ec2.internal\" (UID: \"c12da327df9dbbcb86dad1e1fb06c721\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.267379 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.267319    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:38.368092 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.368056    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:38.439661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.439625    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.442141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.442116    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.468231 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.468185    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:38.568876 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.568782    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:38.669288 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.669246    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-116.ec2.internal\" not found"
Jul 16 22:33:38.713985 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.713961    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:33:38.720148 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.720135    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.729888 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.729869    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 22:33:38.731818 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.731805    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal"
Jul 16 22:33:38.743186 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.743166    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 22:33:38.754326 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.754303    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 22:33:38.754458 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.754440    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 22:33:38.754514 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.754480    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 22:33:38.795605 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.795576    2558 apiserver.go:52] "Watching apiserver"
Jul 16 22:33:38.812521 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.812496    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 22:33:38.812848 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.812827    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-4rs44","kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr","openshift-cluster-node-tuning-operator/tuned-72sgz","openshift-dns/node-resolver-hrw6w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal","openshift-multus/multus-xjclx","openshift-network-diagnostics/network-check-target-zzqfw","openshift-network-operator/iptables-alerter-km78l","kube-system/global-pull-secret-syncer-m8n25","kube-system/konnectivity-agent-8xkbd","openshift-image-registry/node-ca-j4qct","openshift-multus/multus-additional-cni-plugins-hhrpq","openshift-multus/network-metrics-daemon-pnzj8"]
Jul 16 22:33:38.814264 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.814245    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.815518 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.815498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.816616 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.816598    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 22:33:38.816687 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.816666    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 22:33:38.816838 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.816607    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 22:33:38.816838 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.816687    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6c898\""
Jul 16 22:33:38.816838 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.816736    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 22:33:38.816943 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.816902    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.817670 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.817656    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 22:33:38.817958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.817943    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 22:33:38.817995 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.817967    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-774t7\""
Jul 16 22:33:38.818065 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.818053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.819083 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.819037    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 22:33:38.819172 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.819155    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 22:33:38.819310 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.819271    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 22:33:38.819508 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.819493    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.819746 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.819636    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8pkjh\""
Jul 16 22:33:38.819875 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.819863    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 22:33:38.820234 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.820220    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fpg4c\""
Jul 16 22:33:38.820301 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.820285    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:33:38.820644 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.820628    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 22:33:38.820941 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.820923    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:38.821022 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.820994    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:38.821728 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.821714    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 22:33:38.821783 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.821750    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 22:33:38.821966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.821952    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rcqq4\""
Jul 16 22:33:38.822115 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.822100    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:38.823762 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.823738    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.824536 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.824518    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-k8s-cni-cncf-io\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.824614 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.824551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-kubelet\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.824614 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.824579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-hostroot\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.824614 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.824603    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5da05d4-9309-40a2-a2ab-43fbb2c63859-tmp-dir\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.824742 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.824623    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5v7lw\""
Jul 16 22:33:38.824742 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.824626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-kubernetes\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.824742 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.824694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-tuned\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.825061 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825030    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvgd\" (UniqueName: \"kubernetes.io/projected/ba9609e2-cd67-403b-8559-e036dc2aea4d-kube-api-access-lqvgd\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.825175 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hltjb\" (UniqueName: \"kubernetes.io/projected/f4287831-aa57-4f11-912a-37b9987ba4c0-kube-api-access-hltjb\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:38.825175 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-cnibin\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.825272 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825199    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-var-lib-kubelet\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.825272 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-system-cni-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.825365 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-cni-multus\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.825472 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825404    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:33:38.825472 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825464    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 22:33:38.825571 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825472    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 22:33:38.825571 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-etc-kubernetes\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.825660 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825589    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-system-cni-dir\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.825660 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4bln\" (UniqueName: \"kubernetes.io/projected/508b316a-72a1-4d8b-a751-3de2c960df27-kube-api-access-n4bln\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.825756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-sys\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.825756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825696    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5da05d4-9309-40a2-a2ab-43fbb2c63859-hosts-file\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-cni-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-cni-binary-copy\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.825995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-conf-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-socket-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826060    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-run\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826134    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826164    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-netns\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-daemon-config\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826234    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.826352    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826226    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbqzr\" (UniqueName: \"kubernetes.io/projected/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-kube-api-access-wbqzr\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826455    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-os-release\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-device-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.827180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826625    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysconfig\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-systemd\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826675    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-host\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826709    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-socket-dir-parent\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-multus-certs\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826793    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-sys-fs\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-modprobe-d\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba9609e2-cd67-403b-8559-e036dc2aea4d-tmp\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826964    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.826979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs4vz\" (UniqueName: \"kubernetes.io/projected/014497b4-af7f-400b-afa8-006ca6fd108a-kube-api-access-rs4vz\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827054    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-registration-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysctl-conf\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.828006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-lib-modules\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-os-release\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827438    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-cni-bin\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysctl-d\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827527    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkq5\" (UniqueName: \"kubernetes.io/projected/b5da05d4-9309-40a2-a2ab-43fbb2c63859-kube-api-access-wqkq5\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-cnibin\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.827656    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7gbsf\""
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.828325    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:38.828785 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.828431    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:38.829921 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.829903    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:33:38.831118 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.831105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:38.832060 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.832024    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 22:33:38.832289 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.832273    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 22:33:38.832379 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.832326    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vn57h\""
Jul 16 22:33:38.832379 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.832348    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 22:33:38.833883 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.833290    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 22:33:38.833883 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.833549    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 22:33:38.833883 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.833673    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-85sfg\""
Jul 16 22:33:38.833883 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.833806    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 22:33:38.856077 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.856061    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4fblh"
Jul 16 22:33:38.865076 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.865058    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4fblh"
Jul 16 22:33:38.883003 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.882961    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 22:28:39 +0000 UTC" deadline="2027-12-25 08:33:05.491479485 +0000 UTC"
Jul 16 22:33:38.883003 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.883001    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12633h59m26.608481175s"
Jul 16 22:33:38.922462 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.922442    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 22:33:38.927862 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-os-release\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.927983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-cni-bin\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.927983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-slash\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.927983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysctl-d\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.927983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-cnibin\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.927983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-os-release\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.927983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-cni-bin\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.927983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927962    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-hostroot\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.927998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-hostroot\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928008    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-run-netns\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928054    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-cnibin\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysctl-d\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928089    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5da05d4-9309-40a2-a2ab-43fbb2c63859-tmp-dir\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-kubernetes\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-tuned\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvgd\" (UniqueName: \"kubernetes.io/projected/ba9609e2-cd67-403b-8559-e036dc2aea4d-kube-api-access-lqvgd\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-kubernetes\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.928327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928326    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-cnibin\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-cni-multus\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-cni-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5da05d4-9309-40a2-a2ab-43fbb2c63859-tmp-dir\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928448    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-cni-multus\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928527    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-cni-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbqzr\" (UniqueName: \"kubernetes.io/projected/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-kube-api-access-wbqzr\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928574    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-cnibin\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-os-release\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928623    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928646    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs4vz\" (UniqueName: \"kubernetes.io/projected/014497b4-af7f-400b-afa8-006ca6fd108a-kube-api-access-rs4vz\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-dbus\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-os-release\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfs28\" (UniqueName: \"kubernetes.io/projected/f899ec6f-62fe-4101-9946-2409e90cad39-kube-api-access-hfs28\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-socket-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-run\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.928958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-kubelet\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-ovn\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928840    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-cni-netd\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-env-overrides\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-socket-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-run\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9wzs\" (UniqueName: \"kubernetes.io/projected/7d6e9cb5-814a-4503-935c-41a97397f8d6-kube-api-access-w9wzs\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.928983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929016    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-device-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-systemd\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-host\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-device-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-socket-dir-parent\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqdps\" (UniqueName: \"kubernetes.io/projected/bc7b511c-af30-4554-9347-47544e8bd562-kube-api-access-wqdps\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929125    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-systemd\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.929881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-sys-fs\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-socket-dir-parent\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-modprobe-d\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929184    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-host\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-sys-fs\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-kubelet-config\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f899ec6f-62fe-4101-9946-2409e90cad39-iptables-alerter-script\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-modprobe-d\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-registration-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysctl-conf\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkq5\" (UniqueName: \"kubernetes.io/projected/b5da05d4-9309-40a2-a2ab-43fbb2c63859-kube-api-access-wqkq5\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-k8s-cni-cncf-io\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-kubelet\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.930720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovnkube-script-lib\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929504    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hltjb\" (UniqueName: \"kubernetes.io/projected/f4287831-aa57-4f11-912a-37b9987ba4c0-kube-api-access-hltjb\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a9c38fd-6b6f-4339-88ce-8156cb5206a3-konnectivity-ca\") pod \"konnectivity-agent-8xkbd\" (UID: \"4a9c38fd-6b6f-4339-88ce-8156cb5206a3\") " pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-etc-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovnkube-config\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-var-lib-kubelet\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929637    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-system-cni-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-etc-kubernetes\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-system-cni-dir\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a9c38fd-6b6f-4339-88ce-8156cb5206a3-agent-certs\") pod \"konnectivity-agent-8xkbd\" (UID: \"4a9c38fd-6b6f-4339-88ce-8156cb5206a3\") " pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc7b511c-af30-4554-9347-47544e8bd562-serviceca\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f899ec6f-62fe-4101-9946-2409e90cad39-host-slash\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4bln\" (UniqueName: \"kubernetes.io/projected/508b316a-72a1-4d8b-a751-3de2c960df27-kube-api-access-n4bln\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-sys\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5da05d4-9309-40a2-a2ab-43fbb2c63859-hosts-file\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-cni-binary-copy\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.931546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-conf-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929907    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-daemon-config\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-systemd-units\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929956    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.929981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-netns\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930078    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-cni-bin\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysconfig\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-multus-certs\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930160    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc7b511c-af30-4554-9347-47544e8bd562-host\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovn-node-metrics-cert\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba9609e2-cd67-403b-8559-e036dc2aea4d-tmp\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-systemd\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.932241 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930220    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-var-lib-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-registration-dir\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-node-log\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-log-socket\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-sys\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930337    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysctl-conf\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-lib-modules\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5da05d4-9309-40a2-a2ab-43fbb2c63859-hosts-file\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-k8s-cni-cncf-io\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-lib-modules\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-var-lib-kubelet\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-cni-binary-copy\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/014497b4-af7f-400b-afa8-006ca6fd108a-system-cni-dir\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-etc-kubernetes\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-var-lib-kubelet\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.930995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-system-cni-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931089    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/508b316a-72a1-4d8b-a751-3de2c960df27-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.932949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-sysconfig\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-multus-certs\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931178    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-host-run-netns\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.931234    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:38.931311    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs podName:f4287831-aa57-4f11-912a-37b9987ba4c0 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:39.431275054 +0000 UTC m=+1.975098311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs") pod "network-metrics-daemon-pnzj8" (UID: "f4287831-aa57-4f11-912a-37b9987ba4c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-daemon-config\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931546    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-multus-conf-dir\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/014497b4-af7f-400b-afa8-006ca6fd108a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.931890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba9609e2-cd67-403b-8559-e036dc2aea4d-etc-tuned\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.933489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.933032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba9609e2-cd67-403b-8559-e036dc2aea4d-tmp\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.937234 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.937214    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbqzr\" (UniqueName: \"kubernetes.io/projected/40d84c6e-3b4d-4dbf-9d76-5bb757d55b88-kube-api-access-wbqzr\") pod \"multus-xjclx\" (UID: \"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88\") " pod="openshift-multus/multus-xjclx"
Jul 16 22:33:38.937803 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.937784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs4vz\" (UniqueName: \"kubernetes.io/projected/014497b4-af7f-400b-afa8-006ca6fd108a-kube-api-access-rs4vz\") pod \"multus-additional-cni-plugins-hhrpq\" (UID: \"014497b4-af7f-400b-afa8-006ca6fd108a\") " pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:38.938133 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.938116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvgd\" (UniqueName: \"kubernetes.io/projected/ba9609e2-cd67-403b-8559-e036dc2aea4d-kube-api-access-lqvgd\") pod \"tuned-72sgz\" (UID: \"ba9609e2-cd67-403b-8559-e036dc2aea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:38.940484 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.940466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hltjb\" (UniqueName: \"kubernetes.io/projected/f4287831-aa57-4f11-912a-37b9987ba4c0-kube-api-access-hltjb\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:38.948141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.948110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkq5\" (UniqueName: \"kubernetes.io/projected/b5da05d4-9309-40a2-a2ab-43fbb2c63859-kube-api-access-wqkq5\") pod \"node-resolver-hrw6w\" (UID: \"b5da05d4-9309-40a2-a2ab-43fbb2c63859\") " pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:38.948842 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:38.948826    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4bln\" (UniqueName: \"kubernetes.io/projected/508b316a-72a1-4d8b-a751-3de2c960df27-kube-api-access-n4bln\") pod \"aws-ebs-csi-driver-node-xbcgr\" (UID: \"508b316a-72a1-4d8b-a751-3de2c960df27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:40.645937 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.645905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-slash\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.645937 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.645942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.645959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-run-netns\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.645977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-dbus\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.645992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfs28\" (UniqueName: \"kubernetes.io/projected/f899ec6f-62fe-4101-9946-2409e90cad39-kube-api-access-hfs28\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-kubelet\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-slash\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-ovn\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-run-netns\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-cni-netd\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:40.646112    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-cni-netd\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646143    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-kubelet\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-env-overrides\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-dbus\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:40.646163 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:40.646173    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret podName:6a37d336-e886-47b6-a4c0-fe75aa8b94dd nodeName:}" failed. No retries permitted until 2026-07-16 22:33:41.146152429 +0000 UTC m=+2.075162618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret") pod "global-pull-secret-syncer-m8n25" (UID: "6a37d336-e886-47b6-a4c0-fe75aa8b94dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-ovn\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9wzs\" (UniqueName: \"kubernetes.io/projected/7d6e9cb5-814a-4503-935c-41a97397f8d6-kube-api-access-w9wzs\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqdps\" (UniqueName: \"kubernetes.io/projected/bc7b511c-af30-4554-9347-47544e8bd562-kube-api-access-wqdps\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-kubelet-config\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f899ec6f-62fe-4101-9946-2409e90cad39-iptables-alerter-script\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646320    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovnkube-script-lib\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646377    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-kubelet-config\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a9c38fd-6b6f-4339-88ce-8156cb5206a3-konnectivity-ca\") pod \"konnectivity-agent-8xkbd\" (UID: \"4a9c38fd-6b6f-4339-88ce-8156cb5206a3\") " pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646497    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-etc-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovnkube-config\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646557    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a9c38fd-6b6f-4339-88ce-8156cb5206a3-agent-certs\") pod \"konnectivity-agent-8xkbd\" (UID: \"4a9c38fd-6b6f-4339-88ce-8156cb5206a3\") " pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:33:40.646936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc7b511c-af30-4554-9347-47544e8bd562-serviceca\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646614    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f899ec6f-62fe-4101-9946-2409e90cad39-host-slash\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-systemd-units\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-cni-bin\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-env-overrides\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646739    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc7b511c-af30-4554-9347-47544e8bd562-host\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc7b511c-af30-4554-9347-47544e8bd562-host\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovn-node-metrics-cert\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646808    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f899ec6f-62fe-4101-9946-2409e90cad39-host-slash\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646818    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-systemd-units\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646832    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-systemd\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646856    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-var-lib-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-host-cni-bin\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646944    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-var-lib-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646959    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovnkube-script-lib\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.647851 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.646981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f899ec6f-62fe-4101-9946-2409e90cad39-iptables-alerter-script\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647042    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-etc-openvswitch\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647086    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovnkube-config\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647085    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-run-systemd\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-node-log\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-log-socket\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647171    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-node-log\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647215    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d6e9cb5-814a-4503-935c-41a97397f8d6-log-socket\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647507    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc7b511c-af30-4554-9347-47544e8bd562-serviceca\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:40.648529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.647965    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a9c38fd-6b6f-4339-88ce-8156cb5206a3-konnectivity-ca\") pod \"konnectivity-agent-8xkbd\" (UID: \"4a9c38fd-6b6f-4339-88ce-8156cb5206a3\") " pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:33:40.649288 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.649269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d6e9cb5-814a-4503-935c-41a97397f8d6-ovn-node-metrics-cert\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.649540 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.649524    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a9c38fd-6b6f-4339-88ce-8156cb5206a3-agent-certs\") pod \"konnectivity-agent-8xkbd\" (UID: \"4a9c38fd-6b6f-4339-88ce-8156cb5206a3\") " pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:33:40.654474 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:40.654455    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:33:40.654474 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:40.654474    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:33:40.654829 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:40.654484    2558 projected.go:196] Error preparing data for projected volume kube-api-access-fstlb for pod openshift-network-diagnostics/network-check-target-zzqfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:40.654829 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:40.654533    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb podName:ff47fd1d-62d4-4c9e-a0b5-56c536ff7610 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:41.154515231 +0000 UTC m=+2.083525421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fstlb" (UniqueName: "kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb") pod "network-check-target-zzqfw" (UID: "ff47fd1d-62d4-4c9e-a0b5-56c536ff7610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:40.656150 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.656119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqdps\" (UniqueName: \"kubernetes.io/projected/bc7b511c-af30-4554-9347-47544e8bd562-kube-api-access-wqdps\") pod \"node-ca-j4qct\" (UID: \"bc7b511c-af30-4554-9347-47544e8bd562\") " pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:40.656586 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.656564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfs28\" (UniqueName: \"kubernetes.io/projected/f899ec6f-62fe-4101-9946-2409e90cad39-kube-api-access-hfs28\") pod \"iptables-alerter-km78l\" (UID: \"f899ec6f-62fe-4101-9946-2409e90cad39\") " pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:40.656669 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.656632    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88d6ec5757daa63bd60da436a7f378c.slice/crio-23367b6fc8536760679b5a6d97808abaf256107b68b888e6ebf2527a89e54fcc WatchSource:0}: Error finding container 23367b6fc8536760679b5a6d97808abaf256107b68b888e6ebf2527a89e54fcc: Status 404 returned error can't find the container with id 23367b6fc8536760679b5a6d97808abaf256107b68b888e6ebf2527a89e54fcc
Jul 16 22:33:40.657404 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.657382    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12da327df9dbbcb86dad1e1fb06c721.slice/crio-e9873cc45fe9d88b1227216333b9b8889317c3ac5b5a599af3d716c555399cfe WatchSource:0}: Error finding container e9873cc45fe9d88b1227216333b9b8889317c3ac5b5a599af3d716c555399cfe: Status 404 returned error can't find the container with id e9873cc45fe9d88b1227216333b9b8889317c3ac5b5a599af3d716c555399cfe
Jul 16 22:33:40.657472 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.657403    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9wzs\" (UniqueName: \"kubernetes.io/projected/7d6e9cb5-814a-4503-935c-41a97397f8d6-kube-api-access-w9wzs\") pod \"ovnkube-node-4rs44\" (UID: \"7d6e9cb5-814a-4503-935c-41a97397f8d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.661949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.661930    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:33:40.738518 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.738435    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:33:40.763910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.763876    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xjclx"
Jul 16 22:33:40.773802 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.773775    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d84c6e_3b4d_4dbf_9d76_5bb757d55b88.slice/crio-3f68014b41dd3f68b1adc9e8a398ccb4daaed904e0df56989b5ea65885d7c20d WatchSource:0}: Error finding container 3f68014b41dd3f68b1adc9e8a398ccb4daaed904e0df56989b5ea65885d7c20d: Status 404 returned error can't find the container with id 3f68014b41dd3f68b1adc9e8a398ccb4daaed904e0df56989b5ea65885d7c20d
Jul 16 22:33:40.786855 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.786822    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhrpq"
Jul 16 22:33:40.795089 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.795068    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod014497b4_af7f_400b_afa8_006ca6fd108a.slice/crio-9a0d734215156a53af96228d59203da292647cab71b8cdd0244def5dbea1822f WatchSource:0}: Error finding container 9a0d734215156a53af96228d59203da292647cab71b8cdd0244def5dbea1822f: Status 404 returned error can't find the container with id 9a0d734215156a53af96228d59203da292647cab71b8cdd0244def5dbea1822f
Jul 16 22:33:40.804561 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.804542    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr"
Jul 16 22:33:40.813176 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.813151    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508b316a_72a1_4d8b_a751_3de2c960df27.slice/crio-f07bb032e211d7acd2b4bef14c5b5a86b2a96204554ee0d75d7c549e37d8b43d WatchSource:0}: Error finding container f07bb032e211d7acd2b4bef14c5b5a86b2a96204554ee0d75d7c549e37d8b43d: Status 404 returned error can't find the container with id f07bb032e211d7acd2b4bef14c5b5a86b2a96204554ee0d75d7c549e37d8b43d
Jul 16 22:33:40.817141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.815141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-72sgz"
Jul 16 22:33:40.821717 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.821699    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrw6w"
Jul 16 22:33:40.823159 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.823135    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9609e2_cd67_403b_8559_e036dc2aea4d.slice/crio-97ec550cfc3583b8da2cdfafa0eb8a1672a648cbcd51d20f3559a8e5b56f02a4 WatchSource:0}: Error finding container 97ec550cfc3583b8da2cdfafa0eb8a1672a648cbcd51d20f3559a8e5b56f02a4: Status 404 returned error can't find the container with id 97ec550cfc3583b8da2cdfafa0eb8a1672a648cbcd51d20f3559a8e5b56f02a4
Jul 16 22:33:40.829319 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.829299    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5da05d4_9309_40a2_a2ab_43fbb2c63859.slice/crio-40082b3d6aefb6dd9e8677aad0c206b4fdf257624eeeb02463cd34fd7ebfc2f3 WatchSource:0}: Error finding container 40082b3d6aefb6dd9e8677aad0c206b4fdf257624eeeb02463cd34fd7ebfc2f3: Status 404 returned error can't find the container with id 40082b3d6aefb6dd9e8677aad0c206b4fdf257624eeeb02463cd34fd7ebfc2f3
Jul 16 22:33:40.843213 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.843191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-km78l"
Jul 16 22:33:40.851223 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.851201    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf899ec6f_62fe_4101_9946_2409e90cad39.slice/crio-ada22ce36a7be0c28111fa4fb03c4bff41deb38b9f6918c64aecc8433f8024c8 WatchSource:0}: Error finding container ada22ce36a7be0c28111fa4fb03c4bff41deb38b9f6918c64aecc8433f8024c8: Status 404 returned error can't find the container with id ada22ce36a7be0c28111fa4fb03c4bff41deb38b9f6918c64aecc8433f8024c8
Jul 16 22:33:40.881099 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.881069    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:33:40.889553 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.889530    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6e9cb5_814a_4503_935c_41a97397f8d6.slice/crio-d76e455e68a21d135632b616fae75374f7ce2f7390a5f74e49b0e2d46f0276b5 WatchSource:0}: Error finding container d76e455e68a21d135632b616fae75374f7ce2f7390a5f74e49b0e2d46f0276b5: Status 404 returned error can't find the container with id d76e455e68a21d135632b616fae75374f7ce2f7390a5f74e49b0e2d46f0276b5
Jul 16 22:33:40.896410 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.896386    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:33:40.902160 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:40.902141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j4qct"
Jul 16 22:33:40.904625 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.904596    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9c38fd_6b6f_4339_88ce_8156cb5206a3.slice/crio-128acad002a5e2ec74b292649267217dd925919521e57c22574ab7b4d49ef805 WatchSource:0}: Error finding container 128acad002a5e2ec74b292649267217dd925919521e57c22574ab7b4d49ef805: Status 404 returned error can't find the container with id 128acad002a5e2ec74b292649267217dd925919521e57c22574ab7b4d49ef805
Jul 16 22:33:40.910519 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:33:40.910499    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7b511c_af30_4554_9347_47544e8bd562.slice/crio-4ad5a98572a00ca04fbbc7f06cc5ed85713c01cac8bd76bbe072ec72b7bb5c30 WatchSource:0}: Error finding container 4ad5a98572a00ca04fbbc7f06cc5ed85713c01cac8bd76bbe072ec72b7bb5c30: Status 404 returned error can't find the container with id 4ad5a98572a00ca04fbbc7f06cc5ed85713c01cac8bd76bbe072ec72b7bb5c30
Jul 16 22:33:41.049873 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.049775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:41.050024 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.049889    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:41.050024 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.049950    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs podName:f4287831-aa57-4f11-912a-37b9987ba4c0 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:42.049933185 +0000 UTC m=+2.978943382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs") pod "network-metrics-daemon-pnzj8" (UID: "f4287831-aa57-4f11-912a-37b9987ba4c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:41.150127 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.150096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:41.150349 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.150284    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:41.150428 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.150361    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret podName:6a37d336-e886-47b6-a4c0-fe75aa8b94dd nodeName:}" failed. No retries permitted until 2026-07-16 22:33:42.150340973 +0000 UTC m=+3.079351178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret") pod "global-pull-secret-syncer-m8n25" (UID: "6a37d336-e886-47b6-a4c0-fe75aa8b94dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:41.250910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.250861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:41.251086 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.251058    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:33:41.251086 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.251083    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:33:41.251276 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.251098    2558 projected.go:196] Error preparing data for projected volume kube-api-access-fstlb for pod openshift-network-diagnostics/network-check-target-zzqfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:41.251276 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.251157    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb podName:ff47fd1d-62d4-4c9e-a0b5-56c536ff7610 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:42.251138374 +0000 UTC m=+3.180148578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fstlb" (UniqueName: "kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb") pod "network-check-target-zzqfw" (UID: "ff47fd1d-62d4-4c9e-a0b5-56c536ff7610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:41.481977 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.481845    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 22:28:40 +0000 UTC" deadline="2028-03-20 19:54:39.338753815 +0000 UTC"
Jul 16 22:33:41.481977 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.481910    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14709h20m57.85684847s"
Jul 16 22:33:41.631373 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.631335    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:41.631534 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.631452    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:41.631835 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.631815    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:41.631934 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:41.631914    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:41.643148 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.643092    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j4qct" event={"ID":"bc7b511c-af30-4554-9347-47544e8bd562","Type":"ContainerStarted","Data":"4ad5a98572a00ca04fbbc7f06cc5ed85713c01cac8bd76bbe072ec72b7bb5c30"}
Jul 16 22:33:41.651753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.651718    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"d76e455e68a21d135632b616fae75374f7ce2f7390a5f74e49b0e2d46f0276b5"}
Jul 16 22:33:41.655065 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.655041    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-72sgz" event={"ID":"ba9609e2-cd67-403b-8559-e036dc2aea4d","Type":"ContainerStarted","Data":"97ec550cfc3583b8da2cdfafa0eb8a1672a648cbcd51d20f3559a8e5b56f02a4"}
Jul 16 22:33:41.665440 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.665412    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr" event={"ID":"508b316a-72a1-4d8b-a751-3de2c960df27","Type":"ContainerStarted","Data":"f07bb032e211d7acd2b4bef14c5b5a86b2a96204554ee0d75d7c549e37d8b43d"}
Jul 16 22:33:41.680655 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.680624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal" event={"ID":"c12da327df9dbbcb86dad1e1fb06c721","Type":"ContainerStarted","Data":"e9873cc45fe9d88b1227216333b9b8889317c3ac5b5a599af3d716c555399cfe"}
Jul 16 22:33:41.689637 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.689527    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8xkbd" event={"ID":"4a9c38fd-6b6f-4339-88ce-8156cb5206a3","Type":"ContainerStarted","Data":"128acad002a5e2ec74b292649267217dd925919521e57c22574ab7b4d49ef805"}
Jul 16 22:33:41.692068 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.692042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-km78l" event={"ID":"f899ec6f-62fe-4101-9946-2409e90cad39","Type":"ContainerStarted","Data":"ada22ce36a7be0c28111fa4fb03c4bff41deb38b9f6918c64aecc8433f8024c8"}
Jul 16 22:33:41.700276 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.700179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrw6w" event={"ID":"b5da05d4-9309-40a2-a2ab-43fbb2c63859","Type":"ContainerStarted","Data":"40082b3d6aefb6dd9e8677aad0c206b4fdf257624eeeb02463cd34fd7ebfc2f3"}
Jul 16 22:33:41.718732 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.718695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" event={"ID":"014497b4-af7f-400b-afa8-006ca6fd108a","Type":"ContainerStarted","Data":"9a0d734215156a53af96228d59203da292647cab71b8cdd0244def5dbea1822f"}
Jul 16 22:33:41.728322 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.728288    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xjclx" event={"ID":"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88","Type":"ContainerStarted","Data":"3f68014b41dd3f68b1adc9e8a398ccb4daaed904e0df56989b5ea65885d7c20d"}
Jul 16 22:33:41.735249 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.735157    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal" event={"ID":"c88d6ec5757daa63bd60da436a7f378c","Type":"ContainerStarted","Data":"23367b6fc8536760679b5a6d97808abaf256107b68b888e6ebf2527a89e54fcc"}
Jul 16 22:33:41.938821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:41.938763    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:33:42.057821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:42.057790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:42.058006 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.057977    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:42.058068 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.058038    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs podName:f4287831-aa57-4f11-912a-37b9987ba4c0 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:44.058019099 +0000 UTC m=+4.987029306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs") pod "network-metrics-daemon-pnzj8" (UID: "f4287831-aa57-4f11-912a-37b9987ba4c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:42.152920 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:42.152724    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:33:42.158747 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:42.158533    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:42.158747 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.158697    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:42.158965 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.158756    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret podName:6a37d336-e886-47b6-a4c0-fe75aa8b94dd nodeName:}" failed. No retries permitted until 2026-07-16 22:33:44.158737422 +0000 UTC m=+5.087747644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret") pod "global-pull-secret-syncer-m8n25" (UID: "6a37d336-e886-47b6-a4c0-fe75aa8b94dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:42.259646 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:42.259567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:42.259812 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.259783    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:33:42.259812 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.259807    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:33:42.259925 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.259818    2558 projected.go:196] Error preparing data for projected volume kube-api-access-fstlb for pod openshift-network-diagnostics/network-check-target-zzqfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:42.259925 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.259879    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb podName:ff47fd1d-62d4-4c9e-a0b5-56c536ff7610 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:44.259859175 +0000 UTC m=+5.188869388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fstlb" (UniqueName: "kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb") pod "network-check-target-zzqfw" (UID: "ff47fd1d-62d4-4c9e-a0b5-56c536ff7610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:42.483165 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:42.483125    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 22:28:40 +0000 UTC" deadline="2028-04-04 23:59:23.739096828 +0000 UTC"
Jul 16 22:33:42.483165 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:42.483162    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15073h25m41.255939022s"
Jul 16 22:33:42.628630 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:42.628556    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:42.628782 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:42.628701    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:43.634446 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:43.634393    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:43.634880 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:43.634575    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:43.635034 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:43.634951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:43.635134 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:43.635109    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:44.075347 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:44.074675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:44.075347 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.074878    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:44.075347 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.074940    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs podName:f4287831-aa57-4f11-912a-37b9987ba4c0 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:48.074922894 +0000 UTC m=+9.003933089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs") pod "network-metrics-daemon-pnzj8" (UID: "f4287831-aa57-4f11-912a-37b9987ba4c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:44.175632 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:44.175593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:44.175821 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.175768    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:44.175891 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.175828    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret podName:6a37d336-e886-47b6-a4c0-fe75aa8b94dd nodeName:}" failed. No retries permitted until 2026-07-16 22:33:48.17580996 +0000 UTC m=+9.104820164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret") pod "global-pull-secret-syncer-m8n25" (UID: "6a37d336-e886-47b6-a4c0-fe75aa8b94dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:44.276375 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:44.276283    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:44.276575 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.276477    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:33:44.276575 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.276507    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:33:44.276575 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.276521    2558 projected.go:196] Error preparing data for projected volume kube-api-access-fstlb for pod openshift-network-diagnostics/network-check-target-zzqfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:44.276740 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.276591    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb podName:ff47fd1d-62d4-4c9e-a0b5-56c536ff7610 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:48.27656927 +0000 UTC m=+9.205579474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fstlb" (UniqueName: "kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb") pod "network-check-target-zzqfw" (UID: "ff47fd1d-62d4-4c9e-a0b5-56c536ff7610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:44.628207 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:44.628171    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:44.628383 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:44.628311    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:45.631010 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:45.630984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:45.631488 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:45.631111    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:45.631488 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:45.631365    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:45.631488 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:45.631466    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:46.629010 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:46.628973    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:46.629182 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:46.629106    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:47.630361 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:47.630328    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:47.630784 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:47.630461    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:47.630867 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:47.630845    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:47.630975 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:47.630938    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:48.109520 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:48.109456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:48.109685 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.109606    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:48.109685 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.109683    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs podName:f4287831-aa57-4f11-912a-37b9987ba4c0 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:56.109663712 +0000 UTC m=+17.038673919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs") pod "network-metrics-daemon-pnzj8" (UID: "f4287831-aa57-4f11-912a-37b9987ba4c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:48.211079 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:48.210504    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:48.211079 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.210674    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:48.211079 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.210736    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret podName:6a37d336-e886-47b6-a4c0-fe75aa8b94dd nodeName:}" failed. No retries permitted until 2026-07-16 22:33:56.210716983 +0000 UTC m=+17.139727189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret") pod "global-pull-secret-syncer-m8n25" (UID: "6a37d336-e886-47b6-a4c0-fe75aa8b94dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:48.311637 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:48.311594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:48.311824 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.311787    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:33:48.311824 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.311811    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:33:48.311824 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.311826    2558 projected.go:196] Error preparing data for projected volume kube-api-access-fstlb for pod openshift-network-diagnostics/network-check-target-zzqfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:48.311987 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.311884    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb podName:ff47fd1d-62d4-4c9e-a0b5-56c536ff7610 nodeName:}" failed. No retries permitted until 2026-07-16 22:33:56.31186543 +0000 UTC m=+17.240875640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fstlb" (UniqueName: "kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb") pod "network-check-target-zzqfw" (UID: "ff47fd1d-62d4-4c9e-a0b5-56c536ff7610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:48.628926 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:48.628899    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:48.629113 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:48.629035    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:49.629460 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:49.629429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:49.629874 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:49.629514    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:49.629874 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:49.629833    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:49.629975 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:49.629927    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:50.628623 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:50.628210    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:50.628623 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:50.628335    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:51.628904 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:51.628865    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:51.629322 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:51.628988    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:51.629322 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:51.629022    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:51.629322 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:51.629078    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:52.628827 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:52.628796    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:52.628956 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:52.628907    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:53.630374 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:53.630336    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:53.630792 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:53.630345    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:53.630792 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:53.630476    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:53.630792 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:53.630591    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:54.628263 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:54.628219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:54.628428 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:54.628356    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:55.629028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:55.628999    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:55.629470 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:55.629123    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:55.629470 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:55.629203    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:55.629470 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:55.629328    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:56.172294 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:56.172250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:56.172575 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.172389    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:56.172575 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.172449    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs podName:f4287831-aa57-4f11-912a-37b9987ba4c0 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:12.172428972 +0000 UTC m=+33.101439178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs") pod "network-metrics-daemon-pnzj8" (UID: "f4287831-aa57-4f11-912a-37b9987ba4c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:33:56.272943 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:56.272894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:56.273112 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.273056    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:56.273162 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.273138    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret podName:6a37d336-e886-47b6-a4c0-fe75aa8b94dd nodeName:}" failed. No retries permitted until 2026-07-16 22:34:12.273117318 +0000 UTC m=+33.202127511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret") pod "global-pull-secret-syncer-m8n25" (UID: "6a37d336-e886-47b6-a4c0-fe75aa8b94dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:33:56.373514 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:56.373482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:56.373670 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.373647    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:33:56.373670 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.373667    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:33:56.373742 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.373677    2558 projected.go:196] Error preparing data for projected volume kube-api-access-fstlb for pod openshift-network-diagnostics/network-check-target-zzqfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:56.373742 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.373728    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb podName:ff47fd1d-62d4-4c9e-a0b5-56c536ff7610 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:12.373714851 +0000 UTC m=+33.302725040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fstlb" (UniqueName: "kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb") pod "network-check-target-zzqfw" (UID: "ff47fd1d-62d4-4c9e-a0b5-56c536ff7610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:33:56.628917 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:56.628845    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:56.629074 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:56.628975    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:57.628829 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:57.628783    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:57.628829 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:57.628832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:57.629083 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:57.628936    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:33:57.629419 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:57.629078    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:58.629324 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:58.629112    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:33:58.629706 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:58.629429    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:33:59.629633 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:59.629214    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:33:59.629633 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:59.629336    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:33:59.629633 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:33:59.629398    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:33:59.629633 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:33:59.629499    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:00.628398 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:00.628364    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:00.628582 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:00.628505    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:34:01.628434 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.628408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:01.629014 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.628442    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:01.629014 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:01.628529    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:01.629014 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:01.628638    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:34:01.793800 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.793762    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xjclx" event={"ID":"40d84c6e-3b4d-4dbf-9d76-5bb757d55b88","Type":"ContainerStarted","Data":"1d2f4b74b9d02db37a78587b67edff6afa64822252f3ff9f88eddb7ce04efa96"}
Jul 16 22:34:01.796715 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.796696    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:34:01.797137 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.797084    2558 generic.go:356] "Generic (PLEG): container finished" podID="7d6e9cb5-814a-4503-935c-41a97397f8d6" containerID="667dd82566047d4bacd9db1e129c15ebf651bde8f5723a593adba9915ab67fae" exitCode=1
Jul 16 22:34:01.797183 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.797130    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"d0ea304c77da4d00d3c1b62b01340d408a44bf64c13307a2d0d4c591fef3b657"}
Jul 16 22:34:01.797256 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.797217    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"bcdf482371549b87cfc27b6bebc497ce39e262f95da7d37cab5330dda0b793e9"}
Jul 16 22:34:01.797313 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.797282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"dce94b4f7692498b19868bcc0f8864a9c53afba542e576fd519bc4f95d4af428"}
Jul 16 22:34:01.797348 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.797335    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerDied","Data":"667dd82566047d4bacd9db1e129c15ebf651bde8f5723a593adba9915ab67fae"}
Jul 16 22:34:01.797389 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.797377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"06cb40c3a1bb6cccf5a60040f6dce9dd8d1a2dd438efcceac9082d76a9208706"}
Jul 16 22:34:01.803595 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.803571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-72sgz" event={"ID":"ba9609e2-cd67-403b-8559-e036dc2aea4d","Type":"ContainerStarted","Data":"ef62efe9523d20d10ae4bbedd0cee73b0ddaff3ae1da986bb6a8e776086f7d17"}
Jul 16 22:34:01.807066 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.807043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal" event={"ID":"c12da327df9dbbcb86dad1e1fb06c721","Type":"ContainerStarted","Data":"04d5995641eb9c2919686e324187e24ee52e9259b604266e0576571c8964d902"}
Jul 16 22:34:01.868020 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.867977    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xjclx" podStartSLOduration=2.416563016 podStartE2EDuration="22.867962226s" totalImagesPullingTime="20.45139921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:01.845283622 +0000 UTC m=+22.774293835" watchObservedRunningTime="2026-07-16 22:34:01.867962226 +0000 UTC m=+22.796972438"
Jul 16 22:34:01.901764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:01.901718    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-116.ec2.internal" podStartSLOduration=21.901701825 podStartE2EDuration="21.901701825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:01.868658482 +0000 UTC m=+22.797668693" watchObservedRunningTime="2026-07-16 22:34:01.901701825 +0000 UTC m=+22.830712082"
Jul 16 22:34:02.628606 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.628581    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:02.629041 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:02.628708    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:34:02.812992 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.812963    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:34:02.813427 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.813393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"36ee3fa25986d1571d1d74e5c86e9a33b71aa29246c8eba7641bd840ee697952"}
Jul 16 22:34:02.815281 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.815257    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr" event={"ID":"508b316a-72a1-4d8b-a751-3de2c960df27","Type":"ContainerStarted","Data":"4ff2b01e0b0ee21ac0465638e0d61279fc2c556a2c9e63cc89964ab4d3078ac1"}
Jul 16 22:34:02.816790 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.816722    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8xkbd" event={"ID":"4a9c38fd-6b6f-4339-88ce-8156cb5206a3","Type":"ContainerStarted","Data":"115c351690dc0271ffca7cb0e192a3c4921adb0c8d414a8d45b4bb3e6e1121ef"}
Jul 16 22:34:02.818521 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.818316    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-km78l" event={"ID":"f899ec6f-62fe-4101-9946-2409e90cad39","Type":"ContainerStarted","Data":"a08c2887f7a3581a90c857489ca8ae9b1232dcaf3a5fcbfa3fabfcf444f14c2d"}
Jul 16 22:34:02.819864 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.819842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrw6w" event={"ID":"b5da05d4-9309-40a2-a2ab-43fbb2c63859","Type":"ContainerStarted","Data":"ae733369e6e9663c62cd1686e1ea40fdc9ed1320de72623d9875ebe73c4bb39a"}
Jul 16 22:34:02.821736 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.821712    2558 generic.go:356] "Generic (PLEG): container finished" podID="014497b4-af7f-400b-afa8-006ca6fd108a" containerID="5ef2092868903d3e5dfff1733eb0667939ecd743645987f34a45c7c94072283c" exitCode=0
Jul 16 22:34:02.821825 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.821779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" event={"ID":"014497b4-af7f-400b-afa8-006ca6fd108a","Type":"ContainerDied","Data":"5ef2092868903d3e5dfff1733eb0667939ecd743645987f34a45c7c94072283c"}
Jul 16 22:34:02.823516 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.823495    2558 generic.go:356] "Generic (PLEG): container finished" podID="c88d6ec5757daa63bd60da436a7f378c" containerID="f8dfd5b27c548cd01b591c307e0bfe958aaecdc20f518c2e41d8b651d9ee13e5" exitCode=0
Jul 16 22:34:02.823617 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.823524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal" event={"ID":"c88d6ec5757daa63bd60da436a7f378c","Type":"ContainerDied","Data":"f8dfd5b27c548cd01b591c307e0bfe958aaecdc20f518c2e41d8b651d9ee13e5"}
Jul 16 22:34:02.825158 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.825133    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j4qct" event={"ID":"bc7b511c-af30-4554-9347-47544e8bd562","Type":"ContainerStarted","Data":"15b034c9ecd0927bce7f2a8bd1c52b065980c7c536e10603138a3059d42f2bcb"}
Jul 16 22:34:02.834185 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.834149    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-72sgz" podStartSLOduration=3.485796198 podStartE2EDuration="23.834131519s" totalImagesPullingTime="20.348335321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:01.903448358 +0000 UTC m=+22.832458570" watchObservedRunningTime="2026-07-16 22:34:02.834131519 +0000 UTC m=+23.763141734"
Jul 16 22:34:02.834591 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.834562    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8xkbd" podStartSLOduration=3.567723731 podStartE2EDuration="23.834551936s" totalImagesPullingTime="20.266828205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:02.834022428 +0000 UTC m=+23.763032639" watchObservedRunningTime="2026-07-16 22:34:02.834551936 +0000 UTC m=+23.763562148"
Jul 16 22:34:02.874356 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.874307    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j4qct" podStartSLOduration=3.6135172779999998 podStartE2EDuration="23.874288259s" totalImagesPullingTime="20.260770981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:02.873586045 +0000 UTC m=+23.802596258" watchObservedRunningTime="2026-07-16 22:34:02.874288259 +0000 UTC m=+23.803298474"
Jul 16 22:34:02.909691 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.909640    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hrw6w" podStartSLOduration=3.5638074570000002 podStartE2EDuration="23.909622952s" totalImagesPullingTime="20.345815495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:02.909467506 +0000 UTC m=+23.838477719" watchObservedRunningTime="2026-07-16 22:34:02.909622952 +0000 UTC m=+23.838633166"
Jul 16 22:34:02.926513 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:02.926454    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-km78l" podStartSLOduration=3.591179005 podStartE2EDuration="23.926438407s" totalImagesPullingTime="20.335259402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:02.926396634 +0000 UTC m=+23.855406847" watchObservedRunningTime="2026-07-16 22:34:02.926438407 +0000 UTC m=+23.855448631"
Jul 16 22:34:03.078963 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.078930    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xkbd_4a9c38fd-6b6f-4339-88ce-8156cb5206a3/konnectivity-agent/0.log" limit=1024
Jul 16 22:34:03.144391 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.144307    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:34:03.144958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.144934    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:34:03.145285 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.145259    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xkbd_4a9c38fd-6b6f-4339-88ce-8156cb5206a3/konnectivity-agent/0.log" limit=1024
Jul 16 22:34:03.399409 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.399376    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 22:34:03.515501 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.515263    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T22:34:03.399397291Z","UUID":"cfb82ce2-8286-40c5-aa35-4654bd9f9b28","Handler":null,"Name":"","Endpoint":""}
Jul 16 22:34:03.516755 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.516732    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 22:34:03.516887 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.516775    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 22:34:03.632270 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.632224    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:03.632749 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.632277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:03.632749 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.632224    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:03.632749 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:03.632356    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:34:03.632749 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:03.632430    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:03.632749 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:03.632519    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:34:03.829674 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.829580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr" event={"ID":"508b316a-72a1-4d8b-a751-3de2c960df27","Type":"ContainerStarted","Data":"2a750cd2ef209853771c368914d974ef1908235c0723e51e94af1555896e37a6"}
Jul 16 22:34:03.831553 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.831526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal" event={"ID":"c88d6ec5757daa63bd60da436a7f378c","Type":"ContainerStarted","Data":"6cb55020d5c340502448c4d0d7886362be84104c3682a45919a769f88183d3ad"}
Jul 16 22:34:03.832213 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.832185    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:34:03.832603 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.832585    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8xkbd"
Jul 16 22:34:03.865061 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:03.865006    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-116.ec2.internal" podStartSLOduration=23.864989516 podStartE2EDuration="23.864989516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:03.846919732 +0000 UTC m=+24.775929949" watchObservedRunningTime="2026-07-16 22:34:03.864989516 +0000 UTC m=+24.793999729"
Jul 16 22:34:04.839477 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:04.839455    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:34:04.840502 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:04.840468    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"6760849de327ddaf8eaa54cfa158b688b13d41682d9721a5ac3ac238978974a0"}
Jul 16 22:34:04.953642 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:04.953605    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xkbd_4a9c38fd-6b6f-4339-88ce-8156cb5206a3/konnectivity-agent/0.log" limit=1024
Jul 16 22:34:05.629359 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:05.629322    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:05.629667 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:05.629322    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:05.629667 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:05.629479    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:34:05.629667 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:05.629493    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:05.629667 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:05.629613    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:34:05.629867 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:05.629698    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:05.845125 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:05.845084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr" event={"ID":"508b316a-72a1-4d8b-a751-3de2c960df27","Type":"ContainerStarted","Data":"ee6f56eb937459d9a7d1b95c48dbaf7c8fd9b95b78cf1b2f414f73064611076e"}
Jul 16 22:34:05.871268 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:05.871196    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbcgr" podStartSLOduration=3.72534212 podStartE2EDuration="26.871176788s" totalImagesPullingTime="23.145834668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:05.871174772 +0000 UTC m=+26.800184994" watchObservedRunningTime="2026-07-16 22:34:05.871176788 +0000 UTC m=+26.800187001"
Jul 16 22:34:06.852052 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:06.851853    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:34:06.852601 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:06.852579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"510087aff957047287cd9845003c8d6b432c63ecdbdc7a1212207cafb5818172"}
Jul 16 22:34:06.853095 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:06.853070    2558 scope.go:117] "RemoveContainer" containerID="667dd82566047d4bacd9db1e129c15ebf651bde8f5723a593adba9915ab67fae"
Jul 16 22:34:07.628685 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:07.628610    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:07.628874 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:07.628740    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:07.628874 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:07.628610    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:07.628874 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:07.628846    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:34:07.628874 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:07.628610    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:07.629022 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:07.628916    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:34:08.346098 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.345909    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m8n25"]
Jul 16 22:34:08.346799 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.346220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:08.346799 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:08.346342    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:08.349692 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.349558    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pnzj8"]
Jul 16 22:34:08.349692 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.349664    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:08.349875 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:08.349768    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:34:08.350375 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.350350    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zzqfw"]
Jul 16 22:34:08.350490 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.350442    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:08.350548 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:08.350522    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:34:08.860117 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.860096    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:34:08.860563 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.860542    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" event={"ID":"7d6e9cb5-814a-4503-935c-41a97397f8d6","Type":"ContainerStarted","Data":"998d66c1f0a8a10ba1fea6e215d305b323ee6f5aa078001b1c9aac6fe117f968"}
Jul 16 22:34:08.860922 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.860893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:34:08.861033 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.860985    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:34:08.861086 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.861038    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:34:08.862507 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.862481    2558 generic.go:356] "Generic (PLEG): container finished" podID="014497b4-af7f-400b-afa8-006ca6fd108a" containerID="11ddd1d2d614af6ad2ce86a82c0dadb591e86192afff4420ac6b180d4e412769" exitCode=0
Jul 16 22:34:08.862618 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.862521    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" event={"ID":"014497b4-af7f-400b-afa8-006ca6fd108a","Type":"ContainerDied","Data":"11ddd1d2d614af6ad2ce86a82c0dadb591e86192afff4420ac6b180d4e412769"}
Jul 16 22:34:08.877821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.877801    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:34:08.878029 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.878012    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:34:08.895059 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:08.895020    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44" podStartSLOduration=9.532803373 podStartE2EDuration="29.89500812s" totalImagesPullingTime="20.362204747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:08.893410948 +0000 UTC m=+29.822421161" watchObservedRunningTime="2026-07-16 22:34:08.89500812 +0000 UTC m=+29.824018310"
Jul 16 22:34:09.632912 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:09.632880    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:09.633338 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:09.632985    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:10.629053 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:10.628968    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:10.629190 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:10.628968    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:10.629190 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:10.629076    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:34:10.629190 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:10.629153    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:34:10.872390 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:10.872354    2558 generic.go:356] "Generic (PLEG): container finished" podID="014497b4-af7f-400b-afa8-006ca6fd108a" containerID="fcfa9e26b7feddb612d6b3c0f20daa3ee0f4334b507697a613cb1bdedd641304" exitCode=0
Jul 16 22:34:10.872872 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:10.872395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" event={"ID":"014497b4-af7f-400b-afa8-006ca6fd108a","Type":"ContainerDied","Data":"fcfa9e26b7feddb612d6b3c0f20daa3ee0f4334b507697a613cb1bdedd641304"}
Jul 16 22:34:11.628797 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:11.628763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:11.628965 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:11.628869    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:12.194922 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:12.194846    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:12.195280 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.194948    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:34:12.195280 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.194995    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs podName:f4287831-aa57-4f11-912a-37b9987ba4c0 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:44.194982229 +0000 UTC m=+65.123992419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs") pod "network-metrics-daemon-pnzj8" (UID: "f4287831-aa57-4f11-912a-37b9987ba4c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:34:12.295095 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:12.295067    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:12.295297 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.295224    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:34:12.295374 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.295318    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret podName:6a37d336-e886-47b6-a4c0-fe75aa8b94dd nodeName:}" failed. No retries permitted until 2026-07-16 22:34:44.295297144 +0000 UTC m=+65.224307335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret") pod "global-pull-secret-syncer-m8n25" (UID: "6a37d336-e886-47b6-a4c0-fe75aa8b94dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:34:12.395626 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:12.395597    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:12.395778 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.395755    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:34:12.395778 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.395773    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:34:12.395868 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.395784    2558 projected.go:196] Error preparing data for projected volume kube-api-access-fstlb for pod openshift-network-diagnostics/network-check-target-zzqfw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:34:12.395868 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.395833    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb podName:ff47fd1d-62d4-4c9e-a0b5-56c536ff7610 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:44.395819644 +0000 UTC m=+65.324829833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fstlb" (UniqueName: "kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb") pod "network-check-target-zzqfw" (UID: "ff47fd1d-62d4-4c9e-a0b5-56c536ff7610") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:34:12.628308 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:12.628270    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:12.628308 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:12.628296    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:12.628495 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.628371    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzqfw" podUID="ff47fd1d-62d4-4c9e-a0b5-56c536ff7610"
Jul 16 22:34:12.628536 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:12.628498    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnzj8" podUID="f4287831-aa57-4f11-912a-37b9987ba4c0"
Jul 16 22:34:12.878805 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:12.878713    2558 generic.go:356] "Generic (PLEG): container finished" podID="014497b4-af7f-400b-afa8-006ca6fd108a" containerID="ff16729271d62154cb7a92000c3b300bf323b710e6c4280c98712a253d66a3f4" exitCode=0
Jul 16 22:34:12.878805 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:12.878780    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" event={"ID":"014497b4-af7f-400b-afa8-006ca6fd108a","Type":"ContainerDied","Data":"ff16729271d62154cb7a92000c3b300bf323b710e6c4280c98712a253d66a3f4"}
Jul 16 22:34:13.629199 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.629168    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:13.629611 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:13.629338    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8n25" podUID="6a37d336-e886-47b6-a4c0-fe75aa8b94dd"
Jul 16 22:34:13.894654 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.894587    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-116.ec2.internal" event="NodeReady"
Jul 16 22:34:13.894778 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.894715    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 22:34:13.942326 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.942291    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7jh5n"]
Jul 16 22:34:13.944718 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.944690    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jkthp"]
Jul 16 22:34:13.944850 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.944832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:13.946837 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.946815    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkthp"
Jul 16 22:34:13.947423 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.947403    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 22:34:13.947562 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.947540    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 22:34:13.947759 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.947747    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-57zhl\""
Jul 16 22:34:13.949452 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.949433    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 22:34:13.949550 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.949467    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 22:34:13.949618 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.949603    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 22:34:13.949697 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.949619    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m9krj\""
Jul 16 22:34:13.954224 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.954190    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jkthp"]
Jul 16 22:34:13.957346 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:13.957290    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7jh5n"]
Jul 16 22:34:14.008294 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.008259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.008466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.008307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-tmp-dir\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.008466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.008367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-config-volume\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.008466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.008441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn6xn\" (UniqueName: \"kubernetes.io/projected/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-kube-api-access-nn6xn\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.109743 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.109702    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-config-volume\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.109915 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.109791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6df31ee4-5386-4a49-b372-97a5955ce5d5-cert\") pod \"ingress-canary-jkthp\" (UID: \"6df31ee4-5386-4a49-b372-97a5955ce5d5\") " pod="openshift-ingress-canary/ingress-canary-jkthp"
Jul 16 22:34:14.109915 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.109823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn6xn\" (UniqueName: \"kubernetes.io/projected/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-kube-api-access-nn6xn\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.109915 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.109860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.110078 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.109931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-tmp-dir\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.110078 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.109971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7gb9\" (UniqueName: \"kubernetes.io/projected/6df31ee4-5386-4a49-b372-97a5955ce5d5-kube-api-access-v7gb9\") pod \"ingress-canary-jkthp\" (UID: \"6df31ee4-5386-4a49-b372-97a5955ce5d5\") " pod="openshift-ingress-canary/ingress-canary-jkthp"
Jul 16 22:34:14.110167 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:14.110097    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:34:14.110167 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:14.110154    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls podName:5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:14.610133536 +0000 UTC m=+35.539143725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls") pod "dns-default-7jh5n" (UID: "5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0") : secret "dns-default-metrics-tls" not found
Jul 16 22:34:14.110509 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.110489    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-tmp-dir\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.110575 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.110533    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-config-volume\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.121724 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.121561    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn6xn\" (UniqueName: \"kubernetes.io/projected/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-kube-api-access-nn6xn\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.210787 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.210698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7gb9\" (UniqueName: \"kubernetes.io/projected/6df31ee4-5386-4a49-b372-97a5955ce5d5-kube-api-access-v7gb9\") pod \"ingress-canary-jkthp\" (UID: \"6df31ee4-5386-4a49-b372-97a5955ce5d5\") " pod="openshift-ingress-canary/ingress-canary-jkthp"
Jul 16 22:34:14.210946 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.210806    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6df31ee4-5386-4a49-b372-97a5955ce5d5-cert\") pod \"ingress-canary-jkthp\" (UID: \"6df31ee4-5386-4a49-b372-97a5955ce5d5\") " pod="openshift-ingress-canary/ingress-canary-jkthp"
Jul 16 22:34:14.213768 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.213742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6df31ee4-5386-4a49-b372-97a5955ce5d5-cert\") pod \"ingress-canary-jkthp\" (UID: \"6df31ee4-5386-4a49-b372-97a5955ce5d5\") " pod="openshift-ingress-canary/ingress-canary-jkthp"
Jul 16 22:34:14.219797 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.219751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7gb9\" (UniqueName: \"kubernetes.io/projected/6df31ee4-5386-4a49-b372-97a5955ce5d5-kube-api-access-v7gb9\") pod \"ingress-canary-jkthp\" (UID: \"6df31ee4-5386-4a49-b372-97a5955ce5d5\") " pod="openshift-ingress-canary/ingress-canary-jkthp"
Jul 16 22:34:14.264612 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.264576    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkthp"
Jul 16 22:34:14.417616 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.417582    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jkthp"]
Jul 16 22:34:14.422430 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:34:14.422402    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df31ee4_5386_4a49_b372_97a5955ce5d5.slice/crio-d58ceb3f78e28a5a68bd5f004fec6ec1438ad5ed0f19435b2a7eb479008a5927 WatchSource:0}: Error finding container d58ceb3f78e28a5a68bd5f004fec6ec1438ad5ed0f19435b2a7eb479008a5927: Status 404 returned error can't find the container with id d58ceb3f78e28a5a68bd5f004fec6ec1438ad5ed0f19435b2a7eb479008a5927
Jul 16 22:34:14.613902 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.613821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:14.614052 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:14.613933    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:34:14.614052 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:14.613987    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls podName:5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:15.613972627 +0000 UTC m=+36.542982831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls") pod "dns-default-7jh5n" (UID: "5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0") : secret "dns-default-metrics-tls" not found
Jul 16 22:34:14.628223 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.628202    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:14.628321 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.628204    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:14.631185 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.631165    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jdr86\""
Jul 16 22:34:14.631837 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.631688    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 22:34:14.631837 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.631803    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 22:34:14.631960 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.631807    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9dnx4\""
Jul 16 22:34:14.631960 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.631894    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 22:34:14.886227 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:14.886141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jkthp" event={"ID":"6df31ee4-5386-4a49-b372-97a5955ce5d5","Type":"ContainerStarted","Data":"d58ceb3f78e28a5a68bd5f004fec6ec1438ad5ed0f19435b2a7eb479008a5927"}
Jul 16 22:34:15.621097 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:15.621053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:15.621344 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:15.621326    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:34:15.621405 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:15.621397    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls podName:5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:17.621378002 +0000 UTC m=+38.550388197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls") pod "dns-default-7jh5n" (UID: "5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0") : secret "dns-default-metrics-tls" not found
Jul 16 22:34:15.633100 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:15.633076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:15.637136 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:15.637113    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 22:34:17.637255 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:17.637205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:17.637679 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:17.637364    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:34:17.637679 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:17.637436    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls podName:5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:21.63741331 +0000 UTC m=+42.566423523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls") pod "dns-default-7jh5n" (UID: "5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0") : secret "dns-default-metrics-tls" not found
Jul 16 22:34:19.902368 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:19.902332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jkthp" event={"ID":"6df31ee4-5386-4a49-b372-97a5955ce5d5","Type":"ContainerStarted","Data":"2d9851e1b7fef057f2c653729b03dad167f3f0909801009aedff97708cb3e612"}
Jul 16 22:34:19.908581 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:19.908554    2558 generic.go:356] "Generic (PLEG): container finished" podID="014497b4-af7f-400b-afa8-006ca6fd108a" containerID="a4808581d7c95b4d7860836d4575556f9da277348b99064b5512e8008a31cb5d" exitCode=0
Jul 16 22:34:19.908719 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:19.908591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" event={"ID":"014497b4-af7f-400b-afa8-006ca6fd108a","Type":"ContainerDied","Data":"a4808581d7c95b4d7860836d4575556f9da277348b99064b5512e8008a31cb5d"}
Jul 16 22:34:19.920062 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:19.920024    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jkthp" podStartSLOduration=2.4336294929999998 podStartE2EDuration="6.920011004s" totalImagesPullingTime="4.486381511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:19.919476687 +0000 UTC m=+40.848486899" watchObservedRunningTime="2026-07-16 22:34:19.920011004 +0000 UTC m=+40.849021215"
Jul 16 22:34:20.913625 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:20.913587    2558 generic.go:356] "Generic (PLEG): container finished" podID="014497b4-af7f-400b-afa8-006ca6fd108a" containerID="0d15e928f40c21cd4badb7f4e24c9f1760cc2ca00c4b8c299d08d7e9751a2cf5" exitCode=0
Jul 16 22:34:20.913995 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:20.913676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" event={"ID":"014497b4-af7f-400b-afa8-006ca6fd108a","Type":"ContainerDied","Data":"0d15e928f40c21cd4badb7f4e24c9f1760cc2ca00c4b8c299d08d7e9751a2cf5"}
Jul 16 22:34:21.667968 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:21.667943    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:21.668133 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:21.668054    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:34:21.668133 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:21.668111    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls podName:5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:29.668093331 +0000 UTC m=+50.597103523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls") pod "dns-default-7jh5n" (UID: "5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0") : secret "dns-default-metrics-tls" not found
Jul 16 22:34:21.918826 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:21.918738    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" event={"ID":"014497b4-af7f-400b-afa8-006ca6fd108a","Type":"ContainerStarted","Data":"15d9249139eaebcc48bab88cb08cd63e4212a429cd7419c26b5eb9327c43f9f1"}
Jul 16 22:34:21.945839 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:21.945792    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hhrpq" podStartSLOduration=8.862620257 podStartE2EDuration="42.945772197s" totalImagesPullingTime="34.08315194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:21.944123738 +0000 UTC m=+42.873133949" watchObservedRunningTime="2026-07-16 22:34:21.945772197 +0000 UTC m=+42.874782409"
Jul 16 22:34:29.728802 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:29.728766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:29.729291 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:29.728873    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:34:29.729291 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:29.728922    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls podName:5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:45.72890888 +0000 UTC m=+66.657919069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls") pod "dns-default-7jh5n" (UID: "5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0") : secret "dns-default-metrics-tls" not found
Jul 16 22:34:40.890833 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:40.890801    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rs44"
Jul 16 22:34:42.896616 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.896578    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-cgjzx"]
Jul 16 22:34:42.899200 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.899171    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bd79486b6-qw72h"]
Jul 16 22:34:42.899356 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.899328    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:42.901126 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.901106    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:42.905549 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.905526    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:34:42.906022 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.905831    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 22:34:42.908447 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.908426    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5zlj4\""
Jul 16 22:34:42.908588 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.908465    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 22:34:42.908692 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.908673    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 22:34:42.908791 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.908735    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9sg5r\""
Jul 16 22:34:42.908791 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.908778    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 22:34:42.908881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.908783    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 22:34:42.908938 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.908924    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 22:34:42.916596 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.916562    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 22:34:42.917016 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.917002    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 22:34:42.918296 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.918277    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-cgjzx"]
Jul 16 22:34:42.921218 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.921198    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bd79486b6-qw72h"]
Jul 16 22:34:42.927760 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.927739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-serving-cert\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:42.927859 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.927777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-bound-sa-token\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:42.927859 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.927810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:42.927966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.927856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-trusted-ca\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:42.927966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.927882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86932345-7b00-4c77-bcab-a00807b64c75-ca-trust-extracted\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:42.927966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.927912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-installation-pull-secrets\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:42.927966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.927931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n78sg\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-kube-api-access-n78sg\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:42.928141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.928004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-trusted-ca\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:42.928141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.928028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-config\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:42.928141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.928045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-registry-certificates\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:42.928141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.928067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrs2f\" (UniqueName: \"kubernetes.io/projected/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-kube-api-access-mrs2f\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:42.928141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:42.928082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-image-registry-private-configuration\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.004749 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.004718    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xwl7q"]
Jul 16 22:34:43.006651 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.006636    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.009375 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.009352    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 22:34:43.009802 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.009778    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 22:34:43.009894 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.009863    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 16 22:34:43.009947 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.009908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gcm6d\""
Jul 16 22:34:43.009982 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.009969    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 16 22:34:43.017938 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.017916    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 16 22:34:43.028676 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.028652    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xwl7q"]
Jul 16 22:34:43.028866 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.028849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-bound-sa-token\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.028917 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.028879    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.028917 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.028896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-trusted-ca\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.028917 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.028911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86932345-7b00-4c77-bcab-a00807b64c75-ca-trust-extracted\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.029049 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.028930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab1b805-ef62-4187-8767-432aaf483b24-service-ca-bundle\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.029049 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.028947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v6q5\" (UniqueName: \"kubernetes.io/projected/6ab1b805-ef62-4187-8767-432aaf483b24-kube-api-access-8v6q5\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.029049 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.028984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-installation-pull-secrets\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.029049 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:43.028989    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:34:43.029049 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:43.029003    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd79486b6-qw72h: secret "image-registry-tls" not found
Jul 16 22:34:43.029049 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n78sg\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-kube-api-access-n78sg\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.029049 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ab1b805-ef62-4187-8767-432aaf483b24-tmp\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.029394 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:43.029066    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls podName:86932345-7b00-4c77-bcab-a00807b64c75 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:43.529048679 +0000 UTC m=+64.458058876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls") pod "image-registry-6bd79486b6-qw72h" (UID: "86932345-7b00-4c77-bcab-a00807b64c75") : secret "image-registry-tls" not found
Jul 16 22:34:43.029394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ab1b805-ef62-4187-8767-432aaf483b24-snapshots\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.029394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab1b805-ef62-4187-8767-432aaf483b24-serving-cert\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.029394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029152    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab1b805-ef62-4187-8767-432aaf483b24-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.029394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-trusted-ca\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.029394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-config\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.029394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-registry-certificates\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.029394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029373    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrs2f\" (UniqueName: \"kubernetes.io/projected/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-kube-api-access-mrs2f\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.029764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029400    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-image-registry-private-configuration\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.029764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86932345-7b00-4c77-bcab-a00807b64c75-ca-trust-extracted\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.029764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-serving-cert\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.029984 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029956    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-config\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.030057 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.029963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-trusted-ca\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.030246 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.030204    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-registry-certificates\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.031318 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.030558    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-trusted-ca\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.032379 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.032357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-serving-cert\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.032608 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.032589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-image-registry-private-configuration\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.032660 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.032612    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-installation-pull-secrets\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.046397 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.046373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-bound-sa-token\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.046513 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.046430    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n78sg\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-kube-api-access-n78sg\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.046513 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.046478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrs2f\" (UniqueName: \"kubernetes.io/projected/1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0-kube-api-access-mrs2f\") pod \"console-operator-565b7b569d-cgjzx\" (UID: \"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0\") " pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.096196 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.096159    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"]
Jul 16 22:34:43.098879 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.098857    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.101335 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.101312    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 16 22:34:43.101441 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.101402    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 16 22:34:43.101624 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.101605    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:34:43.101737 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.101628    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pngdm\""
Jul 16 22:34:43.101877 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.101864    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 16 22:34:43.109605 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.109586    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"]
Jul 16 22:34:43.130518 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130479    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab1b805-ef62-4187-8767-432aaf483b24-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.130685 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ab1b805-ef62-4187-8767-432aaf483b24-snapshots\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.130685 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ab1b805-ef62-4187-8767-432aaf483b24-tmp\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.130685 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130643    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxdvn\" (UniqueName: \"kubernetes.io/projected/e744a60a-81e3-4c27-ad61-53e35a5e9767-kube-api-access-wxdvn\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.130685 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab1b805-ef62-4187-8767-432aaf483b24-service-ca-bundle\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.130901 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130771    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v6q5\" (UniqueName: \"kubernetes.io/projected/6ab1b805-ef62-4187-8767-432aaf483b24-kube-api-access-8v6q5\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.130901 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e744a60a-81e3-4c27-ad61-53e35a5e9767-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.130997 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab1b805-ef62-4187-8767-432aaf483b24-serving-cert\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.130997 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.130940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e744a60a-81e3-4c27-ad61-53e35a5e9767-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.131187 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.131166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ab1b805-ef62-4187-8767-432aaf483b24-tmp\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.131267 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.131212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ab1b805-ef62-4187-8767-432aaf483b24-snapshots\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.131324 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.131270    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab1b805-ef62-4187-8767-432aaf483b24-service-ca-bundle\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.131563 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.131543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab1b805-ef62-4187-8767-432aaf483b24-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.133261 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.133246    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab1b805-ef62-4187-8767-432aaf483b24-serving-cert\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.139645 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.139626    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v6q5\" (UniqueName: \"kubernetes.io/projected/6ab1b805-ef62-4187-8767-432aaf483b24-kube-api-access-8v6q5\") pod \"insights-operator-555d9d7885-xwl7q\" (UID: \"6ab1b805-ef62-4187-8767-432aaf483b24\") " pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.208790 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.208710    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:43.231409 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.231383    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxdvn\" (UniqueName: \"kubernetes.io/projected/e744a60a-81e3-4c27-ad61-53e35a5e9767-kube-api-access-wxdvn\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.231541 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.231447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e744a60a-81e3-4c27-ad61-53e35a5e9767-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.231541 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.231468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e744a60a-81e3-4c27-ad61-53e35a5e9767-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.231932 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.231914    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e744a60a-81e3-4c27-ad61-53e35a5e9767-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.233771 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.233755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e744a60a-81e3-4c27-ad61-53e35a5e9767-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.239772 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.239749    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxdvn\" (UniqueName: \"kubernetes.io/projected/e744a60a-81e3-4c27-ad61-53e35a5e9767-kube-api-access-wxdvn\") pod \"kube-storage-version-migrator-operator-7658d9b749-r8gbt\" (UID: \"e744a60a-81e3-4c27-ad61-53e35a5e9767\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.315571 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.315536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xwl7q"
Jul 16 22:34:43.326701 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.326666    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-cgjzx"]
Jul 16 22:34:43.329610 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:34:43.329578    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7f8336_8974_4e7c_8f8f_8fb94bdc93a0.slice/crio-1f723b6a12d0559dadf71bcdd2ce66aa0f9accec708e69a55c6a4babd682a3f0 WatchSource:0}: Error finding container 1f723b6a12d0559dadf71bcdd2ce66aa0f9accec708e69a55c6a4babd682a3f0: Status 404 returned error can't find the container with id 1f723b6a12d0559dadf71bcdd2ce66aa0f9accec708e69a55c6a4babd682a3f0
Jul 16 22:34:43.407563 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.407531    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"
Jul 16 22:34:43.462283 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.462165    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xwl7q"]
Jul 16 22:34:43.466966 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:34:43.466932    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab1b805_ef62_4187_8767_432aaf483b24.slice/crio-9d872396f9d78974a57726ba3506d67627c4ef78d4491b7efc42e18f5582f1ed WatchSource:0}: Error finding container 9d872396f9d78974a57726ba3506d67627c4ef78d4491b7efc42e18f5582f1ed: Status 404 returned error can't find the container with id 9d872396f9d78974a57726ba3506d67627c4ef78d4491b7efc42e18f5582f1ed
Jul 16 22:34:43.529618 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.529593    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt"]
Jul 16 22:34:43.531864 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:34:43.531837    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode744a60a_81e3_4c27_ad61_53e35a5e9767.slice/crio-71c60bcdc8637d62cb8c2a210e11132b95cebae99e9e66ec075f1585d99b636b WatchSource:0}: Error finding container 71c60bcdc8637d62cb8c2a210e11132b95cebae99e9e66ec075f1585d99b636b: Status 404 returned error can't find the container with id 71c60bcdc8637d62cb8c2a210e11132b95cebae99e9e66ec075f1585d99b636b
Jul 16 22:34:43.533098 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.533079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:43.533251 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:43.533219    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:34:43.533251 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:43.533250    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd79486b6-qw72h: secret "image-registry-tls" not found
Jul 16 22:34:43.533403 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:43.533302    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls podName:86932345-7b00-4c77-bcab-a00807b64c75 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:44.533282348 +0000 UTC m=+65.462292559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls") pod "image-registry-6bd79486b6-qw72h" (UID: "86932345-7b00-4c77-bcab-a00807b64c75") : secret "image-registry-tls" not found
Jul 16 22:34:43.968302 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.968265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt" event={"ID":"e744a60a-81e3-4c27-ad61-53e35a5e9767","Type":"ContainerStarted","Data":"71c60bcdc8637d62cb8c2a210e11132b95cebae99e9e66ec075f1585d99b636b"}
Jul 16 22:34:43.969155 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.969127    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xwl7q" event={"ID":"6ab1b805-ef62-4187-8767-432aaf483b24","Type":"ContainerStarted","Data":"9d872396f9d78974a57726ba3506d67627c4ef78d4491b7efc42e18f5582f1ed"}
Jul 16 22:34:43.970093 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:43.970074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" event={"ID":"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0","Type":"ContainerStarted","Data":"1f723b6a12d0559dadf71bcdd2ce66aa0f9accec708e69a55c6a4babd682a3f0"}
Jul 16 22:34:44.238597 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.238499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:34:44.241270 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.241247    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 22:34:44.249666 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:44.249531    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 22:34:44.249666 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:44.249612    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs podName:f4287831-aa57-4f11-912a-37b9987ba4c0 nodeName:}" failed. No retries permitted until 2026-07-16 22:35:48.249587503 +0000 UTC m=+129.178597708 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs") pod "network-metrics-daemon-pnzj8" (UID: "f4287831-aa57-4f11-912a-37b9987ba4c0") : secret "metrics-daemon-secret" not found
Jul 16 22:34:44.339532 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.339488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:44.343524 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.343502    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 22:34:44.353509 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.353427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a37d336-e886-47b6-a4c0-fe75aa8b94dd-original-pull-secret\") pod \"global-pull-secret-syncer-m8n25\" (UID: \"6a37d336-e886-47b6-a4c0-fe75aa8b94dd\") " pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:44.440038 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.440003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:44.442735 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.442706    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 22:34:44.443938 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.443738    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8n25"
Jul 16 22:34:44.453499 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.453477    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 22:34:44.468152 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.468095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstlb\" (UniqueName: \"kubernetes.io/projected/ff47fd1d-62d4-4c9e-a0b5-56c536ff7610-kube-api-access-fstlb\") pod \"network-check-target-zzqfw\" (UID: \"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610\") " pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:44.541948 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.541323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:44.541948 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:44.541505    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:34:44.541948 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:44.541524    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd79486b6-qw72h: secret "image-registry-tls" not found
Jul 16 22:34:44.541948 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:44.541581    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls podName:86932345-7b00-4c77-bcab-a00807b64c75 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:46.541562812 +0000 UTC m=+67.470573024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls") pod "image-registry-6bd79486b6-qw72h" (UID: "86932345-7b00-4c77-bcab-a00807b64c75") : secret "image-registry-tls" not found
Jul 16 22:34:44.590858 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.589642    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m8n25"]
Jul 16 22:34:44.594426 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:34:44.594390    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a37d336_e886_47b6_a4c0_fe75aa8b94dd.slice/crio-fc70e8c0690556dad44971384b756030d1fc9e4054006543fa3260b03947173d WatchSource:0}: Error finding container fc70e8c0690556dad44971384b756030d1fc9e4054006543fa3260b03947173d: Status 404 returned error can't find the container with id fc70e8c0690556dad44971384b756030d1fc9e4054006543fa3260b03947173d
Jul 16 22:34:44.649087 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.649053    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jdr86\""
Jul 16 22:34:44.659862 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.659798    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:44.815546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.815517    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zzqfw"]
Jul 16 22:34:44.819886 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:34:44.819854    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff47fd1d_62d4_4c9e_a0b5_56c536ff7610.slice/crio-4d56833cf5bb223e2bd7739f96aea5a204aba5cbd3e44a9b85b8ed1795f2e888 WatchSource:0}: Error finding container 4d56833cf5bb223e2bd7739f96aea5a204aba5cbd3e44a9b85b8ed1795f2e888: Status 404 returned error can't find the container with id 4d56833cf5bb223e2bd7739f96aea5a204aba5cbd3e44a9b85b8ed1795f2e888
Jul 16 22:34:44.975215 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.975175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zzqfw" event={"ID":"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610","Type":"ContainerStarted","Data":"4d56833cf5bb223e2bd7739f96aea5a204aba5cbd3e44a9b85b8ed1795f2e888"}
Jul 16 22:34:44.976532 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:44.976500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m8n25" event={"ID":"6a37d336-e886-47b6-a4c0-fe75aa8b94dd","Type":"ContainerStarted","Data":"fc70e8c0690556dad44971384b756030d1fc9e4054006543fa3260b03947173d"}
Jul 16 22:34:45.752000 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:45.751962    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:34:45.752271 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:45.752148    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:34:45.752345 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:45.752299    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls podName:5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0 nodeName:}" failed. No retries permitted until 2026-07-16 22:35:17.752246979 +0000 UTC m=+98.681257184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls") pod "dns-default-7jh5n" (UID: "5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0") : secret "dns-default-metrics-tls" not found
Jul 16 22:34:46.558828 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:46.558771    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:46.559315 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:46.558939    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:34:46.559315 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:46.558961    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd79486b6-qw72h: secret "image-registry-tls" not found
Jul 16 22:34:46.559315 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:46.559036    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls podName:86932345-7b00-4c77-bcab-a00807b64c75 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:50.559013031 +0000 UTC m=+71.488023240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls") pod "image-registry-6bd79486b6-qw72h" (UID: "86932345-7b00-4c77-bcab-a00807b64c75") : secret "image-registry-tls" not found
Jul 16 22:34:47.674876 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.674844    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"]
Jul 16 22:34:47.677857 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.677831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"
Jul 16 22:34:47.681973 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.681947    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 22:34:47.682095 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.681970    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 22:34:47.682095 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.682027    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qcv2l\""
Jul 16 22:34:47.682290 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.682273    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 22:34:47.682508 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.682492    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 22:34:47.696475 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.696447    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"]
Jul 16 22:34:47.769414 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.769380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ae037af-fea2-4851-8107-3fed98d4eef5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55cbdbb494-kgffv\" (UID: \"6ae037af-fea2-4851-8107-3fed98d4eef5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"
Jul 16 22:34:47.769587 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.769439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fflr2\" (UniqueName: \"kubernetes.io/projected/6ae037af-fea2-4851-8107-3fed98d4eef5-kube-api-access-fflr2\") pod \"managed-serviceaccount-addon-agent-55cbdbb494-kgffv\" (UID: \"6ae037af-fea2-4851-8107-3fed98d4eef5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"
Jul 16 22:34:47.870278 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.870219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ae037af-fea2-4851-8107-3fed98d4eef5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55cbdbb494-kgffv\" (UID: \"6ae037af-fea2-4851-8107-3fed98d4eef5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"
Jul 16 22:34:47.870467 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.870327    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fflr2\" (UniqueName: \"kubernetes.io/projected/6ae037af-fea2-4851-8107-3fed98d4eef5-kube-api-access-fflr2\") pod \"managed-serviceaccount-addon-agent-55cbdbb494-kgffv\" (UID: \"6ae037af-fea2-4851-8107-3fed98d4eef5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"
Jul 16 22:34:47.873110 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.873082    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ae037af-fea2-4851-8107-3fed98d4eef5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55cbdbb494-kgffv\" (UID: \"6ae037af-fea2-4851-8107-3fed98d4eef5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"
Jul 16 22:34:47.880651 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:47.880626    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fflr2\" (UniqueName: \"kubernetes.io/projected/6ae037af-fea2-4851-8107-3fed98d4eef5-kube-api-access-fflr2\") pod \"managed-serviceaccount-addon-agent-55cbdbb494-kgffv\" (UID: \"6ae037af-fea2-4851-8107-3fed98d4eef5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"
Jul 16 22:34:48.004816 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:48.004721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"
Jul 16 22:34:49.656174 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.656142    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv"]
Jul 16 22:34:49.993124 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.993093    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/0.log"
Jul 16 22:34:49.993318 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.993143    2558 generic.go:356] "Generic (PLEG): container finished" podID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0" containerID="1cad5d31ad046ca49e2a06d88fe008084b3f74b3e9c860c4b4ff98329008c34d" exitCode=255
Jul 16 22:34:49.993318 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.993260    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" event={"ID":"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0","Type":"ContainerDied","Data":"1cad5d31ad046ca49e2a06d88fe008084b3f74b3e9c860c4b4ff98329008c34d"}
Jul 16 22:34:49.993591 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.993570    2558 scope.go:117] "RemoveContainer" containerID="1cad5d31ad046ca49e2a06d88fe008084b3f74b3e9c860c4b4ff98329008c34d"
Jul 16 22:34:49.996109 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.995188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zzqfw" event={"ID":"ff47fd1d-62d4-4c9e-a0b5-56c536ff7610","Type":"ContainerStarted","Data":"76fff0409a0f480796a5ed0343b04bb2ad200eb2b1e9e2564df820c332ad4d7d"}
Jul 16 22:34:49.996109 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.995259    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:34:49.996874 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.996853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m8n25" event={"ID":"6a37d336-e886-47b6-a4c0-fe75aa8b94dd","Type":"ContainerStarted","Data":"27286d2620f5b539317c851459caba7e5c17e5c6b2ae61d850bfd4055dd98899"}
Jul 16 22:34:49.998031 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.998008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv" event={"ID":"6ae037af-fea2-4851-8107-3fed98d4eef5","Type":"ContainerStarted","Data":"6d4e41d54657389661259c4f7745edf715265f10481280aa0c79f9471a11c3a5"}
Jul 16 22:34:49.999614 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:49.999591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt" event={"ID":"e744a60a-81e3-4c27-ad61-53e35a5e9767","Type":"ContainerStarted","Data":"f8dd75a8f1034948787eb6c5168185a12ae100985b9ecdf42b36704ac56362f2"}
Jul 16 22:34:50.001267 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:50.001243    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xwl7q" event={"ID":"6ab1b805-ef62-4187-8767-432aaf483b24","Type":"ContainerStarted","Data":"67caa19f7c044284838c80b1a22ffd9574c8e55129c996f44c49115d7f496a72"}
Jul 16 22:34:50.034871 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:50.034815    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m8n25" podStartSLOduration=66.11278677 podStartE2EDuration="1m11.034798403s" totalImagesPullingTime="4.922011633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:50.03472258 +0000 UTC m=+70.963732793" watchObservedRunningTime="2026-07-16 22:34:50.034798403 +0000 UTC m=+70.963808604"
Jul 16 22:34:50.079392 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:50.079343    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zzqfw" podStartSLOduration=66.389280679 podStartE2EDuration="1m11.079323714s" totalImagesPullingTime="4.690043035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:50.07901008 +0000 UTC m=+71.008020290" watchObservedRunningTime="2026-07-16 22:34:50.079323714 +0000 UTC m=+71.008333922"
Jul 16 22:34:50.079552 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:50.079519    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt" podStartSLOduration=1.114058825 podStartE2EDuration="7.079512024s" totalImagesPullingTime="5.965453199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:50.057261771 +0000 UTC m=+70.986271983" watchObservedRunningTime="2026-07-16 22:34:50.079512024 +0000 UTC m=+71.008522235"
Jul 16 22:34:50.102090 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:50.102037    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-xwl7q" podStartSLOduration=2.071769398 podStartE2EDuration="8.1020174s" totalImagesPullingTime="6.030248002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:50.101838197 +0000 UTC m=+71.030848407" watchObservedRunningTime="2026-07-16 22:34:50.1020174 +0000 UTC m=+71.031027612"
Jul 16 22:34:50.594990 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:50.594424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:50.594990 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:50.594555    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:34:50.594990 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:50.594569    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd79486b6-qw72h: secret "image-registry-tls" not found
Jul 16 22:34:50.594990 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:50.594636    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls podName:86932345-7b00-4c77-bcab-a00807b64c75 nodeName:}" failed. No retries permitted until 2026-07-16 22:34:58.594617524 +0000 UTC m=+79.523627714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls") pod "image-registry-6bd79486b6-qw72h" (UID: "86932345-7b00-4c77-bcab-a00807b64c75") : secret "image-registry-tls" not found
Jul 16 22:34:51.005834 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:51.005808    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/1.log"
Jul 16 22:34:51.006258 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:51.006210    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/0.log"
Jul 16 22:34:51.006304 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:51.006263    2558 generic.go:356] "Generic (PLEG): container finished" podID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0" containerID="7274fc935768e68c707120cf33459d302a7331fe08a1f951ab9fb6f237d26878" exitCode=255
Jul 16 22:34:51.006415 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:51.006391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" event={"ID":"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0","Type":"ContainerDied","Data":"7274fc935768e68c707120cf33459d302a7331fe08a1f951ab9fb6f237d26878"}
Jul 16 22:34:51.006477 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:51.006457    2558 scope.go:117] "RemoveContainer" containerID="1cad5d31ad046ca49e2a06d88fe008084b3f74b3e9c860c4b4ff98329008c34d"
Jul 16 22:34:51.006818 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:51.006798    2558 scope.go:117] "RemoveContainer" containerID="7274fc935768e68c707120cf33459d302a7331fe08a1f951ab9fb6f237d26878"
Jul 16 22:34:51.007038 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:51.006967    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-cgjzx_openshift-console-operator(1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" podUID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0"
Jul 16 22:34:52.010592 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:52.010559    2558 scope.go:117] "RemoveContainer" containerID="7274fc935768e68c707120cf33459d302a7331fe08a1f951ab9fb6f237d26878"
Jul 16 22:34:52.011057 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:52.010761    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-cgjzx_openshift-console-operator(1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" podUID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0"
Jul 16 22:34:53.015004 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:53.014972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv" event={"ID":"6ae037af-fea2-4851-8107-3fed98d4eef5","Type":"ContainerStarted","Data":"895ab9d38da7ad513e977d643dd94f3dfc9f86c4c153c5c54d7688b84ea0f4ff"}
Jul 16 22:34:53.016390 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:53.016371    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/1.log"
Jul 16 22:34:53.033509 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:53.033467    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55cbdbb494-kgffv" podStartSLOduration=3.582569201 podStartE2EDuration="6.033454862s" totalImagesPullingTime="2.450885661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:53.032044991 +0000 UTC m=+73.961055201" watchObservedRunningTime="2026-07-16 22:34:53.033454862 +0000 UTC m=+73.962465072"
Jul 16 22:34:53.209315 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:53.209281    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:53.209473 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:53.209361    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:34:53.209694 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:53.209683    2558 scope.go:117] "RemoveContainer" containerID="7274fc935768e68c707120cf33459d302a7331fe08a1f951ab9fb6f237d26878"
Jul 16 22:34:53.209838 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:34:53.209822    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-cgjzx_openshift-console-operator(1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" podUID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0"
Jul 16 22:34:53.297498 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:53.297428    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrw6w_b5da05d4-9309-40a2-a2ab-43fbb2c63859/dns-node-resolver/0.log"
Jul 16 22:34:53.887666 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:53.887637    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j4qct_bc7b511c-af30-4554-9347-47544e8bd562/node-ca/0.log"
Jul 16 22:34:55.088409 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:55.088374    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jkthp_6df31ee4-5386-4a49-b372-97a5955ce5d5/serve-healthcheck-canary/0.log"
Jul 16 22:34:58.655393 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:58.655347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:58.657895 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:58.657869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"image-registry-6bd79486b6-qw72h\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") " pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:58.814089 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:58.814056    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:58.943587 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:58.943563    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bd79486b6-qw72h"]
Jul 16 22:34:58.945774 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:34:58.945745    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86932345_7b00_4c77_bcab_a00807b64c75.slice/crio-f33f12d655620cbc421bad22370bd4c2e1845718bc3a6d336fb25478c1952d53 WatchSource:0}: Error finding container f33f12d655620cbc421bad22370bd4c2e1845718bc3a6d336fb25478c1952d53: Status 404 returned error can't find the container with id f33f12d655620cbc421bad22370bd4c2e1845718bc3a6d336fb25478c1952d53
Jul 16 22:34:59.033764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:59.033737    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h" event={"ID":"86932345-7b00-4c77-bcab-a00807b64c75","Type":"ContainerStarted","Data":"bec6b226ed5fa4a237dfe34f34b83a26c27ff47232824d0fe9d0f446f56fdb92"}
Jul 16 22:34:59.033883 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:59.033779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h" event={"ID":"86932345-7b00-4c77-bcab-a00807b64c75","Type":"ContainerStarted","Data":"f33f12d655620cbc421bad22370bd4c2e1845718bc3a6d336fb25478c1952d53"}
Jul 16 22:34:59.033883 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:59.033862    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:34:59.053475 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:34:59.053437    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h" podStartSLOduration=17.053422555 podStartE2EDuration="17.053422555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:59.052999443 +0000 UTC m=+79.982009654" watchObservedRunningTime="2026-07-16 22:34:59.053422555 +0000 UTC m=+79.982432766"
Jul 16 22:35:06.629406 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:06.629303    2558 scope.go:117] "RemoveContainer" containerID="7274fc935768e68c707120cf33459d302a7331fe08a1f951ab9fb6f237d26878"
Jul 16 22:35:07.060428 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:07.060354    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:35:07.060765 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:07.060750    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/1.log"
Jul 16 22:35:07.060865 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:07.060784    2558 generic.go:356] "Generic (PLEG): container finished" podID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0" containerID="e4928eafe1677a68800839471c71ea747beed705cb69f9750717e707faadfc29" exitCode=255
Jul 16 22:35:07.060901 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:07.060859    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" event={"ID":"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0","Type":"ContainerDied","Data":"e4928eafe1677a68800839471c71ea747beed705cb69f9750717e707faadfc29"}
Jul 16 22:35:07.060934 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:07.060914    2558 scope.go:117] "RemoveContainer" containerID="7274fc935768e68c707120cf33459d302a7331fe08a1f951ab9fb6f237d26878"
Jul 16 22:35:07.061273 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:07.061258    2558 scope.go:117] "RemoveContainer" containerID="e4928eafe1677a68800839471c71ea747beed705cb69f9750717e707faadfc29"
Jul 16 22:35:07.061433 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:35:07.061407    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-cgjzx_openshift-console-operator(1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" podUID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0"
Jul 16 22:35:08.065246 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:08.065206    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:35:11.041779 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.041741    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"]
Jul 16 22:35:11.045666 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.045649    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6c2l2"]
Jul 16 22:35:11.045778 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.045759    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"
Jul 16 22:35:11.048739 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.048719    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lljgc\""
Jul 16 22:35:11.048859 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.048754    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 22:35:11.048912 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.048883    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.050453 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.050432    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 22:35:11.052498 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.052473    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 22:35:11.052618 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.052563    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 22:35:11.052618 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.052595    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lklv7\""
Jul 16 22:35:11.062042 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.062022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"]
Jul 16 22:35:11.063244 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.063211    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6c2l2"]
Jul 16 22:35:11.092000 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.091972    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bd79486b6-qw72h"]
Jul 16 22:35:11.142610 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.142578    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-577478c94f-k25qh"]
Jul 16 22:35:11.145586 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.145566    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.153151 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.153128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/160d33fa-8dbe-4360-a201-1adce47a7417-data-volume\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.153272 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.153161    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/160d33fa-8dbe-4360-a201-1adce47a7417-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.153272 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.153187    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzf26\" (UniqueName: \"kubernetes.io/projected/160d33fa-8dbe-4360-a201-1adce47a7417-kube-api-access-lzf26\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.153353 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.153267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1998c5f-2a47-4838-b991-bbf5bfc41a1f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wkn9c\" (UID: \"b1998c5f-2a47-4838-b991-bbf5bfc41a1f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"
Jul 16 22:35:11.153353 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.153333    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/160d33fa-8dbe-4360-a201-1adce47a7417-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.153422 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.153354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/160d33fa-8dbe-4360-a201-1adce47a7417-crio-socket\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.153422 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.153369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1998c5f-2a47-4838-b991-bbf5bfc41a1f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wkn9c\" (UID: \"b1998c5f-2a47-4838-b991-bbf5bfc41a1f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"
Jul 16 22:35:11.160890 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.160869    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-577478c94f-k25qh"]
Jul 16 22:35:11.253709 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ab20305-7311-444e-998e-6be83cb25f36-trusted-ca\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.253709 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/160d33fa-8dbe-4360-a201-1adce47a7417-data-volume\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ab20305-7311-444e-998e-6be83cb25f36-image-registry-private-configuration\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/160d33fa-8dbe-4360-a201-1adce47a7417-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253780    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzf26\" (UniqueName: \"kubernetes.io/projected/160d33fa-8dbe-4360-a201-1adce47a7417-kube-api-access-lzf26\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253797    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1998c5f-2a47-4838-b991-bbf5bfc41a1f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wkn9c\" (UID: \"b1998c5f-2a47-4838-b991-bbf5bfc41a1f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42cwp\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-kube-api-access-42cwp\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ab20305-7311-444e-998e-6be83cb25f36-installation-pull-secrets\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ab20305-7311-444e-998e-6be83cb25f36-ca-trust-extracted\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/160d33fa-8dbe-4360-a201-1adce47a7417-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.253939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253933    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ab20305-7311-444e-998e-6be83cb25f36-registry-certificates\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.254332 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-registry-tls\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.254332 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.253983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/160d33fa-8dbe-4360-a201-1adce47a7417-crio-socket\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.254332 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.254000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1998c5f-2a47-4838-b991-bbf5bfc41a1f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wkn9c\" (UID: \"b1998c5f-2a47-4838-b991-bbf5bfc41a1f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"
Jul 16 22:35:11.254332 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.254016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-bound-sa-token\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.254332 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.254084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/160d33fa-8dbe-4360-a201-1adce47a7417-data-volume\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.254332 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.254088    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/160d33fa-8dbe-4360-a201-1adce47a7417-crio-socket\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.254526 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.254477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/160d33fa-8dbe-4360-a201-1adce47a7417-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.254923 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.254902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1998c5f-2a47-4838-b991-bbf5bfc41a1f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wkn9c\" (UID: \"b1998c5f-2a47-4838-b991-bbf5bfc41a1f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"
Jul 16 22:35:11.256306 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.256285    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/160d33fa-8dbe-4360-a201-1adce47a7417-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.256385 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.256372    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1998c5f-2a47-4838-b991-bbf5bfc41a1f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wkn9c\" (UID: \"b1998c5f-2a47-4838-b991-bbf5bfc41a1f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"
Jul 16 22:35:11.274506 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.274484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzf26\" (UniqueName: \"kubernetes.io/projected/160d33fa-8dbe-4360-a201-1adce47a7417-kube-api-access-lzf26\") pod \"insights-runtime-extractor-6c2l2\" (UID: \"160d33fa-8dbe-4360-a201-1adce47a7417\") " pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.354442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ab20305-7311-444e-998e-6be83cb25f36-installation-pull-secrets\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.354442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ab20305-7311-444e-998e-6be83cb25f36-ca-trust-extracted\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.354442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ab20305-7311-444e-998e-6be83cb25f36-registry-certificates\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.354442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-registry-tls\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.354732 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-bound-sa-token\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.354732 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ab20305-7311-444e-998e-6be83cb25f36-trusted-ca\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.354732 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ab20305-7311-444e-998e-6be83cb25f36-image-registry-private-configuration\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.354900 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42cwp\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-kube-api-access-42cwp\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.354900 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.354802    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ab20305-7311-444e-998e-6be83cb25f36-ca-trust-extracted\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.355352 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.355306    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ab20305-7311-444e-998e-6be83cb25f36-registry-certificates\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.355887 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.355865    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ab20305-7311-444e-998e-6be83cb25f36-trusted-ca\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.356745 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.356720    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"
Jul 16 22:35:11.357100 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.357079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ab20305-7311-444e-998e-6be83cb25f36-image-registry-private-configuration\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.357141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.357090    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ab20305-7311-444e-998e-6be83cb25f36-installation-pull-secrets\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.357141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.357122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-registry-tls\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.362896 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.362877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6c2l2"
Jul 16 22:35:11.378711 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.378678    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-bound-sa-token\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.387605 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.387581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42cwp\" (UniqueName: \"kubernetes.io/projected/3ab20305-7311-444e-998e-6be83cb25f36-kube-api-access-42cwp\") pod \"image-registry-577478c94f-k25qh\" (UID: \"3ab20305-7311-444e-998e-6be83cb25f36\") " pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.453573 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.453539    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:11.533945 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.533906    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c"]
Jul 16 22:35:11.541051 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:11.541020    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1998c5f_2a47_4838_b991_bbf5bfc41a1f.slice/crio-2e708ff8648ccc0535646ba72550e4cbfc4b04c08e0e741fa2fbb6d3b28c087e WatchSource:0}: Error finding container 2e708ff8648ccc0535646ba72550e4cbfc4b04c08e0e741fa2fbb6d3b28c087e: Status 404 returned error can't find the container with id 2e708ff8648ccc0535646ba72550e4cbfc4b04c08e0e741fa2fbb6d3b28c087e
Jul 16 22:35:11.574278 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:11.574250    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160d33fa_8dbe_4360_a201_1adce47a7417.slice/crio-33d060b009e1967a109fdc825a502e3dc1a27e7559be8e58f360a51556c14079 WatchSource:0}: Error finding container 33d060b009e1967a109fdc825a502e3dc1a27e7559be8e58f360a51556c14079: Status 404 returned error can't find the container with id 33d060b009e1967a109fdc825a502e3dc1a27e7559be8e58f360a51556c14079
Jul 16 22:35:11.574988 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.574963    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6c2l2"]
Jul 16 22:35:11.602747 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:11.602720    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-577478c94f-k25qh"]
Jul 16 22:35:11.604039 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:11.604010    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab20305_7311_444e_998e_6be83cb25f36.slice/crio-25c0dff41c62bd133bfbe81e73d59fe845c2ea8f27aca87061307d429174dfc4 WatchSource:0}: Error finding container 25c0dff41c62bd133bfbe81e73d59fe845c2ea8f27aca87061307d429174dfc4: Status 404 returned error can't find the container with id 25c0dff41c62bd133bfbe81e73d59fe845c2ea8f27aca87061307d429174dfc4
Jul 16 22:35:12.080658 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:12.080613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c" event={"ID":"b1998c5f-2a47-4838-b991-bbf5bfc41a1f","Type":"ContainerStarted","Data":"2e708ff8648ccc0535646ba72550e4cbfc4b04c08e0e741fa2fbb6d3b28c087e"}
Jul 16 22:35:12.082089 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:12.082053    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c2l2" event={"ID":"160d33fa-8dbe-4360-a201-1adce47a7417","Type":"ContainerStarted","Data":"33d060b009e1967a109fdc825a502e3dc1a27e7559be8e58f360a51556c14079"}
Jul 16 22:35:12.085118 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:12.084535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-577478c94f-k25qh" event={"ID":"3ab20305-7311-444e-998e-6be83cb25f36","Type":"ContainerStarted","Data":"94a35275936ab08b79ecf52aa44b8560f5569438825323120a65aac44b513f5e"}
Jul 16 22:35:12.085118 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:12.084577    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-577478c94f-k25qh" event={"ID":"3ab20305-7311-444e-998e-6be83cb25f36","Type":"ContainerStarted","Data":"25c0dff41c62bd133bfbe81e73d59fe845c2ea8f27aca87061307d429174dfc4"}
Jul 16 22:35:12.085118 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:12.085063    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:13.091487 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:13.091447    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c" event={"ID":"b1998c5f-2a47-4838-b991-bbf5bfc41a1f","Type":"ContainerStarted","Data":"c0f1457da7cdf2ffd43755319e7de8726726e3ef6500d8cfd6a84d23232da1a3"}
Jul 16 22:35:13.119783 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:13.119680    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-577478c94f-k25qh" podStartSLOduration=2.119661689 podStartE2EDuration="2.119661689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:12.107805772 +0000 UTC m=+93.036815997" watchObservedRunningTime="2026-07-16 22:35:13.119661689 +0000 UTC m=+94.048671896"
Jul 16 22:35:13.120185 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:13.120149    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wkn9c" podStartSLOduration=0.795696197 podStartE2EDuration="2.12014171s" totalImagesPullingTime="1.324445513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:13.117907108 +0000 UTC m=+94.046917320" watchObservedRunningTime="2026-07-16 22:35:13.12014171 +0000 UTC m=+94.049151921"
Jul 16 22:35:13.209507 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:13.209476    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:35:13.209667 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:13.209531    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:35:13.209888 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:13.209870    2558 scope.go:117] "RemoveContainer" containerID="e4928eafe1677a68800839471c71ea747beed705cb69f9750717e707faadfc29"
Jul 16 22:35:13.210104 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:35:13.210063    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-cgjzx_openshift-console-operator(1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" podUID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0"
Jul 16 22:35:17.105025 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:17.104976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c2l2" event={"ID":"160d33fa-8dbe-4360-a201-1adce47a7417","Type":"ContainerStarted","Data":"4fc3a686e302bfab7d721b8396ac0d2ed690e31c81e9a01dbd7a18e0edfd4562"}
Jul 16 22:35:17.808335 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:17.808297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:35:17.811119 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:17.811089    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0-metrics-tls\") pod \"dns-default-7jh5n\" (UID: \"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0\") " pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:35:17.861081 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:17.861048    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-57zhl\""
Jul 16 22:35:17.869004 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:17.868973    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:35:18.017732 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:18.017698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7jh5n"]
Jul 16 22:35:18.021658 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:18.021628    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2937b1_f8b2_48c3_adbb_fc680c5a7fb0.slice/crio-1279f92577a8567a2a736b56c60bc089248894d7fc4bfe7c5d6418e47b0bfcde WatchSource:0}: Error finding container 1279f92577a8567a2a736b56c60bc089248894d7fc4bfe7c5d6418e47b0bfcde: Status 404 returned error can't find the container with id 1279f92577a8567a2a736b56c60bc089248894d7fc4bfe7c5d6418e47b0bfcde
Jul 16 22:35:18.109572 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:18.109483    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jh5n" event={"ID":"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0","Type":"ContainerStarted","Data":"1279f92577a8567a2a736b56c60bc089248894d7fc4bfe7c5d6418e47b0bfcde"}
Jul 16 22:35:21.009831 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.009802    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zzqfw"
Jul 16 22:35:21.097581 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.097539    2558 patch_prober.go:28] interesting pod/image-registry-6bd79486b6-qw72h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 22:35:21.097725 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.097593    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h" podUID="86932345-7b00-4c77-bcab-a00807b64c75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:35:21.123962 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.123921    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c2l2" event={"ID":"160d33fa-8dbe-4360-a201-1adce47a7417","Type":"ContainerStarted","Data":"b45a43a799b00a06105a2c0edc677e9786c5aca4eb369b9d56a3615d92aba93e"}
Jul 16 22:35:21.693140 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.693102    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"]
Jul 16 22:35:21.716219 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.716187    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"]
Jul 16 22:35:21.716411 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.716261    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"]
Jul 16 22:35:21.716411 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.716300    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.720820 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.720780    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 22:35:21.720973 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.720830    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 22:35:21.720973 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.720830    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 22:35:21.720973 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.720963    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 22:35:21.721158 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.721025    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jt9g8\""
Jul 16 22:35:21.721284 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.721274    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 22:35:21.731721 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.731657    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"]
Jul 16 22:35:21.731840 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.731738    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.735048 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.735027    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4cfz6\""
Jul 16 22:35:21.735175 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.735075    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 16 22:35:21.735175 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.735148    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 16 22:35:21.735472 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.735449    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 16 22:35:21.772697 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.772665    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9k29q"]
Jul 16 22:35:21.794146 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.794057    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.797376 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.797342    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xww28\""
Jul 16 22:35:21.797655 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.797631    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 22:35:21.797781 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.797631    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 22:35:21.797781 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.797640    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 22:35:21.846809 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.846765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eff28caa-2385-4d5f-baa2-590a0f6dcac2-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.846994 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.846833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eff28caa-2385-4d5f-baa2-590a0f6dcac2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.846994 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.846913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba6b66be-1449-4915-862d-812ed7816050-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.846994 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.846947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxsqd\" (UniqueName: \"kubernetes.io/projected/ba6b66be-1449-4915-862d-812ed7816050-kube-api-access-dxsqd\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.847166 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.847023    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6b66be-1449-4915-862d-812ed7816050-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.847166 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.847057    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.847166 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.847097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.847166 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.847155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94gps\" (UniqueName: \"kubernetes.io/projected/eff28caa-2385-4d5f-baa2-590a0f6dcac2-kube-api-access-94gps\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.847428 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.847214    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.847428 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.847272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eff28caa-2385-4d5f-baa2-590a0f6dcac2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.948590 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.948551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.948764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.948596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94gps\" (UniqueName: \"kubernetes.io/projected/eff28caa-2385-4d5f-baa2-590a0f6dcac2-kube-api-access-94gps\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.948764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.948621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-root\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.948764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.948656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.948764 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.948683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.948966 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:35:21.948771    2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 16 22:35:21.948966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.948773    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95464aa-919b-47a1-a3f5-37a91faa1643-metrics-client-ca\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.948966 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:35:21.948833    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-tls podName:ba6b66be-1449-4915-862d-812ed7816050 nodeName:}" failed. No retries permitted until 2026-07-16 22:35:22.448814999 +0000 UTC m=+103.377825194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-5z5vp" (UID: "ba6b66be-1449-4915-862d-812ed7816050") : secret "kube-state-metrics-tls" not found
Jul 16 22:35:21.948966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.948851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eff28caa-2385-4d5f-baa2-590a0f6dcac2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.949161 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eff28caa-2385-4d5f-baa2-590a0f6dcac2-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.949161 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eff28caa-2385-4d5f-baa2-590a0f6dcac2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.949161 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949089    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba6b66be-1449-4915-862d-812ed7816050-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.949161 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxsqd\" (UniqueName: \"kubernetes.io/projected/ba6b66be-1449-4915-862d-812ed7816050-kube-api-access-dxsqd\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.949161 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlp9k\" (UniqueName: \"kubernetes.io/projected/f95464aa-919b-47a1-a3f5-37a91faa1643-kube-api-access-mlp9k\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.949444 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-textfile\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.949444 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-tls\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.949444 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6b66be-1449-4915-862d-812ed7816050-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.949444 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949225    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.949444 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.949444 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-wtmp\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.949444 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-sys\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:21.949864 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eff28caa-2385-4d5f-baa2-590a0f6dcac2-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.950007 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.949990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6b66be-1449-4915-862d-812ed7816050-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.950267 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.950189    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.950870 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.950781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba6b66be-1449-4915-862d-812ed7816050-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.952486 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.952453    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eff28caa-2385-4d5f-baa2-590a0f6dcac2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.952574 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.952518    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eff28caa-2385-4d5f-baa2-590a0f6dcac2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.952949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.952929    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:21.958845 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.958822    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94gps\" (UniqueName: \"kubernetes.io/projected/eff28caa-2385-4d5f-baa2-590a0f6dcac2-kube-api-access-94gps\") pod \"openshift-state-metrics-79f6958cdf-rs6j2\" (UID: \"eff28caa-2385-4d5f-baa2-590a0f6dcac2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:21.959264 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:21.959217    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxsqd\" (UniqueName: \"kubernetes.io/projected/ba6b66be-1449-4915-862d-812ed7816050-kube-api-access-dxsqd\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:22.028121 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.028080    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"
Jul 16 22:35:22.050395 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050320    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-textfile\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050395 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-tls\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-wtmp\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-sys\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050453    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-root\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95464aa-919b-47a1-a3f5-37a91faa1643-metrics-client-ca\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-sys\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlp9k\" (UniqueName: \"kubernetes.io/projected/f95464aa-919b-47a1-a3f5-37a91faa1643-kube-api-access-mlp9k\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:35:22.050639    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 22:35:22.050661 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-root\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.051138 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050678    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-wtmp\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.051138 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.050680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-textfile\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.051138 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:35:22.050704    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-tls podName:f95464aa-919b-47a1-a3f5-37a91faa1643 nodeName:}" failed. No retries permitted until 2026-07-16 22:35:22.550683409 +0000 UTC m=+103.479693618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-tls") pod "node-exporter-9k29q" (UID: "f95464aa-919b-47a1-a3f5-37a91faa1643") : secret "node-exporter-tls" not found
Jul 16 22:35:22.051335 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.051204    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.051395 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.051359    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95464aa-919b-47a1-a3f5-37a91faa1643-metrics-client-ca\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.053454 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.053427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.059972 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.059948    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlp9k\" (UniqueName: \"kubernetes.io/projected/f95464aa-919b-47a1-a3f5-37a91faa1643-kube-api-access-mlp9k\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.154470 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.154430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jh5n" event={"ID":"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0","Type":"ContainerStarted","Data":"1a2af9936a2024cd0b0dc58f100daca44988cc9de2aac76a833035f79941baab"}
Jul 16 22:35:22.154636 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.154497    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jh5n" event={"ID":"5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0","Type":"ContainerStarted","Data":"f405be0dfbe3e26d3f7af743aa55a281e2fbf4b4c22a1a1fa47eb38faf5078fe"}
Jul 16 22:35:22.155396 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.155321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:35:22.173794 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.173682    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7jh5n" podStartSLOduration=65.933863386 podStartE2EDuration="1m9.173658842s" totalImagesPullingTime="3.239795456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:22.17196171 +0000 UTC m=+103.100971933" watchObservedRunningTime="2026-07-16 22:35:22.173658842 +0000 UTC m=+103.102669058"
Jul 16 22:35:22.234613 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.234581    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2"]
Jul 16 22:35:22.238350 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:22.238316    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff28caa_2385_4d5f_baa2_590a0f6dcac2.slice/crio-c46b04c8fb2120aa707cb9ab4ad5dced7bf41c373340a4b09c55b7f06e24ed43 WatchSource:0}: Error finding container c46b04c8fb2120aa707cb9ab4ad5dced7bf41c373340a4b09c55b7f06e24ed43: Status 404 returned error can't find the container with id c46b04c8fb2120aa707cb9ab4ad5dced7bf41c373340a4b09c55b7f06e24ed43
Jul 16 22:35:22.454317 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.454287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:22.457253 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.457213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba6b66be-1449-4915-862d-812ed7816050-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-5z5vp\" (UID: \"ba6b66be-1449-4915-862d-812ed7816050\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:22.555823 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.555701    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-tls\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.558606 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.558572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f95464aa-919b-47a1-a3f5-37a91faa1643-node-exporter-tls\") pod \"node-exporter-9k29q\" (UID: \"f95464aa-919b-47a1-a3f5-37a91faa1643\") " pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.643383 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.643353    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"
Jul 16 22:35:22.699005 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.698975    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:35:22.705252 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.705213    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k29q"
Jul 16 22:35:22.716020 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.715992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.719483 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.719212    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:35:22.719483 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.719311    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 22:35:22.719483 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.719323    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 22:35:22.719483 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.719369    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 22:35:22.719483 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.719397    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 22:35:22.719483 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.719448    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 22:35:22.719823 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.719579    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 22:35:22.720579 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.720071    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 22:35:22.720579 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.720269    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4hk78\""
Jul 16 22:35:22.720579 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.720401    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 22:35:22.720579 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.720457    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 22:35:22.857567 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.857773 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.857773 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-web-config\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.857952 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.857952 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857805    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.857952 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.857952 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-out\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.857952 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.858186 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.858186 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.857992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.858186 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.858016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nbb5\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-kube-api-access-5nbb5\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.858186 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.858046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.858186 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.858111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.958929 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.958773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.958929 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.958845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.958929 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.958875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-web-config\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.958929 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.958930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959274 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959274 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-out\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959372    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959585 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nbb5\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-kube-api-access-5nbb5\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959585 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959585 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.959456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.959889 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:35:22.959627    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle podName:ce612c2b-561e-43e1-a77f-b9c46a39bd80 nodeName:}" failed. No retries permitted until 2026-07-16 22:35:23.459597085 +0000 UTC m=+104.388607291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80") : configmap references non-existent config key: ca-bundle.crt
Jul 16 22:35:22.960170 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.960146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.960435 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.960411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.963683 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.962619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-web-config\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.963683 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.963216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.963683 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.963633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-out\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.964403 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.964357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.964742 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.964644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.964823 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.964760    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.964823 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.964789    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.965393 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.965373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.965533 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.965517    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:22.970340 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:22.970318    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nbb5\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-kube-api-access-5nbb5\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:23.159754 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:23.159721    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2" event={"ID":"eff28caa-2385-4d5f-baa2-590a0f6dcac2","Type":"ContainerStarted","Data":"c8c445205cafc82032557694eb47e5e7682be1dd1636734040f8eba8d3999de4"}
Jul 16 22:35:23.160182 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:23.159817    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2" event={"ID":"eff28caa-2385-4d5f-baa2-590a0f6dcac2","Type":"ContainerStarted","Data":"a3e46c8f77011ce294985d944f8163492cc51a4950cf71241e87aa5ee00745db"}
Jul 16 22:35:23.160182 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:23.159842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2" event={"ID":"eff28caa-2385-4d5f-baa2-590a0f6dcac2","Type":"ContainerStarted","Data":"c46b04c8fb2120aa707cb9ab4ad5dced7bf41c373340a4b09c55b7f06e24ed43"}
Jul 16 22:35:23.463723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:23.463685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:23.464515 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:23.464484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:23.628366 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:23.628332    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:35:24.507502 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:24.507383    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95464aa_919b_47a1_a3f5_37a91faa1643.slice/crio-641c6741531c1e7ff5a89c43ade37e77f3924c2c0e83a60b0f8766bf83a5f331 WatchSource:0}: Error finding container 641c6741531c1e7ff5a89c43ade37e77f3924c2c0e83a60b0f8766bf83a5f331: Status 404 returned error can't find the container with id 641c6741531c1e7ff5a89c43ade37e77f3924c2c0e83a60b0f8766bf83a5f331
Jul 16 22:35:24.646759 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:24.646621    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:35:24.649210 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:24.649182    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce612c2b_561e_43e1_a77f_b9c46a39bd80.slice/crio-b8f0371615c03f1855abb1403e82a0aac3122d384961be72d9a73e3698e2004b WatchSource:0}: Error finding container b8f0371615c03f1855abb1403e82a0aac3122d384961be72d9a73e3698e2004b: Status 404 returned error can't find the container with id b8f0371615c03f1855abb1403e82a0aac3122d384961be72d9a73e3698e2004b
Jul 16 22:35:24.658852 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:24.658817    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-5z5vp"]
Jul 16 22:35:24.661531 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:24.661510    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6b66be_1449_4915_862d_812ed7816050.slice/crio-6fce5f25e790b3f496ca16ae0c9c552533dcd950f3e5856402ee0cede7c750a9 WatchSource:0}: Error finding container 6fce5f25e790b3f496ca16ae0c9c552533dcd950f3e5856402ee0cede7c750a9: Status 404 returned error can't find the container with id 6fce5f25e790b3f496ca16ae0c9c552533dcd950f3e5856402ee0cede7c750a9
Jul 16 22:35:25.168480 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:25.168444    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerStarted","Data":"b8f0371615c03f1855abb1403e82a0aac3122d384961be72d9a73e3698e2004b"}
Jul 16 22:35:25.169650 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:25.169623    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k29q" event={"ID":"f95464aa-919b-47a1-a3f5-37a91faa1643","Type":"ContainerStarted","Data":"641c6741531c1e7ff5a89c43ade37e77f3924c2c0e83a60b0f8766bf83a5f331"}
Jul 16 22:35:25.171541 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:25.171517    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c2l2" event={"ID":"160d33fa-8dbe-4360-a201-1adce47a7417","Type":"ContainerStarted","Data":"23de8ece4740e4253b6227c2ab30575a4840ae7ae1417d9f8098c1e7dc93e1bf"}
Jul 16 22:35:25.172611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:25.172585    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp" event={"ID":"ba6b66be-1449-4915-862d-812ed7816050","Type":"ContainerStarted","Data":"6fce5f25e790b3f496ca16ae0c9c552533dcd950f3e5856402ee0cede7c750a9"}
Jul 16 22:35:25.190856 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:25.190808    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6c2l2" podStartSLOduration=1.061496811 podStartE2EDuration="14.190794518s" totalImagesPullingTime="13.129297707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:35:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:25.1897227 +0000 UTC m=+106.118732911" watchObservedRunningTime="2026-07-16 22:35:25.190794518 +0000 UTC m=+106.119804730"
Jul 16 22:35:26.012464 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.012430    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"]
Jul 16 22:35:26.025627 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.025603    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.027879 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.027857    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"]
Jul 16 22:35:26.028475 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.028459    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9q8ggvsnpv1k4\""
Jul 16 22:35:26.031625 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.030584    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 16 22:35:26.031625 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.031391    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jzf77\""
Jul 16 22:35:26.031625 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.031424    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 22:35:26.032134 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.031994    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 16 22:35:26.032134 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.032049    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 16 22:35:26.188467 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.188437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-secret-metrics-server-client-certs\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.188660 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.188499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bd29db7b-17e9-4005-9af9-07d7a5449210-audit-log\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.188660 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.188534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-client-ca-bundle\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.188660 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.188617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd29db7b-17e9-4005-9af9-07d7a5449210-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.188660 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.188641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-secret-metrics-server-tls\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.188881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.188696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bd29db7b-17e9-4005-9af9-07d7a5449210-metrics-server-audit-profiles\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.188881 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.188723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfjzx\" (UniqueName: \"kubernetes.io/projected/bd29db7b-17e9-4005-9af9-07d7a5449210-kube-api-access-dfjzx\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.289879 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.289789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bd29db7b-17e9-4005-9af9-07d7a5449210-metrics-server-audit-profiles\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.289879 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.289844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfjzx\" (UniqueName: \"kubernetes.io/projected/bd29db7b-17e9-4005-9af9-07d7a5449210-kube-api-access-dfjzx\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.290120 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.289897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-secret-metrics-server-client-certs\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.290177 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.290159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bd29db7b-17e9-4005-9af9-07d7a5449210-audit-log\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.290250 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.290205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-client-ca-bundle\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.290314 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.290287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd29db7b-17e9-4005-9af9-07d7a5449210-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.290372 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.290322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-secret-metrics-server-tls\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.290728 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.290703    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bd29db7b-17e9-4005-9af9-07d7a5449210-audit-log\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.291866 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.290904    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bd29db7b-17e9-4005-9af9-07d7a5449210-metrics-server-audit-profiles\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.291866 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.291777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd29db7b-17e9-4005-9af9-07d7a5449210-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.293184 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.293158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-secret-metrics-server-client-certs\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.293421 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.293397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-secret-metrics-server-tls\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.293654 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.293629    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd29db7b-17e9-4005-9af9-07d7a5449210-client-ca-bundle\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.308822 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.308799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfjzx\" (UniqueName: \"kubernetes.io/projected/bd29db7b-17e9-4005-9af9-07d7a5449210-kube-api-access-dfjzx\") pod \"metrics-server-69cf5bc5fc-sf9t8\" (UID: \"bd29db7b-17e9-4005-9af9-07d7a5449210\") " pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.338405 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.338382    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:26.628721 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:26.628696    2558 scope.go:117] "RemoveContainer" containerID="e4928eafe1677a68800839471c71ea747beed705cb69f9750717e707faadfc29"
Jul 16 22:35:26.628879 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:35:26.628860    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-cgjzx_openshift-console-operator(1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" podUID="1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0"
Jul 16 22:35:27.325772 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:27.325747    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"]
Jul 16 22:35:27.440074 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:27.440003    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd29db7b_17e9_4005_9af9_07d7a5449210.slice/crio-674bcb72c29b3af629bb00900a5dcbccfe759c81e3519ab3e860166188383e5b WatchSource:0}: Error finding container 674bcb72c29b3af629bb00900a5dcbccfe759c81e3519ab3e860166188383e5b: Status 404 returned error can't find the container with id 674bcb72c29b3af629bb00900a5dcbccfe759c81e3519ab3e860166188383e5b
Jul 16 22:35:28.185018 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.184980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2" event={"ID":"eff28caa-2385-4d5f-baa2-590a0f6dcac2","Type":"ContainerStarted","Data":"853ed3e66f536eb416162525e737d2498f080e4982d04462bd05d51f60e2987d"}
Jul 16 22:35:28.186460 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.186435    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerID="dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559" exitCode=0
Jul 16 22:35:28.186580 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.186518    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerDied","Data":"dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559"}
Jul 16 22:35:28.188114 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.188090    2558 generic.go:356] "Generic (PLEG): container finished" podID="f95464aa-919b-47a1-a3f5-37a91faa1643" containerID="e93147a59e09ba7e09be30261055cea0ff7ecb4fde9f3b2fe9c30b2571f4800a" exitCode=0
Jul 16 22:35:28.188196 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.188182    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k29q" event={"ID":"f95464aa-919b-47a1-a3f5-37a91faa1643","Type":"ContainerDied","Data":"e93147a59e09ba7e09be30261055cea0ff7ecb4fde9f3b2fe9c30b2571f4800a"}
Jul 16 22:35:28.190471 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.190450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp" event={"ID":"ba6b66be-1449-4915-862d-812ed7816050","Type":"ContainerStarted","Data":"b43110bc042dbbee6cabda20f585a7c7e2c82aae2142c4106ceac1a7fda25172"}
Jul 16 22:35:28.190571 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.190490    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp" event={"ID":"ba6b66be-1449-4915-862d-812ed7816050","Type":"ContainerStarted","Data":"6f93284c841fdc71daa19a8986880c2a965f857ccfa5c695206a84e1c4ef5fe1"}
Jul 16 22:35:28.190571 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.190517    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp" event={"ID":"ba6b66be-1449-4915-862d-812ed7816050","Type":"ContainerStarted","Data":"7d97773e87c71e6b1f30dde254ec2f643f44eb36a697af6cd4b23107dced48b6"}
Jul 16 22:35:28.191658 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.191639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8" event={"ID":"bd29db7b-17e9-4005-9af9-07d7a5449210","Type":"ContainerStarted","Data":"674bcb72c29b3af629bb00900a5dcbccfe759c81e3519ab3e860166188383e5b"}
Jul 16 22:35:28.210096 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.210048    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rs6j2" podStartSLOduration=2.911718073 podStartE2EDuration="7.210028282s" totalImagesPullingTime="4.298310209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:28.208492692 +0000 UTC m=+109.137502906" watchObservedRunningTime="2026-07-16 22:35:28.210028282 +0000 UTC m=+109.139038499"
Jul 16 22:35:28.262459 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:28.262412    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-5z5vp" podStartSLOduration=4.495616415 podStartE2EDuration="7.262395011s" totalImagesPullingTime="2.766778596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:28.260569195 +0000 UTC m=+109.189579408" watchObservedRunningTime="2026-07-16 22:35:28.262395011 +0000 UTC m=+109.191405224"
Jul 16 22:35:29.198157 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:29.198066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k29q" event={"ID":"f95464aa-919b-47a1-a3f5-37a91faa1643","Type":"ContainerStarted","Data":"ee4b9afe0a195e3cc4e0f1ed1af890ef89dc2c6a7f8b22739ed31e04a6fab0e5"}
Jul 16 22:35:29.198621 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:29.198165    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k29q" event={"ID":"f95464aa-919b-47a1-a3f5-37a91faa1643","Type":"ContainerStarted","Data":"0971044ca840bcb253833f0f46878e3221a563304c25533ce984f9e0fccd4493"}
Jul 16 22:35:29.199727 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:29.199695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8" event={"ID":"bd29db7b-17e9-4005-9af9-07d7a5449210","Type":"ContainerStarted","Data":"5091f6c9c7fb2036b786bf7230c1d2e443d85ec2d297d31d5738004031400b7e"}
Jul 16 22:35:29.218758 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:29.218716    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9k29q" podStartSLOduration=5.4426544660000005 podStartE2EDuration="8.218697764s" totalImagesPullingTime="2.68009936s" totalInitContainerRuntime="95.943938ms" isStatefulPod=true podCreationTimestamp="2026-07-16 22:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:29.216460012 +0000 UTC m=+110.145470225" watchObservedRunningTime="2026-07-16 22:35:29.218697764 +0000 UTC m=+110.147707977"
Jul 16 22:35:29.236221 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:29.236180    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8" podStartSLOduration=2.789347289 podStartE2EDuration="4.236165705s" totalImagesPullingTime="1.446818416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:29.235751015 +0000 UTC m=+110.164761253" watchObservedRunningTime="2026-07-16 22:35:29.236165705 +0000 UTC m=+110.165175917"
Jul 16 22:35:30.210919 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:30.210885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerStarted","Data":"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de"}
Jul 16 22:35:30.211280 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:30.210977    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerStarted","Data":"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62"}
Jul 16 22:35:30.211280 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:30.211019    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerStarted","Data":"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96"}
Jul 16 22:35:30.211280 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:30.211044    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerStarted","Data":"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04"}
Jul 16 22:35:30.211280 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:30.211066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerStarted","Data":"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2"}
Jul 16 22:35:31.097694 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:31.097670    2558 patch_prober.go:28] interesting pod/image-registry-6bd79486b6-qw72h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 22:35:31.097783 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:31.097714    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h" podUID="86932345-7b00-4c77-bcab-a00807b64c75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:35:31.218785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:31.218751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerStarted","Data":"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768"}
Jul 16 22:35:31.257627 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:31.257579    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.155417928 podStartE2EDuration="9.257562148s" totalImagesPullingTime="5.081576727s" totalInitContainerRuntime="20.567493ms" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:31.257008997 +0000 UTC m=+112.186019245" watchObservedRunningTime="2026-07-16 22:35:31.257562148 +0000 UTC m=+112.186572396"
Jul 16 22:35:31.458320 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:31.458286    2558 patch_prober.go:28] interesting pod/image-registry-577478c94f-k25qh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 22:35:31.458512 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:31.458342    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-577478c94f-k25qh" podUID="3ab20305-7311-444e-998e-6be83cb25f36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:35:33.096717 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:33.096685    2558 patch_prober.go:28] interesting pod/image-registry-577478c94f-k25qh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 22:35:33.097086 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:33.096734    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-577478c94f-k25qh" podUID="3ab20305-7311-444e-998e-6be83cb25f36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:35:33.166177 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:33.166147    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7jh5n"
Jul 16 22:35:36.111517 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.111457    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h" podUID="86932345-7b00-4c77-bcab-a00807b64c75" containerName="registry" containerID="cri-o://bec6b226ed5fa4a237dfe34f34b83a26c27ff47232824d0fe9d0f446f56fdb92" gracePeriod=30
Jul 16 22:35:36.237837 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.237801    2558 generic.go:356] "Generic (PLEG): container finished" podID="86932345-7b00-4c77-bcab-a00807b64c75" containerID="bec6b226ed5fa4a237dfe34f34b83a26c27ff47232824d0fe9d0f446f56fdb92" exitCode=0
Jul 16 22:35:36.237960 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.237869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h" event={"ID":"86932345-7b00-4c77-bcab-a00807b64c75","Type":"ContainerDied","Data":"bec6b226ed5fa4a237dfe34f34b83a26c27ff47232824d0fe9d0f446f56fdb92"}
Jul 16 22:35:36.347801 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.347780    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:35:36.386392 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386359    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") pod \"86932345-7b00-4c77-bcab-a00807b64c75\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") "
Jul 16 22:35:36.386556 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386406    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86932345-7b00-4c77-bcab-a00807b64c75-ca-trust-extracted\") pod \"86932345-7b00-4c77-bcab-a00807b64c75\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") "
Jul 16 22:35:36.386556 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386450    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-trusted-ca\") pod \"86932345-7b00-4c77-bcab-a00807b64c75\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") "
Jul 16 22:35:36.386556 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386504    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-registry-certificates\") pod \"86932345-7b00-4c77-bcab-a00807b64c75\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") "
Jul 16 22:35:36.386556 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386542    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-installation-pull-secrets\") pod \"86932345-7b00-4c77-bcab-a00807b64c75\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") "
Jul 16 22:35:36.386756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386572    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n78sg\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-kube-api-access-n78sg\") pod \"86932345-7b00-4c77-bcab-a00807b64c75\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") "
Jul 16 22:35:36.386756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386621    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-bound-sa-token\") pod \"86932345-7b00-4c77-bcab-a00807b64c75\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") "
Jul 16 22:35:36.386756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386656    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-image-registry-private-configuration\") pod \"86932345-7b00-4c77-bcab-a00807b64c75\" (UID: \"86932345-7b00-4c77-bcab-a00807b64c75\") "
Jul 16 22:35:36.386898 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386846    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "86932345-7b00-4c77-bcab-a00807b64c75" (UID: "86932345-7b00-4c77-bcab-a00807b64c75"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:35:36.387001 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386968    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-trusted-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:35:36.387126 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.386995    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "86932345-7b00-4c77-bcab-a00807b64c75" (UID: "86932345-7b00-4c77-bcab-a00807b64c75"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:35:36.389104 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.389073    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "86932345-7b00-4c77-bcab-a00807b64c75" (UID: "86932345-7b00-4c77-bcab-a00807b64c75"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:35:36.389422 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.389337    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-kube-api-access-n78sg" (OuterVolumeSpecName: "kube-api-access-n78sg") pod "86932345-7b00-4c77-bcab-a00807b64c75" (UID: "86932345-7b00-4c77-bcab-a00807b64c75"). InnerVolumeSpecName "kube-api-access-n78sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:35:36.389526 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.389496    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "86932345-7b00-4c77-bcab-a00807b64c75" (UID: "86932345-7b00-4c77-bcab-a00807b64c75"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:35:36.389526 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.389519    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "86932345-7b00-4c77-bcab-a00807b64c75" (UID: "86932345-7b00-4c77-bcab-a00807b64c75"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:35:36.389817 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.389802    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "86932345-7b00-4c77-bcab-a00807b64c75" (UID: "86932345-7b00-4c77-bcab-a00807b64c75"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:35:36.395000 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.394979    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86932345-7b00-4c77-bcab-a00807b64c75-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "86932345-7b00-4c77-bcab-a00807b64c75" (UID: "86932345-7b00-4c77-bcab-a00807b64c75"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:35:36.487523 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.487479    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86932345-7b00-4c77-bcab-a00807b64c75-registry-certificates\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:35:36.487523 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.487516    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-installation-pull-secrets\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:35:36.487523 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.487526    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n78sg\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-kube-api-access-n78sg\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:35:36.487523 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.487537    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-bound-sa-token\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:35:36.487753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.487548    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86932345-7b00-4c77-bcab-a00807b64c75-image-registry-private-configuration\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:35:36.487753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.487558    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86932345-7b00-4c77-bcab-a00807b64c75-registry-tls\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:35:36.487753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:36.487566    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86932345-7b00-4c77-bcab-a00807b64c75-ca-trust-extracted\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:35:37.243064 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:37.243030    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h"
Jul 16 22:35:37.243064 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:37.243044    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd79486b6-qw72h" event={"ID":"86932345-7b00-4c77-bcab-a00807b64c75","Type":"ContainerDied","Data":"f33f12d655620cbc421bad22370bd4c2e1845718bc3a6d336fb25478c1952d53"}
Jul 16 22:35:37.243578 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:37.243109    2558 scope.go:117] "RemoveContainer" containerID="bec6b226ed5fa4a237dfe34f34b83a26c27ff47232824d0fe9d0f446f56fdb92"
Jul 16 22:35:37.265299 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:37.265274    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bd79486b6-qw72h"]
Jul 16 22:35:37.268629 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:37.268607    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bd79486b6-qw72h"]
Jul 16 22:35:37.633598 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:37.633572    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86932345-7b00-4c77-bcab-a00807b64c75" path="/var/lib/kubelet/pods/86932345-7b00-4c77-bcab-a00807b64c75/volumes"
Jul 16 22:35:39.630515 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:39.630490    2558 scope.go:117] "RemoveContainer" containerID="e4928eafe1677a68800839471c71ea747beed705cb69f9750717e707faadfc29"
Jul 16 22:35:40.257701 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.257673    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:35:40.257856 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.257744    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" event={"ID":"1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0","Type":"ContainerStarted","Data":"221cb43114e82ae0ff2892c17df27b6d1e64ccaaa5dd5d84a9ca88dc42f1f184"}
Jul 16 22:35:40.258037 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.258014    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:35:40.277416 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.277367    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx" podStartSLOduration=52.161261782 podStartE2EDuration="58.277351929s" totalImagesPullingTime="6.116090147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:40.276470599 +0000 UTC m=+121.205480813" watchObservedRunningTime="2026-07-16 22:35:40.277351929 +0000 UTC m=+121.206362141"
Jul 16 22:35:40.322958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.322931    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-cgjzx"
Jul 16 22:35:40.501418 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.501382    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-sfthj"]
Jul 16 22:35:40.501682 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.501671    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86932345-7b00-4c77-bcab-a00807b64c75" containerName="registry"
Jul 16 22:35:40.501724 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.501684    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="86932345-7b00-4c77-bcab-a00807b64c75" containerName="registry"
Jul 16 22:35:40.501765 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.501739    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="86932345-7b00-4c77-bcab-a00807b64c75" containerName="registry"
Jul 16 22:35:40.503785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.503763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-sfthj"
Jul 16 22:35:40.506642 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.506623    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 22:35:40.506736 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.506643    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 22:35:40.507042 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.507028    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9xnrs\""
Jul 16 22:35:40.518942 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.518917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw8h9\" (UniqueName: \"kubernetes.io/projected/f4e8e409-a6d0-4b25-8f23-6ac3da778f5d-kube-api-access-tw8h9\") pod \"downloads-5bc67dcd46-sfthj\" (UID: \"f4e8e409-a6d0-4b25-8f23-6ac3da778f5d\") " pod="openshift-console/downloads-5bc67dcd46-sfthj"
Jul 16 22:35:40.519131 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.519116    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-sfthj"]
Jul 16 22:35:40.619863 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.619835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw8h9\" (UniqueName: \"kubernetes.io/projected/f4e8e409-a6d0-4b25-8f23-6ac3da778f5d-kube-api-access-tw8h9\") pod \"downloads-5bc67dcd46-sfthj\" (UID: \"f4e8e409-a6d0-4b25-8f23-6ac3da778f5d\") " pod="openshift-console/downloads-5bc67dcd46-sfthj"
Jul 16 22:35:40.631330 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.631304    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw8h9\" (UniqueName: \"kubernetes.io/projected/f4e8e409-a6d0-4b25-8f23-6ac3da778f5d-kube-api-access-tw8h9\") pod \"downloads-5bc67dcd46-sfthj\" (UID: \"f4e8e409-a6d0-4b25-8f23-6ac3da778f5d\") " pod="openshift-console/downloads-5bc67dcd46-sfthj"
Jul 16 22:35:40.813651 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.813563    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-sfthj"
Jul 16 22:35:40.938267 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:40.938224    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-sfthj"]
Jul 16 22:35:40.940253 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:40.940208    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e8e409_a6d0_4b25_8f23_6ac3da778f5d.slice/crio-98a28bc79a023c0d827358598c1c4de2d94994370361adcf4884eb6e6dceb988 WatchSource:0}: Error finding container 98a28bc79a023c0d827358598c1c4de2d94994370361adcf4884eb6e6dceb988: Status 404 returned error can't find the container with id 98a28bc79a023c0d827358598c1c4de2d94994370361adcf4884eb6e6dceb988
Jul 16 22:35:41.262469 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:41.262439    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-sfthj" event={"ID":"f4e8e409-a6d0-4b25-8f23-6ac3da778f5d","Type":"ContainerStarted","Data":"98a28bc79a023c0d827358598c1c4de2d94994370361adcf4884eb6e6dceb988"}
Jul 16 22:35:41.457571 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:41.457540    2558 patch_prober.go:28] interesting pod/image-registry-577478c94f-k25qh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 22:35:41.457718 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:41.457602    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-577478c94f-k25qh" podUID="3ab20305-7311-444e-998e-6be83cb25f36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:35:43.097571 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:43.097539    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-577478c94f-k25qh"
Jul 16 22:35:46.338815 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:46.338782    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:46.339209 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:46.338847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:35:48.294499 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:48.294457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:35:48.297886 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:48.297860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4287831-aa57-4f11-912a-37b9987ba4c0-metrics-certs\") pod \"network-metrics-daemon-pnzj8\" (UID: \"f4287831-aa57-4f11-912a-37b9987ba4c0\") " pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:35:48.546649 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:48.546573    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9dnx4\""
Jul 16 22:35:48.553695 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:48.553671    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnzj8"
Jul 16 22:35:48.745063 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:48.745020    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pnzj8"]
Jul 16 22:35:48.750385 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:48.750356    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4287831_aa57_4f11_912a_37b9987ba4c0.slice/crio-f6b3de4fdc5af53f6217ec1bdbfd6e47fcc978590ecf018056498de68a75f4e6 WatchSource:0}: Error finding container f6b3de4fdc5af53f6217ec1bdbfd6e47fcc978590ecf018056498de68a75f4e6: Status 404 returned error can't find the container with id f6b3de4fdc5af53f6217ec1bdbfd6e47fcc978590ecf018056498de68a75f4e6
Jul 16 22:35:49.298102 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.298061    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pnzj8" event={"ID":"f4287831-aa57-4f11-912a-37b9987ba4c0","Type":"ContainerStarted","Data":"f6b3de4fdc5af53f6217ec1bdbfd6e47fcc978590ecf018056498de68a75f4e6"}
Jul 16 22:35:49.740716 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.740671    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc448d8c8-ld4wr"]
Jul 16 22:35:49.763463 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.763426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.768668 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.768641    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 22:35:49.768824 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.768644    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 22:35:49.769636 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.769612    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tz9dq\""
Jul 16 22:35:49.769868 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.769850    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 22:35:49.771791 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.770055    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 22:35:49.771791 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.770262    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 22:35:49.781088 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.781062    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc448d8c8-ld4wr"]
Jul 16 22:35:49.806766 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.806727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zssfb\" (UniqueName: \"kubernetes.io/projected/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-kube-api-access-zssfb\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.806925 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.806776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-serving-cert\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.806925 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.806872    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-config\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.807048 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.806972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-oauth-serving-cert\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.807048 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.807007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-oauth-config\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.807158 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.807043    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-service-ca\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.907839 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.907793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-service-ca\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.908026 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.907869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zssfb\" (UniqueName: \"kubernetes.io/projected/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-kube-api-access-zssfb\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.908212 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.908187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-serving-cert\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.908328 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.908290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-config\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.908393 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.908341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-oauth-serving-cert\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.908393 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.908362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-oauth-config\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.908610 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.908585    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-service-ca\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.909175 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.909149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-config\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.909704 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.909684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-oauth-serving-cert\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.911351 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.911311    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-oauth-config\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.911563 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.911537    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-serving-cert\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:49.941812 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:49.941750    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zssfb\" (UniqueName: \"kubernetes.io/projected/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-kube-api-access-zssfb\") pod \"console-fc448d8c8-ld4wr\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") " pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:50.078438 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:50.078301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:35:50.382420 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:50.381983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc448d8c8-ld4wr"]
Jul 16 22:35:50.514723 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:50.514672    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e078b6c_bc8c_4b65_b6d2_6a9e450a505a.slice/crio-f141d4eb9693e5eec45f38dd157c91a50e53bb144ce652962102d647ced35bfa WatchSource:0}: Error finding container f141d4eb9693e5eec45f38dd157c91a50e53bb144ce652962102d647ced35bfa: Status 404 returned error can't find the container with id f141d4eb9693e5eec45f38dd157c91a50e53bb144ce652962102d647ced35bfa
Jul 16 22:35:51.308213 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:51.308130    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc448d8c8-ld4wr" event={"ID":"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a","Type":"ContainerStarted","Data":"f141d4eb9693e5eec45f38dd157c91a50e53bb144ce652962102d647ced35bfa"}
Jul 16 22:35:51.309804 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:51.309777    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pnzj8" event={"ID":"f4287831-aa57-4f11-912a-37b9987ba4c0","Type":"ContainerStarted","Data":"d7b493041699b9691c5523dd7be45d47b8193ce3b171536dc9a7e43075a4581a"}
Jul 16 22:35:57.646796 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.646770    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c7d57549-d9kjn"]
Jul 16 22:35:57.649019 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.649006    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.663533 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.663510    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c7d57549-d9kjn"]
Jul 16 22:35:57.673732 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.673701    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 22:35:57.781547 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.781518    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-service-ca\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.781640 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.781551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-trusted-ca-bundle\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.781640 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.781569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flf8n\" (UniqueName: \"kubernetes.io/projected/53880697-2701-498d-b7be-e78e7ac2d7ff-kube-api-access-flf8n\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.781640 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.781628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-oauth-config\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.781741 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.781684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-console-config\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.781774 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.781754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-oauth-serving-cert\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.781807 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.781784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-serving-cert\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.882938 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.882889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-service-ca\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.882938 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.882937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-trusted-ca-bundle\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.883178 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.882981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flf8n\" (UniqueName: \"kubernetes.io/projected/53880697-2701-498d-b7be-e78e7ac2d7ff-kube-api-access-flf8n\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.883178 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.883020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-oauth-config\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.883178 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.883071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-console-config\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.883178 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.883128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-oauth-serving-cert\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.883416 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.883182    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-serving-cert\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.883663 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.883632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-service-ca\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.884560 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.884293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-console-config\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.884560 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.884479    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-trusted-ca-bundle\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.884951 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.884779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-oauth-serving-cert\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.886488 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.886461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-serving-cert\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.886712 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.886688    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-oauth-config\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.893761 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.893732    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flf8n\" (UniqueName: \"kubernetes.io/projected/53880697-2701-498d-b7be-e78e7ac2d7ff-kube-api-access-flf8n\") pod \"console-68c7d57549-d9kjn\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") " pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:57.968378 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:57.967995    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:35:58.190378 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:58.190051    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c7d57549-d9kjn"]
Jul 16 22:35:58.192744 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:35:58.192713    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53880697_2701_498d_b7be_e78e7ac2d7ff.slice/crio-c7a1e1d139e2ee8dcb944deec1bb59d04baa64f2df70103789470ca7b1ef8237 WatchSource:0}: Error finding container c7a1e1d139e2ee8dcb944deec1bb59d04baa64f2df70103789470ca7b1ef8237: Status 404 returned error can't find the container with id c7a1e1d139e2ee8dcb944deec1bb59d04baa64f2df70103789470ca7b1ef8237
Jul 16 22:35:58.345142 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:58.345015    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pnzj8" event={"ID":"f4287831-aa57-4f11-912a-37b9987ba4c0","Type":"ContainerStarted","Data":"ac0d02e403e6528a48bddd1a5ea7b1ed5a9c61afdce68d001c68d816c66172ea"}
Jul 16 22:35:58.348331 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:58.348297    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-sfthj" event={"ID":"f4e8e409-a6d0-4b25-8f23-6ac3da778f5d","Type":"ContainerStarted","Data":"254354b5b9a2b6cfbe8aa2f40c98535e5e94ba99bba5d158d8d4e3854b0f98ef"}
Jul 16 22:35:58.348680 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:58.348655    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-sfthj"
Jul 16 22:35:58.349974 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:58.349938    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c7d57549-d9kjn" event={"ID":"53880697-2701-498d-b7be-e78e7ac2d7ff","Type":"ContainerStarted","Data":"c7a1e1d139e2ee8dcb944deec1bb59d04baa64f2df70103789470ca7b1ef8237"}
Jul 16 22:35:58.361336 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:58.360991    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-sfthj"
Jul 16 22:35:58.365396 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:58.363999    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pnzj8" podStartSLOduration=137.572230218 podStartE2EDuration="2m19.363979641s" totalImagesPullingTime="1.791749423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:58.362589633 +0000 UTC m=+139.291599865" watchObservedRunningTime="2026-07-16 22:35:58.363979641 +0000 UTC m=+139.292989854"
Jul 16 22:35:58.387493 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:35:58.387442    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-sfthj" podStartSLOduration=1.604607769 podStartE2EDuration="18.387422692s" totalImagesPullingTime="16.782814923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:58.386077096 +0000 UTC m=+139.315087333" watchObservedRunningTime="2026-07-16 22:35:58.387422692 +0000 UTC m=+139.316432906"
Jul 16 22:36:01.369832 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:01.369780    2558 generic.go:356] "Generic (PLEG): container finished" podID="e744a60a-81e3-4c27-ad61-53e35a5e9767" containerID="f8dd75a8f1034948787eb6c5168185a12ae100985b9ecdf42b36704ac56362f2" exitCode=0
Jul 16 22:36:01.370392 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:01.369852    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt" event={"ID":"e744a60a-81e3-4c27-ad61-53e35a5e9767","Type":"ContainerDied","Data":"f8dd75a8f1034948787eb6c5168185a12ae100985b9ecdf42b36704ac56362f2"}
Jul 16 22:36:01.370466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:01.370449    2558 scope.go:117] "RemoveContainer" containerID="f8dd75a8f1034948787eb6c5168185a12ae100985b9ecdf42b36704ac56362f2"
Jul 16 22:36:01.374349 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:01.374157    2558 generic.go:356] "Generic (PLEG): container finished" podID="6ab1b805-ef62-4187-8767-432aaf483b24" containerID="67caa19f7c044284838c80b1a22ffd9574c8e55129c996f44c49115d7f496a72" exitCode=0
Jul 16 22:36:01.374349 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:01.374254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xwl7q" event={"ID":"6ab1b805-ef62-4187-8767-432aaf483b24","Type":"ContainerDied","Data":"67caa19f7c044284838c80b1a22ffd9574c8e55129c996f44c49115d7f496a72"}
Jul 16 22:36:01.374615 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:01.374594    2558 scope.go:117] "RemoveContainer" containerID="67caa19f7c044284838c80b1a22ffd9574c8e55129c996f44c49115d7f496a72"
Jul 16 22:36:02.349938 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.349851    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce612c2b-561e-43e1-a77f-b9c46a39bd80/init-config-reloader/0.log"
Jul 16 22:36:02.356487 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.356462    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce612c2b-561e-43e1-a77f-b9c46a39bd80/alertmanager/0.log"
Jul 16 22:36:02.380754 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.380721    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc448d8c8-ld4wr" event={"ID":"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a","Type":"ContainerStarted","Data":"a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712"}
Jul 16 22:36:02.383101 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.383070    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-r8gbt" event={"ID":"e744a60a-81e3-4c27-ad61-53e35a5e9767","Type":"ContainerStarted","Data":"1bf39918855bf3c31afbfca6b42d8fcbc9693985c3e7fc1d3a3b36155a788073"}
Jul 16 22:36:02.385371 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.385333    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xwl7q" event={"ID":"6ab1b805-ef62-4187-8767-432aaf483b24","Type":"ContainerStarted","Data":"12700d46ffccc4b1b78a8408a696a3dad2a08956f3f627048bfb5d92266ca51b"}
Jul 16 22:36:02.387151 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.387118    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c7d57549-d9kjn" event={"ID":"53880697-2701-498d-b7be-e78e7ac2d7ff","Type":"ContainerStarted","Data":"371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e"}
Jul 16 22:36:02.402033 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.401994    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc448d8c8-ld4wr" podStartSLOduration=2.078888151 podStartE2EDuration="13.401978254s" totalImagesPullingTime="11.323090103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:36:02.399931133 +0000 UTC m=+143.328941345" watchObservedRunningTime="2026-07-16 22:36:02.401978254 +0000 UTC m=+143.330988465"
Jul 16 22:36:02.439473 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.439415    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c7d57549-d9kjn" podStartSLOduration=1.761037756 podStartE2EDuration="5.439395955s" totalImagesPullingTime="3.678358199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:36:02.418593603 +0000 UTC m=+143.347603816" watchObservedRunningTime="2026-07-16 22:36:02.439395955 +0000 UTC m=+143.368406168"
Jul 16 22:36:02.450589 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.450532    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce612c2b-561e-43e1-a77f-b9c46a39bd80/config-reloader/0.log"
Jul 16 22:36:02.644821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.644787    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce612c2b-561e-43e1-a77f-b9c46a39bd80/kube-rbac-proxy-web/0.log"
Jul 16 22:36:02.845894 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:02.845866    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce612c2b-561e-43e1-a77f-b9c46a39bd80/kube-rbac-proxy/0.log"
Jul 16 22:36:03.044789 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:03.044697    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce612c2b-561e-43e1-a77f-b9c46a39bd80/kube-rbac-proxy-metric/0.log"
Jul 16 22:36:03.244281 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:03.244227    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce612c2b-561e-43e1-a77f-b9c46a39bd80/prom-label-proxy/0.log"
Jul 16 22:36:03.646040 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:03.646007    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5z5vp_ba6b66be-1449-4915-862d-812ed7816050/kube-state-metrics/0.log"
Jul 16 22:36:03.845599 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:03.845568    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5z5vp_ba6b66be-1449-4915-862d-812ed7816050/kube-rbac-proxy-main/0.log"
Jul 16 22:36:04.045183 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:04.045112    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5z5vp_ba6b66be-1449-4915-862d-812ed7816050/kube-rbac-proxy-self/0.log"
Jul 16 22:36:04.244371 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:04.244327    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69cf5bc5fc-sf9t8_bd29db7b-17e9-4005-9af9-07d7a5449210/metrics-server/0.log"
Jul 16 22:36:04.645127 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:04.645092    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k29q_f95464aa-919b-47a1-a3f5-37a91faa1643/init-textfile/0.log"
Jul 16 22:36:04.845876 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:04.845843    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k29q_f95464aa-919b-47a1-a3f5-37a91faa1643/node-exporter/0.log"
Jul 16 22:36:05.045063 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:05.044989    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k29q_f95464aa-919b-47a1-a3f5-37a91faa1643/kube-rbac-proxy/0.log"
Jul 16 22:36:06.345386 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:06.345356    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:36:06.349946 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:06.349920    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69cf5bc5fc-sf9t8"
Jul 16 22:36:06.444952 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:06.444921    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rs6j2_eff28caa-2385-4d5f-baa2-590a0f6dcac2/kube-rbac-proxy-main/0.log"
Jul 16 22:36:06.645110 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:06.645081    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rs6j2_eff28caa-2385-4d5f-baa2-590a0f6dcac2/kube-rbac-proxy-self/0.log"
Jul 16 22:36:06.846051 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:06.846028    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rs6j2_eff28caa-2385-4d5f-baa2-590a0f6dcac2/openshift-state-metrics/0.log"
Jul 16 22:36:07.968859 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:07.968822    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:36:07.969318 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:07.968884    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:36:07.973843 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:07.973824    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:36:08.422133 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:08.422110    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:36:08.474168 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:08.474137    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc448d8c8-ld4wr"]
Jul 16 22:36:10.079319 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:10.079285    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:36:10.244542 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:10.244511    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-wkn9c_b1998c5f-2a47-4838-b991-bbf5bfc41a1f/networking-console-plugin/0.log"
Jul 16 22:36:10.444318 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:10.444291    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:36:10.647286 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:10.647213    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/3.log"
Jul 16 22:36:10.844694 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:10.844615    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68c7d57549-d9kjn_53880697-2701-498d-b7be-e78e7ac2d7ff/console/0.log"
Jul 16 22:36:11.045865 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:11.045837    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fc448d8c8-ld4wr_8e078b6c-bc8c-4b65-b6d2-6a9e450a505a/console/0.log"
Jul 16 22:36:11.246461 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:11.246433    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-sfthj_f4e8e409-a6d0-4b25-8f23-6ac3da778f5d/download-server/0.log"
Jul 16 22:36:33.495751 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.495666    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fc448d8c8-ld4wr" podUID="8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" containerName="console" containerID="cri-o://a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712" gracePeriod=15
Jul 16 22:36:33.767490 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.767419    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:36:33.831321 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831295    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-serving-cert\") pod \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") "
Jul 16 22:36:33.831478 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831351    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zssfb\" (UniqueName: \"kubernetes.io/projected/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-kube-api-access-zssfb\") pod \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") "
Jul 16 22:36:33.831478 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831379    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-service-ca\") pod \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") "
Jul 16 22:36:33.831478 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831418    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-oauth-serving-cert\") pod \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") "
Jul 16 22:36:33.831478 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831471    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-oauth-config\") pod \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") "
Jul 16 22:36:33.831654 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831502    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-config\") pod \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\" (UID: \"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a\") "
Jul 16 22:36:33.831846 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831812    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" (UID: "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:36:33.831984 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831864    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" (UID: "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:36:33.831984 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.831910    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-config" (OuterVolumeSpecName: "console-config") pod "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" (UID: "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:36:33.833804 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.833775    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" (UID: "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:33.833901 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.833808    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" (UID: "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:33.833901 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.833858    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-kube-api-access-zssfb" (OuterVolumeSpecName: "kube-api-access-zssfb") pod "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" (UID: "8e078b6c-bc8c-4b65-b6d2-6a9e450a505a"). InnerVolumeSpecName "kube-api-access-zssfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:36:33.932719 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.932689    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-oauth-serving-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:33.932719 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.932716    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-oauth-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:33.932719 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.932725    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:33.932942 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.932734    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-console-serving-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:33.932942 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.932743    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zssfb\" (UniqueName: \"kubernetes.io/projected/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-kube-api-access-zssfb\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:33.932942 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:33.932751    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a-service-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:34.524939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.524904    2558 generic.go:356] "Generic (PLEG): container finished" podID="8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" containerID="a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712" exitCode=0
Jul 16 22:36:34.525355 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.524950    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc448d8c8-ld4wr"
Jul 16 22:36:34.525355 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.524998    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc448d8c8-ld4wr" event={"ID":"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a","Type":"ContainerDied","Data":"a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712"}
Jul 16 22:36:34.525355 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.525054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc448d8c8-ld4wr" event={"ID":"8e078b6c-bc8c-4b65-b6d2-6a9e450a505a","Type":"ContainerDied","Data":"f141d4eb9693e5eec45f38dd157c91a50e53bb144ce652962102d647ced35bfa"}
Jul 16 22:36:34.525355 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.525075    2558 scope.go:117] "RemoveContainer" containerID="a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712"
Jul 16 22:36:34.534171 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.534153    2558 scope.go:117] "RemoveContainer" containerID="a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712"
Jul 16 22:36:34.534494 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:36:34.534473    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712\": container with ID starting with a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712 not found: ID does not exist" containerID="a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712"
Jul 16 22:36:34.534550 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.534502    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712"} err="failed to get container status \"a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712\": rpc error: code = NotFound desc = could not find container \"a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712\": container with ID starting with a6bf49586e077c990deb2f7fe7c88dc84c4850d85a828cb70bcd3a85be04b712 not found: ID does not exist"
Jul 16 22:36:34.546837 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.546803    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc448d8c8-ld4wr"]
Jul 16 22:36:34.550519 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:34.550496    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc448d8c8-ld4wr"]
Jul 16 22:36:35.633191 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:35.633155    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" path="/var/lib/kubelet/pods/8e078b6c-bc8c-4b65-b6d2-6a9e450a505a/volumes"
Jul 16 22:36:42.061170 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.061131    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:36:42.061596 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.061477    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="alertmanager" containerID="cri-o://8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2" gracePeriod=120
Jul 16 22:36:42.061674 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.061558    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy-metric" containerID="cri-o://52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de" gracePeriod=120
Jul 16 22:36:42.061674 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.061624    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy-web" containerID="cri-o://5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96" gracePeriod=120
Jul 16 22:36:42.061775 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.061647    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy" containerID="cri-o://5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62" gracePeriod=120
Jul 16 22:36:42.061775 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.061566    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="prom-label-proxy" containerID="cri-o://ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768" gracePeriod=120
Jul 16 22:36:42.061775 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.061639    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="config-reloader" containerID="cri-o://375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04" gracePeriod=120
Jul 16 22:36:42.557753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.557720    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerID="ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768" exitCode=0
Jul 16 22:36:42.557753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.557745    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerID="5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62" exitCode=0
Jul 16 22:36:42.557753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.557752    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerID="375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04" exitCode=0
Jul 16 22:36:42.557753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.557757    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerID="8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2" exitCode=0
Jul 16 22:36:42.558041 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.557791    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerDied","Data":"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768"}
Jul 16 22:36:42.558041 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.557856    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerDied","Data":"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62"}
Jul 16 22:36:42.558041 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.557883    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerDied","Data":"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04"}
Jul 16 22:36:42.558041 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:42.557908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerDied","Data":"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2"}
Jul 16 22:36:43.360366 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.360336    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.516607 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516529    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-web\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516607 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516562    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-tls-assets\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516607 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516582    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-web-config\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516607 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516603    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nbb5\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-kube-api-access-5nbb5\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516951 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516628    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-out\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516951 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516646    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-cluster-tls-config\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516951 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516951 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516855    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-main-tls\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516951 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516920    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-volume\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.516951 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516951    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-main-db\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.517290 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.516996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.517290 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.517044    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-metrics-client-ca\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.517290 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.517070    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy\") pod \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\" (UID: \"ce612c2b-561e-43e1-a77f-b9c46a39bd80\") "
Jul 16 22:36:43.519563 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.519524    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:36:43.519685 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.519564    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:43.519924 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.519901    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-out" (OuterVolumeSpecName: "config-out") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:43.520010 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.519920    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:36:43.520129 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.520012    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-kube-api-access-5nbb5" (OuterVolumeSpecName: "kube-api-access-5nbb5") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "kube-api-access-5nbb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:36:43.520314 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.520260    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:36:43.520314 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.520270    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:43.520596 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.520561    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-volume" (OuterVolumeSpecName: "config-volume") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:43.520734 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.520715    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:43.521939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.521919    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:43.522008 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.521949    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:43.524573 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.524549    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:43.531388 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.531368    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-web-config" (OuterVolumeSpecName: "web-config") pod "ce612c2b-561e-43e1-a77f-b9c46a39bd80" (UID: "ce612c2b-561e-43e1-a77f-b9c46a39bd80"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:43.564922 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.564888    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerID="52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de" exitCode=0
Jul 16 22:36:43.564922 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.564915    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerID="5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96" exitCode=0
Jul 16 22:36:43.564922 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.564910    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerDied","Data":"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de"}
Jul 16 22:36:43.565100 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.564962    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.565100 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.564983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerDied","Data":"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96"}
Jul 16 22:36:43.565100 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.565013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce612c2b-561e-43e1-a77f-b9c46a39bd80","Type":"ContainerDied","Data":"b8f0371615c03f1855abb1403e82a0aac3122d384961be72d9a73e3698e2004b"}
Jul 16 22:36:43.565100 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.565048    2558 scope.go:117] "RemoveContainer" containerID="ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768"
Jul 16 22:36:43.572574 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.572555    2558 scope.go:117] "RemoveContainer" containerID="52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de"
Jul 16 22:36:43.579945 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.579923    2558 scope.go:117] "RemoveContainer" containerID="5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62"
Jul 16 22:36:43.586993 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.586977    2558 scope.go:117] "RemoveContainer" containerID="5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96"
Jul 16 22:36:43.589403 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.589376    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:36:43.594072 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.594046    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:36:43.595507 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.595492    2558 scope.go:117] "RemoveContainer" containerID="375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04"
Jul 16 22:36:43.602655 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.602637    2558 scope.go:117] "RemoveContainer" containerID="8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2"
Jul 16 22:36:43.609829 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.609810    2558 scope.go:117] "RemoveContainer" containerID="dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559"
Jul 16 22:36:43.616885 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.616863    2558 scope.go:117] "RemoveContainer" containerID="ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768"
Jul 16 22:36:43.617365 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:36:43.617195    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768\": container with ID starting with ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768 not found: ID does not exist" containerID="ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768"
Jul 16 22:36:43.617365 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.617258    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768"} err="failed to get container status \"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768\": rpc error: code = NotFound desc = could not find container \"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768\": container with ID starting with ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768 not found: ID does not exist"
Jul 16 22:36:43.617365 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.617285    2558 scope.go:117] "RemoveContainer" containerID="52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de"
Jul 16 22:36:43.617602 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:36:43.617575    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de\": container with ID starting with 52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de not found: ID does not exist" containerID="52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de"
Jul 16 22:36:43.617664 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.617611    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de"} err="failed to get container status \"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de\": rpc error: code = NotFound desc = could not find container \"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de\": container with ID starting with 52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de not found: ID does not exist"
Jul 16 22:36:43.617664 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.617634    2558 scope.go:117] "RemoveContainer" containerID="5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62"
Jul 16 22:36:43.617899 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:36:43.617879    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62\": container with ID starting with 5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62 not found: ID does not exist" containerID="5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62"
Jul 16 22:36:43.617958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.617906    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62"} err="failed to get container status \"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62\": rpc error: code = NotFound desc = could not find container \"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62\": container with ID starting with 5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62 not found: ID does not exist"
Jul 16 22:36:43.617958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.617926    2558 scope.go:117] "RemoveContainer" containerID="5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96"
Jul 16 22:36:43.618066 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618028    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nbb5\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-kube-api-access-5nbb5\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618066 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618050    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-out\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618066 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618061    2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-cluster-tls-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618070    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618085    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-main-tls\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618098    2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-config-volume\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618111    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce612c2b-561e-43e1-a77f-b9c46a39bd80-alertmanager-main-db\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618125    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618139    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce612c2b-561e-43e1-a77f-b9c46a39bd80-metrics-client-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618149    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618157    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618165    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce612c2b-561e-43e1-a77f-b9c46a39bd80-tls-assets\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618179 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:36:43.618164    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96\": container with ID starting with 5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96 not found: ID does not exist" containerID="5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96"
Jul 16 22:36:43.618549 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618196    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce612c2b-561e-43e1-a77f-b9c46a39bd80-web-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:36:43.618549 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618193    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96"} err="failed to get container status \"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96\": rpc error: code = NotFound desc = could not find container \"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96\": container with ID starting with 5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96 not found: ID does not exist"
Jul 16 22:36:43.618549 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618209    2558 scope.go:117] "RemoveContainer" containerID="375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04"
Jul 16 22:36:43.618549 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:36:43.618478    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04\": container with ID starting with 375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04 not found: ID does not exist" containerID="375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04"
Jul 16 22:36:43.618549 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618499    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04"} err="failed to get container status \"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04\": rpc error: code = NotFound desc = could not find container \"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04\": container with ID starting with 375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04 not found: ID does not exist"
Jul 16 22:36:43.618549 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618512    2558 scope.go:117] "RemoveContainer" containerID="8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2"
Jul 16 22:36:43.618786 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:36:43.618727    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2\": container with ID starting with 8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2 not found: ID does not exist" containerID="8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2"
Jul 16 22:36:43.618786 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618746    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2"} err="failed to get container status \"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2\": rpc error: code = NotFound desc = could not find container \"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2\": container with ID starting with 8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2 not found: ID does not exist"
Jul 16 22:36:43.618786 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618763    2558 scope.go:117] "RemoveContainer" containerID="dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559"
Jul 16 22:36:43.618904 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.618791    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:36:43.619016 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:36:43.619001    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559\": container with ID starting with dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559 not found: ID does not exist" containerID="dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559"
Jul 16 22:36:43.619060 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619020    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559"} err="failed to get container status \"dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559\": rpc error: code = NotFound desc = could not find container \"dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559\": container with ID starting with dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559 not found: ID does not exist"
Jul 16 22:36:43.619060 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619033    2558 scope.go:117] "RemoveContainer" containerID="ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768"
Jul 16 22:36:43.619156 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619128    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="config-reloader"
Jul 16 22:36:43.619156 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619141    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="config-reloader"
Jul 16 22:36:43.619156 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619148    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" containerName="console"
Jul 16 22:36:43.619156 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619154    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" containerName="console"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619161    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="prom-label-proxy"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619166    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="prom-label-proxy"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619178    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619186    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619206    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="init-config-reloader"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619214    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="init-config-reloader"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619249    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy-web"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619255    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy-web"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619262    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy-metric"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619267    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy-metric"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619266    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768"} err="failed to get container status \"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768\": rpc error: code = NotFound desc = could not find container \"ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768\": container with ID starting with ad97c05d58fbe6e570401015ef62d2b2e1be2da1a20d1690d06ba1c5e8d0c768 not found: ID does not exist"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619281    2558 scope.go:117] "RemoveContainer" containerID="52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619275    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="alertmanager"
Jul 16 22:36:43.619344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619327    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="alertmanager"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619401    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="alertmanager"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619412    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e078b6c-bc8c-4b65-b6d2-6a9e450a505a" containerName="console"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619423    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="prom-label-proxy"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619433    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy-metric"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619441    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy-web"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619450    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="kube-rbac-proxy"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619458    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" containerName="config-reloader"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619516    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de"} err="failed to get container status \"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de\": rpc error: code = NotFound desc = could not find container \"52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de\": container with ID starting with 52c13ace293062a59919eb2ccbbdffc894a53e069b32f0fb03c33e338e82e0de not found: ID does not exist"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619537    2558 scope.go:117] "RemoveContainer" containerID="5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619757    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62"} err="failed to get container status \"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62\": rpc error: code = NotFound desc = could not find container \"5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62\": container with ID starting with 5f923f81bca45fa22dc040d9605bfa771384b4072eef7463827f32ae8ad68f62 not found: ID does not exist"
Jul 16 22:36:43.619819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.619772    2558 scope.go:117] "RemoveContainer" containerID="5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96"
Jul 16 22:36:43.620396 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.620025    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96"} err="failed to get container status \"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96\": rpc error: code = NotFound desc = could not find container \"5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96\": container with ID starting with 5ca080ac3eeebc0027c2383e338536555a55018b52441490c2a342660236ea96 not found: ID does not exist"
Jul 16 22:36:43.620396 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.620041    2558 scope.go:117] "RemoveContainer" containerID="375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04"
Jul 16 22:36:43.620396 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.620324    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04"} err="failed to get container status \"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04\": rpc error: code = NotFound desc = could not find container \"375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04\": container with ID starting with 375f2695aab511a9a7c0d44143309f1eb048a860dc0c3432295b6815ead8ca04 not found: ID does not exist"
Jul 16 22:36:43.620396 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.620343    2558 scope.go:117] "RemoveContainer" containerID="8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2"
Jul 16 22:36:43.620632 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.620615    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2"} err="failed to get container status \"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2\": rpc error: code = NotFound desc = could not find container \"8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2\": container with ID starting with 8f40b7bec7a3d326596194f8975d58cb4cebe32dc5690aa3c8e4617e207ac4a2 not found: ID does not exist"
Jul 16 22:36:43.620686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.620632    2558 scope.go:117] "RemoveContainer" containerID="dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559"
Jul 16 22:36:43.620877 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.620858    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559"} err="failed to get container status \"dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559\": rpc error: code = NotFound desc = could not find container \"dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559\": container with ID starting with dfb7f88ed06841acc98d5845d73a2d9c60582e23d2bfe4cdb4ce6209e22b6559 not found: ID does not exist"
Jul 16 22:36:43.642013 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.641989    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.644971 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.644943    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 22:36:43.645063 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.644952    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4hk78\""
Jul 16 22:36:43.645183 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.645162    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 22:36:43.645183 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.645182    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 22:36:43.645612 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.645208    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 22:36:43.645612 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.645218    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 22:36:43.645612 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.645209    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 22:36:43.645612 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.645302    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 22:36:43.645874 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.645813    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 22:36:43.649902 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.649498    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce612c2b-561e-43e1-a77f-b9c46a39bd80" path="/var/lib/kubelet/pods/ce612c2b-561e-43e1-a77f-b9c46a39bd80/volumes"
Jul 16 22:36:43.650332 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.650206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:36:43.651040 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.651024    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 22:36:43.718855 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.718823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719005 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.718864    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9690a30c-d79f-4abf-816d-8ce549ad2ebe-config-out\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719005 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.718895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719005 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.718940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4mzs\" (UniqueName: \"kubernetes.io/projected/9690a30c-d79f-4abf-816d-8ce549ad2ebe-kube-api-access-k4mzs\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719005 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.718964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9690a30c-d79f-4abf-816d-8ce549ad2ebe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719138 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.719002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719138 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.719071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9690a30c-d79f-4abf-816d-8ce549ad2ebe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719138 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.719103    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9690a30c-d79f-4abf-816d-8ce549ad2ebe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719138 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.719124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-config-volume\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719348 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.719142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719348 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.719163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719348 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.719180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-web-config\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.719348 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.719297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9690a30c-d79f-4abf-816d-8ce549ad2ebe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820211 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820211 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820174    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9690a30c-d79f-4abf-816d-8ce549ad2ebe-config-out\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820211 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mzs\" (UniqueName: \"kubernetes.io/projected/9690a30c-d79f-4abf-816d-8ce549ad2ebe-kube-api-access-k4mzs\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9690a30c-d79f-4abf-816d-8ce549ad2ebe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9690a30c-d79f-4abf-816d-8ce549ad2ebe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820466 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820439    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9690a30c-d79f-4abf-816d-8ce549ad2ebe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-config-volume\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820888 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-web-config\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820888 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9690a30c-d79f-4abf-816d-8ce549ad2ebe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.820888 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.820782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9690a30c-d79f-4abf-816d-8ce549ad2ebe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.821367 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.821167    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9690a30c-d79f-4abf-816d-8ce549ad2ebe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.822284 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.821750    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9690a30c-d79f-4abf-816d-8ce549ad2ebe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.823356 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.823333    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9690a30c-d79f-4abf-816d-8ce549ad2ebe-config-out\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.823580 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.823537    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.823734 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.823701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.823934 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.823916    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9690a30c-d79f-4abf-816d-8ce549ad2ebe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.824012 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.823949    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.824174 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.824154    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-config-volume\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.824247 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.824218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.824644 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.824626    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.825308 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.825291    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9690a30c-d79f-4abf-816d-8ce549ad2ebe-web-config\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.830826 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.830807    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4mzs\" (UniqueName: \"kubernetes.io/projected/9690a30c-d79f-4abf-816d-8ce549ad2ebe-kube-api-access-k4mzs\") pod \"alertmanager-main-0\" (UID: \"9690a30c-d79f-4abf-816d-8ce549ad2ebe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:43.953379 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:43.953344    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 22:36:44.109035 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:44.109008    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 22:36:44.110040 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:36:44.110015    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9690a30c_d79f_4abf_816d_8ce549ad2ebe.slice/crio-3f4beb8e25d2a64c3ae7c942fdb5c771b7e03948e96478345f8f7f1b9eefeb27 WatchSource:0}: Error finding container 3f4beb8e25d2a64c3ae7c942fdb5c771b7e03948e96478345f8f7f1b9eefeb27: Status 404 returned error can't find the container with id 3f4beb8e25d2a64c3ae7c942fdb5c771b7e03948e96478345f8f7f1b9eefeb27
Jul 16 22:36:44.577175 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:44.577139    2558 generic.go:356] "Generic (PLEG): container finished" podID="9690a30c-d79f-4abf-816d-8ce549ad2ebe" containerID="cc1c55ef388764c900df6e681254fff893523258e58d552701fc8ffc17d01df4" exitCode=0
Jul 16 22:36:44.577560 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:44.577174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9690a30c-d79f-4abf-816d-8ce549ad2ebe","Type":"ContainerDied","Data":"cc1c55ef388764c900df6e681254fff893523258e58d552701fc8ffc17d01df4"}
Jul 16 22:36:44.577560 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:44.577303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9690a30c-d79f-4abf-816d-8ce549ad2ebe","Type":"ContainerStarted","Data":"3f4beb8e25d2a64c3ae7c942fdb5c771b7e03948e96478345f8f7f1b9eefeb27"}
Jul 16 22:36:45.584662 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:45.584627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9690a30c-d79f-4abf-816d-8ce549ad2ebe","Type":"ContainerStarted","Data":"a4d05683fb254c806d06dfca1ef163dc74df1df436f5cdc2958397c18993f5a7"}
Jul 16 22:36:45.585051 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:45.584690    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9690a30c-d79f-4abf-816d-8ce549ad2ebe","Type":"ContainerStarted","Data":"14ced295c26b30e119ff746da2ee88fdcc54030ccd5e47a838ea61e876acc1fc"}
Jul 16 22:36:45.585051 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:45.584717    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9690a30c-d79f-4abf-816d-8ce549ad2ebe","Type":"ContainerStarted","Data":"a8bbd331c7ec43a0489d388ab0fdbe4108dabee512179d503eafab3b59e375ab"}
Jul 16 22:36:45.585051 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:45.584746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9690a30c-d79f-4abf-816d-8ce549ad2ebe","Type":"ContainerStarted","Data":"3cac2d5d696377bd24e38df2c223d45e8e972e8f29ee21c3fccf70cd949f2512"}
Jul 16 22:36:45.585051 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:45.584769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9690a30c-d79f-4abf-816d-8ce549ad2ebe","Type":"ContainerStarted","Data":"f28b197ddd875dfe4411dad5690011c131ca62451fff1a09475007b0f5af6b47"}
Jul 16 22:36:45.585051 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:45.584791    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9690a30c-d79f-4abf-816d-8ce549ad2ebe","Type":"ContainerStarted","Data":"36165e5fca5591e45b42d14fd7630117d97c89dc4592856435fbbd7c23ab8f7a"}
Jul 16 22:36:45.614191 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:45.614132    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.598761186 podStartE2EDuration="2.614112494s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.351308ms" isStatefulPod=false podCreationTimestamp="2026-07-16 22:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:36:45.612610196 +0000 UTC m=+186.541620429" watchObservedRunningTime="2026-07-16 22:36:45.614112494 +0000 UTC m=+186.543122707"
Jul 16 22:36:46.029638 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.029603    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75c7d4df74-stgsr"]
Jul 16 22:36:46.032151 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.032129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.035442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.035417    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 16 22:36:46.035442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.035425    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k9f52\""
Jul 16 22:36:46.035606 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.035468    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 16 22:36:46.035606 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.035480    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 16 22:36:46.036188 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.036169    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 16 22:36:46.036385 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.036370    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 16 22:36:46.040530 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.040513    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 16 22:36:46.048055 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.048032    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75c7d4df74-stgsr"]
Jul 16 22:36:46.139438 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.139407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.139611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.139458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-metrics-client-ca\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.139611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.139501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-federate-client-tls\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.139611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.139541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.139611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.139572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-serving-certs-ca-bundle\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.139611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.139592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-secret-telemeter-client\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.139611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.139611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8n9\" (UniqueName: \"kubernetes.io/projected/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-kube-api-access-fz8n9\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.139870 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.139631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-telemeter-client-tls\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.240739 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.240705    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.240876 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.240768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-metrics-client-ca\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.240876 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.240822    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-federate-client-tls\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.240876 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.240850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.240998 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.240884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-serving-certs-ca-bundle\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.240998 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.240910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-secret-telemeter-client\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.240998 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.240943    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8n9\" (UniqueName: \"kubernetes.io/projected/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-kube-api-access-fz8n9\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.240998 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.240977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-telemeter-client-tls\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.241702 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.241677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-serving-certs-ca-bundle\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.242118 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.242096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.242181 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.242116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-metrics-client-ca\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.243804 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.243780    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.243975 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.243957    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-federate-client-tls\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.244119 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.244096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-secret-telemeter-client\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.244200 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.244186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-telemeter-client-tls\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.249721 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.249700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8n9\" (UniqueName: \"kubernetes.io/projected/57ab8d37-4e9c-42d1-9144-e6c20702a9ff-kube-api-access-fz8n9\") pod \"telemeter-client-75c7d4df74-stgsr\" (UID: \"57ab8d37-4e9c-42d1-9144-e6c20702a9ff\") " pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.341910 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.341838    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr"
Jul 16 22:36:46.474842 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.474811    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75c7d4df74-stgsr"]
Jul 16 22:36:46.478398 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:36:46.478377    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ab8d37_4e9c_42d1_9144_e6c20702a9ff.slice/crio-cf01efc72d343e58ecc556915f05dd3a6aa5e101808e0e3381e78e0e40299b34 WatchSource:0}: Error finding container cf01efc72d343e58ecc556915f05dd3a6aa5e101808e0e3381e78e0e40299b34: Status 404 returned error can't find the container with id cf01efc72d343e58ecc556915f05dd3a6aa5e101808e0e3381e78e0e40299b34
Jul 16 22:36:46.589678 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:46.589648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr" event={"ID":"57ab8d37-4e9c-42d1-9144-e6c20702a9ff","Type":"ContainerStarted","Data":"cf01efc72d343e58ecc556915f05dd3a6aa5e101808e0e3381e78e0e40299b34"}
Jul 16 22:36:48.599597 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:48.599513    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr" event={"ID":"57ab8d37-4e9c-42d1-9144-e6c20702a9ff","Type":"ContainerStarted","Data":"19c24a7f6875ea74e52f322cda8b7c6b860b7f6dfdd9396e40957c40424b105c"}
Jul 16 22:36:48.599597 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:48.599572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr" event={"ID":"57ab8d37-4e9c-42d1-9144-e6c20702a9ff","Type":"ContainerStarted","Data":"b9e0a39346b59cb3117644423e9cf659676cca3d6f7051d922331ccbfacf47b3"}
Jul 16 22:36:48.599597 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:48.599593    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr" event={"ID":"57ab8d37-4e9c-42d1-9144-e6c20702a9ff","Type":"ContainerStarted","Data":"f64bda39ad52a28714454209e74bb9a1fa892c9ccdf95838878fb7c7cbceb04a"}
Jul 16 22:36:48.630080 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:48.630027    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75c7d4df74-stgsr" podStartSLOduration=0.911198385 podStartE2EDuration="2.630011752s" totalImagesPullingTime="1.718813367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:36:48.6251098 +0000 UTC m=+189.554120012" watchObservedRunningTime="2026-07-16 22:36:48.630011752 +0000 UTC m=+189.559021963"
Jul 16 22:36:49.364034 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.363996    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb6d4477d-7dv24"]
Jul 16 22:36:49.366219 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.366203    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.388431 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.388405    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb6d4477d-7dv24"]
Jul 16 22:36:49.470818 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.470778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-oauth-config\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.470818 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.470828    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-oauth-serving-cert\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.471089 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.470861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzl6c\" (UniqueName: \"kubernetes.io/projected/aae75850-ecb8-44cb-9e98-4773a2c55f2a-kube-api-access-qzl6c\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.471089 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.470966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-serving-cert\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.471089 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.471005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-config\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.471089 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.471084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-service-ca\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.471333 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.471107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-trusted-ca-bundle\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572056 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572021    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-serving-cert\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572056 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-config\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572321 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572088    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-service-ca\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572321 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-trusted-ca-bundle\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572321 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-oauth-config\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572485 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572330    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-oauth-serving-cert\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572485 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzl6c\" (UniqueName: \"kubernetes.io/projected/aae75850-ecb8-44cb-9e98-4773a2c55f2a-kube-api-access-qzl6c\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572872 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572844    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-service-ca\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.572872 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.572860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-config\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.573201 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.573008    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-oauth-serving-cert\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.573201 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.573072    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-trusted-ca-bundle\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.575393 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.575370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-serving-cert\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.575393 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.575387    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-oauth-config\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.589120 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.589099    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzl6c\" (UniqueName: \"kubernetes.io/projected/aae75850-ecb8-44cb-9e98-4773a2c55f2a-kube-api-access-qzl6c\") pod \"console-5cb6d4477d-7dv24\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") " pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.675203 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.675166    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:49.808793 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:49.808773    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb6d4477d-7dv24"]
Jul 16 22:36:49.810966 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:36:49.810944    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae75850_ecb8_44cb_9e98_4773a2c55f2a.slice/crio-8d4d76606c9c683670ec83f29daac49bcdfc3f9224e80091df0dcbd3ec959ae9 WatchSource:0}: Error finding container 8d4d76606c9c683670ec83f29daac49bcdfc3f9224e80091df0dcbd3ec959ae9: Status 404 returned error can't find the container with id 8d4d76606c9c683670ec83f29daac49bcdfc3f9224e80091df0dcbd3ec959ae9
Jul 16 22:36:50.615970 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:50.615931    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb6d4477d-7dv24" event={"ID":"aae75850-ecb8-44cb-9e98-4773a2c55f2a","Type":"ContainerStarted","Data":"692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57"}
Jul 16 22:36:50.616113 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:50.616007    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb6d4477d-7dv24" event={"ID":"aae75850-ecb8-44cb-9e98-4773a2c55f2a","Type":"ContainerStarted","Data":"8d4d76606c9c683670ec83f29daac49bcdfc3f9224e80091df0dcbd3ec959ae9"}
Jul 16 22:36:59.675687 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:59.675654    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:59.676082 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:59.675706    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:59.680503 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:59.680478    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:36:59.700189 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:36:59.700117    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb6d4477d-7dv24" podStartSLOduration=10.700102755 podStartE2EDuration="10.700102755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:36:50.641674116 +0000 UTC m=+191.570684328" watchObservedRunningTime="2026-07-16 22:36:59.700102755 +0000 UTC m=+200.629112968"
Jul 16 22:37:00.659324 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:00.659294    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:37:00.714120 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:00.714085    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c7d57549-d9kjn"]
Jul 16 22:37:25.738741 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:25.738682    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68c7d57549-d9kjn" podUID="53880697-2701-498d-b7be-e78e7ac2d7ff" containerName="console" containerID="cri-o://371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e" gracePeriod=15
Jul 16 22:37:25.983189 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:25.983165    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:37:26.089604 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.089520    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-trusted-ca-bundle\") pod \"53880697-2701-498d-b7be-e78e7ac2d7ff\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") "
Jul 16 22:37:26.089604 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.089574    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-service-ca\") pod \"53880697-2701-498d-b7be-e78e7ac2d7ff\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") "
Jul 16 22:37:26.089821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.089610    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flf8n\" (UniqueName: \"kubernetes.io/projected/53880697-2701-498d-b7be-e78e7ac2d7ff-kube-api-access-flf8n\") pod \"53880697-2701-498d-b7be-e78e7ac2d7ff\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") "
Jul 16 22:37:26.089821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.089647    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-oauth-config\") pod \"53880697-2701-498d-b7be-e78e7ac2d7ff\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") "
Jul 16 22:37:26.089821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.089671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-oauth-serving-cert\") pod \"53880697-2701-498d-b7be-e78e7ac2d7ff\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") "
Jul 16 22:37:26.089821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.089697    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-serving-cert\") pod \"53880697-2701-498d-b7be-e78e7ac2d7ff\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") "
Jul 16 22:37:26.089821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.089737    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-console-config\") pod \"53880697-2701-498d-b7be-e78e7ac2d7ff\" (UID: \"53880697-2701-498d-b7be-e78e7ac2d7ff\") "
Jul 16 22:37:26.090145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.090106    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53880697-2701-498d-b7be-e78e7ac2d7ff" (UID: "53880697-2701-498d-b7be-e78e7ac2d7ff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:37:26.090145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.090124    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "53880697-2701-498d-b7be-e78e7ac2d7ff" (UID: "53880697-2701-498d-b7be-e78e7ac2d7ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:37:26.090145 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.090127    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53880697-2701-498d-b7be-e78e7ac2d7ff" (UID: "53880697-2701-498d-b7be-e78e7ac2d7ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:37:26.090510 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.090217    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-console-config" (OuterVolumeSpecName: "console-config") pod "53880697-2701-498d-b7be-e78e7ac2d7ff" (UID: "53880697-2701-498d-b7be-e78e7ac2d7ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:37:26.090510 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.090325    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-service-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:37:26.090510 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.090344    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-oauth-serving-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:37:26.090510 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.090358    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-console-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:37:26.090510 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.090366    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53880697-2701-498d-b7be-e78e7ac2d7ff-trusted-ca-bundle\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:37:26.092013 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.091987    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53880697-2701-498d-b7be-e78e7ac2d7ff" (UID: "53880697-2701-498d-b7be-e78e7ac2d7ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:37:26.092121 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.092025    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53880697-2701-498d-b7be-e78e7ac2d7ff-kube-api-access-flf8n" (OuterVolumeSpecName: "kube-api-access-flf8n") pod "53880697-2701-498d-b7be-e78e7ac2d7ff" (UID: "53880697-2701-498d-b7be-e78e7ac2d7ff"). InnerVolumeSpecName "kube-api-access-flf8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:37:26.092121 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.092081    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53880697-2701-498d-b7be-e78e7ac2d7ff" (UID: "53880697-2701-498d-b7be-e78e7ac2d7ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:37:26.191369 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.191340    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-serving-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:37:26.191369 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.191366    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flf8n\" (UniqueName: \"kubernetes.io/projected/53880697-2701-498d-b7be-e78e7ac2d7ff-kube-api-access-flf8n\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:37:26.191511 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.191380    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53880697-2701-498d-b7be-e78e7ac2d7ff-console-oauth-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:37:26.756288 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.756213    2558 generic.go:356] "Generic (PLEG): container finished" podID="53880697-2701-498d-b7be-e78e7ac2d7ff" containerID="371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e" exitCode=0
Jul 16 22:37:26.756288 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.756285    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c7d57549-d9kjn"
Jul 16 22:37:26.756745 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.756306    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c7d57549-d9kjn" event={"ID":"53880697-2701-498d-b7be-e78e7ac2d7ff","Type":"ContainerDied","Data":"371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e"}
Jul 16 22:37:26.756745 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.756361    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c7d57549-d9kjn" event={"ID":"53880697-2701-498d-b7be-e78e7ac2d7ff","Type":"ContainerDied","Data":"c7a1e1d139e2ee8dcb944deec1bb59d04baa64f2df70103789470ca7b1ef8237"}
Jul 16 22:37:26.756745 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.756380    2558 scope.go:117] "RemoveContainer" containerID="371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e"
Jul 16 22:37:26.765125 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.765109    2558 scope.go:117] "RemoveContainer" containerID="371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e"
Jul 16 22:37:26.765354 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:37:26.765335    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e\": container with ID starting with 371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e not found: ID does not exist" containerID="371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e"
Jul 16 22:37:26.765424 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.765366    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e"} err="failed to get container status \"371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e\": rpc error: code = NotFound desc = could not find container \"371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e\": container with ID starting with 371fe5c34a39f654df6285e7bc82b7db60a59c1d0c97c04a37d65c68cf6cf69e not found: ID does not exist"
Jul 16 22:37:26.777628 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.777598    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c7d57549-d9kjn"]
Jul 16 22:37:26.783740 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:26.783716    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68c7d57549-d9kjn"]
Jul 16 22:37:27.633270 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:37:27.633212    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53880697-2701-498d-b7be-e78e7ac2d7ff" path="/var/lib/kubelet/pods/53880697-2701-498d-b7be-e78e7ac2d7ff/volumes"
Jul 16 22:38:39.447862 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:39.447830    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:38:39.451052 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:39.451027    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:38:39.463095 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:39.463067    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:38:39.465586 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:39.465562    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 22:38:39.466586 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:39.466566    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:38:40.719455 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.719420    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f79db6d4b-rbblz"]
Jul 16 22:38:40.721760 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.719868    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53880697-2701-498d-b7be-e78e7ac2d7ff" containerName="console"
Jul 16 22:38:40.721760 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.719886    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="53880697-2701-498d-b7be-e78e7ac2d7ff" containerName="console"
Jul 16 22:38:40.721760 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.719970    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="53880697-2701-498d-b7be-e78e7ac2d7ff" containerName="console"
Jul 16 22:38:40.722704 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.722684    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.726432 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.726406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-oauth-config\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.726569 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.726476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-service-ca\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.726569 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.726515    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvmg6\" (UniqueName: \"kubernetes.io/projected/69209a16-b241-4894-a49f-881dc22e73fb-kube-api-access-xvmg6\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.726695 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.726591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-serving-cert\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.726695 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.726626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-trusted-ca-bundle\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.726826 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.726727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-console-config\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.726826 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.726774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-oauth-serving-cert\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.733499 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.733474    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f79db6d4b-rbblz"]
Jul 16 22:38:40.827677 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.827634    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-oauth-config\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.827852 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.827708    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-service-ca\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.827852 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.827741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvmg6\" (UniqueName: \"kubernetes.io/projected/69209a16-b241-4894-a49f-881dc22e73fb-kube-api-access-xvmg6\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.827852 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.827759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-serving-cert\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.827852 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.827777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-trusted-ca-bundle\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.827852 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.827839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-console-config\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.828113 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.827875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-oauth-serving-cert\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.828666 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.828634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-service-ca\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.828793 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.828744    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-oauth-serving-cert\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.828874 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.828850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-console-config\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.828969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.828953    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-trusted-ca-bundle\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.830861 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.830842    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-serving-cert\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.830936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.830870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-oauth-config\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:40.837421 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:40.837399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvmg6\" (UniqueName: \"kubernetes.io/projected/69209a16-b241-4894-a49f-881dc22e73fb-kube-api-access-xvmg6\") pod \"console-6f79db6d4b-rbblz\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") " pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:41.034806 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:41.034711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:41.173820 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:41.173793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f79db6d4b-rbblz"]
Jul 16 22:38:41.176511 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:38:41.176466    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69209a16_b241_4894_a49f_881dc22e73fb.slice/crio-f01b5dab8e5738fe45761e647d7a9dd82d3524241e61c8c275b76421878e82a1 WatchSource:0}: Error finding container f01b5dab8e5738fe45761e647d7a9dd82d3524241e61c8c275b76421878e82a1: Status 404 returned error can't find the container with id f01b5dab8e5738fe45761e647d7a9dd82d3524241e61c8c275b76421878e82a1
Jul 16 22:38:42.049858 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:42.049823    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f79db6d4b-rbblz" event={"ID":"69209a16-b241-4894-a49f-881dc22e73fb","Type":"ContainerStarted","Data":"8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd"}
Jul 16 22:38:42.050262 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:42.049879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f79db6d4b-rbblz" event={"ID":"69209a16-b241-4894-a49f-881dc22e73fb","Type":"ContainerStarted","Data":"f01b5dab8e5738fe45761e647d7a9dd82d3524241e61c8c275b76421878e82a1"}
Jul 16 22:38:42.071718 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:42.071670    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f79db6d4b-rbblz" podStartSLOduration=2.071654343 podStartE2EDuration="2.071654343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:38:42.068182258 +0000 UTC m=+302.997192471" watchObservedRunningTime="2026-07-16 22:38:42.071654343 +0000 UTC m=+303.000664555"
Jul 16 22:38:51.035729 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:51.035692    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:51.036180 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:51.035761    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:51.040390 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:51.040370    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:51.089937 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:51.089911    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:38:51.136532 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:38:51.136498    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb6d4477d-7dv24"]
Jul 16 22:39:10.544125 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.544086    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"]
Jul 16 22:39:10.547194 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.547178    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"
Jul 16 22:39:10.549935 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.549913    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 16 22:39:10.549935 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.549928    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-q9bv2\""
Jul 16 22:39:10.550168 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.550154    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:39:10.560847 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.560824    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"]
Jul 16 22:39:10.681647 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.681614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbhfq\" (UniqueName: \"kubernetes.io/projected/ad954191-0657-4033-a622-67fa5de62820-kube-api-access-gbhfq\") pod \"cert-manager-operator-controller-manager-55c444bf86-d4ls4\" (UID: \"ad954191-0657-4033-a622-67fa5de62820\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"
Jul 16 22:39:10.681809 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.681655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad954191-0657-4033-a622-67fa5de62820-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d4ls4\" (UID: \"ad954191-0657-4033-a622-67fa5de62820\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"
Jul 16 22:39:10.783006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.782974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbhfq\" (UniqueName: \"kubernetes.io/projected/ad954191-0657-4033-a622-67fa5de62820-kube-api-access-gbhfq\") pod \"cert-manager-operator-controller-manager-55c444bf86-d4ls4\" (UID: \"ad954191-0657-4033-a622-67fa5de62820\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"
Jul 16 22:39:10.783156 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.783017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad954191-0657-4033-a622-67fa5de62820-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d4ls4\" (UID: \"ad954191-0657-4033-a622-67fa5de62820\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"
Jul 16 22:39:10.783393 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.783374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad954191-0657-4033-a622-67fa5de62820-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d4ls4\" (UID: \"ad954191-0657-4033-a622-67fa5de62820\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"
Jul 16 22:39:10.792385 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.792364    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbhfq\" (UniqueName: \"kubernetes.io/projected/ad954191-0657-4033-a622-67fa5de62820-kube-api-access-gbhfq\") pod \"cert-manager-operator-controller-manager-55c444bf86-d4ls4\" (UID: \"ad954191-0657-4033-a622-67fa5de62820\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"
Jul 16 22:39:10.856379 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.856321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"
Jul 16 22:39:10.993203 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:10.993068    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4"]
Jul 16 22:39:10.997435 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:39:10.997406    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad954191_0657_4033_a622_67fa5de62820.slice/crio-06797b2222371074d9a33d070664d7642ba462d3af8df4aa8db10bb540d0f1a8 WatchSource:0}: Error finding container 06797b2222371074d9a33d070664d7642ba462d3af8df4aa8db10bb540d0f1a8: Status 404 returned error can't find the container with id 06797b2222371074d9a33d070664d7642ba462d3af8df4aa8db10bb540d0f1a8
Jul 16 22:39:11.000202 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:11.000181    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:39:11.165564 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:11.165537    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4" event={"ID":"ad954191-0657-4033-a622-67fa5de62820","Type":"ContainerStarted","Data":"06797b2222371074d9a33d070664d7642ba462d3af8df4aa8db10bb540d0f1a8"}
Jul 16 22:39:14.182460 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:14.182422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4" event={"ID":"ad954191-0657-4033-a622-67fa5de62820","Type":"ContainerStarted","Data":"199c0d2a94600a9757de46e98f334d5914ac733fe461434e8c430069f899d650"}
Jul 16 22:39:14.205046 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:14.204986    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d4ls4" podStartSLOduration=1.339790438 podStartE2EDuration="4.204964924s" totalImagesPullingTime="2.865174486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:39:14.20327982 +0000 UTC m=+335.132290032" watchObservedRunningTime="2026-07-16 22:39:14.204964924 +0000 UTC m=+335.133975141"
Jul 16 22:39:16.159186 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.159143    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cb6d4477d-7dv24" podUID="aae75850-ecb8-44cb-9e98-4773a2c55f2a" containerName="console" containerID="cri-o://692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57" gracePeriod=15
Jul 16 22:39:16.391617 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.391590    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:39:16.536992 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.536908    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-oauth-config\") pod \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") "
Jul 16 22:39:16.536992 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.536957    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-serving-cert\") pod \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") "
Jul 16 22:39:16.536992 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.536990    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-trusted-ca-bundle\") pod \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") "
Jul 16 22:39:16.537269 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.537013    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-service-ca\") pod \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") "
Jul 16 22:39:16.537269 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.537035    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-oauth-serving-cert\") pod \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") "
Jul 16 22:39:16.537269 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.537067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-config\") pod \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") "
Jul 16 22:39:16.537269 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.537084    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzl6c\" (UniqueName: \"kubernetes.io/projected/aae75850-ecb8-44cb-9e98-4773a2c55f2a-kube-api-access-qzl6c\") pod \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\" (UID: \"aae75850-ecb8-44cb-9e98-4773a2c55f2a\") "
Jul 16 22:39:16.537552 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.537515    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-service-ca" (OuterVolumeSpecName: "service-ca") pod "aae75850-ecb8-44cb-9e98-4773a2c55f2a" (UID: "aae75850-ecb8-44cb-9e98-4773a2c55f2a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:39:16.537664 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.537554    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aae75850-ecb8-44cb-9e98-4773a2c55f2a" (UID: "aae75850-ecb8-44cb-9e98-4773a2c55f2a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:39:16.537664 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.537562    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-config" (OuterVolumeSpecName: "console-config") pod "aae75850-ecb8-44cb-9e98-4773a2c55f2a" (UID: "aae75850-ecb8-44cb-9e98-4773a2c55f2a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:39:16.537664 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.537608    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aae75850-ecb8-44cb-9e98-4773a2c55f2a" (UID: "aae75850-ecb8-44cb-9e98-4773a2c55f2a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:39:16.539449 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.539425    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae75850-ecb8-44cb-9e98-4773a2c55f2a-kube-api-access-qzl6c" (OuterVolumeSpecName: "kube-api-access-qzl6c") pod "aae75850-ecb8-44cb-9e98-4773a2c55f2a" (UID: "aae75850-ecb8-44cb-9e98-4773a2c55f2a"). InnerVolumeSpecName "kube-api-access-qzl6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:39:16.539449 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.539436    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aae75850-ecb8-44cb-9e98-4773a2c55f2a" (UID: "aae75850-ecb8-44cb-9e98-4773a2c55f2a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:39:16.539449 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.539424    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aae75850-ecb8-44cb-9e98-4773a2c55f2a" (UID: "aae75850-ecb8-44cb-9e98-4773a2c55f2a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:39:16.637921 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.637889    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-oauth-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:39:16.637921 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.637916    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-serving-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:39:16.637921 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.637925    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-trusted-ca-bundle\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:39:16.638125 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.637933    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-service-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:39:16.638125 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.637941    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-oauth-serving-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:39:16.638125 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.637950    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae75850-ecb8-44cb-9e98-4773a2c55f2a-console-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:39:16.638125 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:16.637959    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzl6c\" (UniqueName: \"kubernetes.io/projected/aae75850-ecb8-44cb-9e98-4773a2c55f2a-kube-api-access-qzl6c\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:39:17.197074 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.197036    2558 generic.go:356] "Generic (PLEG): container finished" podID="aae75850-ecb8-44cb-9e98-4773a2c55f2a" containerID="692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57" exitCode=0
Jul 16 22:39:17.197074 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.197076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb6d4477d-7dv24" event={"ID":"aae75850-ecb8-44cb-9e98-4773a2c55f2a","Type":"ContainerDied","Data":"692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57"}
Jul 16 22:39:17.197520 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.197094    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb6d4477d-7dv24"
Jul 16 22:39:17.197520 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.197120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb6d4477d-7dv24" event={"ID":"aae75850-ecb8-44cb-9e98-4773a2c55f2a","Type":"ContainerDied","Data":"8d4d76606c9c683670ec83f29daac49bcdfc3f9224e80091df0dcbd3ec959ae9"}
Jul 16 22:39:17.197520 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.197142    2558 scope.go:117] "RemoveContainer" containerID="692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57"
Jul 16 22:39:17.205837 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.205820    2558 scope.go:117] "RemoveContainer" containerID="692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57"
Jul 16 22:39:17.206081 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:39:17.206063    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57\": container with ID starting with 692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57 not found: ID does not exist" containerID="692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57"
Jul 16 22:39:17.206120 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.206089    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57"} err="failed to get container status \"692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57\": rpc error: code = NotFound desc = could not find container \"692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57\": container with ID starting with 692e5edd396e559d71f65cc4d5c59519780e3b25d9c1e2f5984ec4359b742c57 not found: ID does not exist"
Jul 16 22:39:17.250971 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.250941    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb6d4477d-7dv24"]
Jul 16 22:39:17.261806 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.261777    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb6d4477d-7dv24"]
Jul 16 22:39:17.634166 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:17.634135    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae75850-ecb8-44cb-9e98-4773a2c55f2a" path="/var/lib/kubelet/pods/aae75850-ecb8-44cb-9e98-4773a2c55f2a/volumes"
Jul 16 22:39:22.972416 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.972379    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"]
Jul 16 22:39:22.972932 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.972710    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae75850-ecb8-44cb-9e98-4773a2c55f2a" containerName="console"
Jul 16 22:39:22.972932 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.972724    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae75850-ecb8-44cb-9e98-4773a2c55f2a" containerName="console"
Jul 16 22:39:22.972932 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.972796    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae75850-ecb8-44cb-9e98-4773a2c55f2a" containerName="console"
Jul 16 22:39:22.977319 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.977302    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"
Jul 16 22:39:22.980692 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.980661    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 22:39:22.981793 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.981777    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mmn9c\""
Jul 16 22:39:22.981793 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.981787    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 22:39:22.992202 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:22.992178    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"]
Jul 16 22:39:23.090940 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:23.090904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f32b3da-b48c-4766-81f9-94a3dfadd438-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jq58r\" (UID: \"8f32b3da-b48c-4766-81f9-94a3dfadd438\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"
Jul 16 22:39:23.091112 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:23.090972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znstl\" (UniqueName: \"kubernetes.io/projected/8f32b3da-b48c-4766-81f9-94a3dfadd438-kube-api-access-znstl\") pod \"cert-manager-cainjector-559cdd8c87-jq58r\" (UID: \"8f32b3da-b48c-4766-81f9-94a3dfadd438\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"
Jul 16 22:39:23.191933 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:23.191893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f32b3da-b48c-4766-81f9-94a3dfadd438-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jq58r\" (UID: \"8f32b3da-b48c-4766-81f9-94a3dfadd438\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"
Jul 16 22:39:23.192087 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:23.191988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znstl\" (UniqueName: \"kubernetes.io/projected/8f32b3da-b48c-4766-81f9-94a3dfadd438-kube-api-access-znstl\") pod \"cert-manager-cainjector-559cdd8c87-jq58r\" (UID: \"8f32b3da-b48c-4766-81f9-94a3dfadd438\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"
Jul 16 22:39:23.202344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:23.202316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f32b3da-b48c-4766-81f9-94a3dfadd438-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jq58r\" (UID: \"8f32b3da-b48c-4766-81f9-94a3dfadd438\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"
Jul 16 22:39:23.202638 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:23.202620    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znstl\" (UniqueName: \"kubernetes.io/projected/8f32b3da-b48c-4766-81f9-94a3dfadd438-kube-api-access-znstl\") pod \"cert-manager-cainjector-559cdd8c87-jq58r\" (UID: \"8f32b3da-b48c-4766-81f9-94a3dfadd438\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"
Jul 16 22:39:23.286434 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:23.286352    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"
Jul 16 22:39:23.422172 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:23.422017    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jq58r"]
Jul 16 22:39:23.425065 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:39:23.425039    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f32b3da_b48c_4766_81f9_94a3dfadd438.slice/crio-0973a883a7af47dd38647fd8d3680ddda65fa66ee69b6ee3bb30f5ea72bc6ce1 WatchSource:0}: Error finding container 0973a883a7af47dd38647fd8d3680ddda65fa66ee69b6ee3bb30f5ea72bc6ce1: Status 404 returned error can't find the container with id 0973a883a7af47dd38647fd8d3680ddda65fa66ee69b6ee3bb30f5ea72bc6ce1
Jul 16 22:39:24.230293 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:24.230258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r" event={"ID":"8f32b3da-b48c-4766-81f9-94a3dfadd438","Type":"ContainerStarted","Data":"0973a883a7af47dd38647fd8d3680ddda65fa66ee69b6ee3bb30f5ea72bc6ce1"}
Jul 16 22:39:26.242243 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:26.242191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r" event={"ID":"8f32b3da-b48c-4766-81f9-94a3dfadd438","Type":"ContainerStarted","Data":"a9abd33a27964afbc15ab6002bd32e04405aeaa70c5e9e4b1addc0f85eef331d"}
Jul 16 22:39:26.273167 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:26.273024    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jq58r" podStartSLOduration=1.705226905 podStartE2EDuration="4.273003229s" totalImagesPullingTime="2.567776324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:39:26.2722102 +0000 UTC m=+347.201220453" watchObservedRunningTime="2026-07-16 22:39:26.273003229 +0000 UTC m=+347.202013444"
Jul 16 22:39:28.359798 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.359769    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"]
Jul 16 22:39:28.363015 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.362998    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"
Jul 16 22:39:28.366832 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.366800    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xqlvp\""
Jul 16 22:39:28.367036 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.367023    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:39:28.368046 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.368031    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 22:39:28.397899 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.397879    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"]
Jul 16 22:39:28.542600 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.542565    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ntqv\" (UniqueName: \"kubernetes.io/projected/ddd2beab-b072-41ec-bd2f-cb3c5e25c61a-kube-api-access-6ntqv\") pod \"openshift-lws-operator-fd8ccff4c-7tdgj\" (UID: \"ddd2beab-b072-41ec-bd2f-cb3c5e25c61a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"
Jul 16 22:39:28.542779 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.542612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddd2beab-b072-41ec-bd2f-cb3c5e25c61a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7tdgj\" (UID: \"ddd2beab-b072-41ec-bd2f-cb3c5e25c61a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"
Jul 16 22:39:28.643901 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.643864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ntqv\" (UniqueName: \"kubernetes.io/projected/ddd2beab-b072-41ec-bd2f-cb3c5e25c61a-kube-api-access-6ntqv\") pod \"openshift-lws-operator-fd8ccff4c-7tdgj\" (UID: \"ddd2beab-b072-41ec-bd2f-cb3c5e25c61a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"
Jul 16 22:39:28.644055 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.643910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddd2beab-b072-41ec-bd2f-cb3c5e25c61a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7tdgj\" (UID: \"ddd2beab-b072-41ec-bd2f-cb3c5e25c61a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"
Jul 16 22:39:28.644296 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.644279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddd2beab-b072-41ec-bd2f-cb3c5e25c61a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7tdgj\" (UID: \"ddd2beab-b072-41ec-bd2f-cb3c5e25c61a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"
Jul 16 22:39:28.653738 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.653704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ntqv\" (UniqueName: \"kubernetes.io/projected/ddd2beab-b072-41ec-bd2f-cb3c5e25c61a-kube-api-access-6ntqv\") pod \"openshift-lws-operator-fd8ccff4c-7tdgj\" (UID: \"ddd2beab-b072-41ec-bd2f-cb3c5e25c61a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"
Jul 16 22:39:28.671596 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.671573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"
Jul 16 22:39:28.816796 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:28.816770    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj"]
Jul 16 22:39:28.819510 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:39:28.819483    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddd2beab_b072_41ec_bd2f_cb3c5e25c61a.slice/crio-7ce708026937315ab9aaa736aca93de4644b7e2748b4c7f10cd0475cf17be1c6 WatchSource:0}: Error finding container 7ce708026937315ab9aaa736aca93de4644b7e2748b4c7f10cd0475cf17be1c6: Status 404 returned error can't find the container with id 7ce708026937315ab9aaa736aca93de4644b7e2748b4c7f10cd0475cf17be1c6
Jul 16 22:39:29.257141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:29.257104    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj" event={"ID":"ddd2beab-b072-41ec-bd2f-cb3c5e25c61a","Type":"ContainerStarted","Data":"7ce708026937315ab9aaa736aca93de4644b7e2748b4c7f10cd0475cf17be1c6"}
Jul 16 22:39:32.274382 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:32.274346    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj" event={"ID":"ddd2beab-b072-41ec-bd2f-cb3c5e25c61a","Type":"ContainerStarted","Data":"74747b992573b7d1b01dcdec7f7eadd36faebbd3990370d26bf015bac7278544"}
Jul 16 22:39:32.295483 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:32.295428    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tdgj" podStartSLOduration=1.742488653 podStartE2EDuration="4.295407526s" totalImagesPullingTime="2.552918873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:39:32.293921976 +0000 UTC m=+353.222932189" watchObservedRunningTime="2026-07-16 22:39:32.295407526 +0000 UTC m=+353.224417740"
Jul 16 22:39:47.981413 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:47.981381    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"]
Jul 16 22:39:47.987168 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:47.987146    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:47.992156 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:47.992135    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 22:39:47.992294 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:47.992135    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 22:39:47.992294 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:47.992160    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xs9sp\""
Jul 16 22:39:47.993384 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:47.993359    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 22:39:47.993503 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:47.993364    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 22:39:48.012103 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.012076    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"]
Jul 16 22:39:48.119262 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.119201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwkcw\" (UniqueName: \"kubernetes.io/projected/62bb22b3-83fc-49ac-8cd2-44054ec16b21-kube-api-access-qwkcw\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.119467 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.119356    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62bb22b3-83fc-49ac-8cd2-44054ec16b21-manifests\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.119467 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.119401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62bb22b3-83fc-49ac-8cd2-44054ec16b21-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.119467 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.119439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62bb22b3-83fc-49ac-8cd2-44054ec16b21-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.119608 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.119468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62bb22b3-83fc-49ac-8cd2-44054ec16b21-tmp\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.220587 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.220560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62bb22b3-83fc-49ac-8cd2-44054ec16b21-manifests\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.220774 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.220599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62bb22b3-83fc-49ac-8cd2-44054ec16b21-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.220774 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.220621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62bb22b3-83fc-49ac-8cd2-44054ec16b21-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.220774 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.220641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62bb22b3-83fc-49ac-8cd2-44054ec16b21-tmp\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.220774 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.220676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkcw\" (UniqueName: \"kubernetes.io/projected/62bb22b3-83fc-49ac-8cd2-44054ec16b21-kube-api-access-qwkcw\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.221013 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.220980    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62bb22b3-83fc-49ac-8cd2-44054ec16b21-manifests\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.223135 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.223112    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62bb22b3-83fc-49ac-8cd2-44054ec16b21-tmp\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.223423 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.223406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62bb22b3-83fc-49ac-8cd2-44054ec16b21-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.223491 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.223404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62bb22b3-83fc-49ac-8cd2-44054ec16b21-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.232897 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.232847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwkcw\" (UniqueName: \"kubernetes.io/projected/62bb22b3-83fc-49ac-8cd2-44054ec16b21-kube-api-access-qwkcw\") pod \"opendatahub-operator-controller-manager-6bb6b77ff4-572sq\" (UID: \"62bb22b3-83fc-49ac-8cd2-44054ec16b21\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.297847 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.297814    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:48.440761 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:48.440732    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"]
Jul 16 22:39:48.442827 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:39:48.442794    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bb22b3_83fc_49ac_8cd2_44054ec16b21.slice/crio-c99f9d3fb339378f7308ae04f39655bda45d0d3c5f79cce3c84d70dfcc5b3976 WatchSource:0}: Error finding container c99f9d3fb339378f7308ae04f39655bda45d0d3c5f79cce3c84d70dfcc5b3976: Status 404 returned error can't find the container with id c99f9d3fb339378f7308ae04f39655bda45d0d3c5f79cce3c84d70dfcc5b3976
Jul 16 22:39:49.348791 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:49.348748    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq" event={"ID":"62bb22b3-83fc-49ac-8cd2-44054ec16b21","Type":"ContainerStarted","Data":"c99f9d3fb339378f7308ae04f39655bda45d0d3c5f79cce3c84d70dfcc5b3976"}
Jul 16 22:39:52.366050 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:52.366006    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq" event={"ID":"62bb22b3-83fc-49ac-8cd2-44054ec16b21","Type":"ContainerStarted","Data":"d9041fb3593f38764325758fa8da40ee279de48bbdbf0ffd455428d31694fd68"}
Jul 16 22:39:53.371880 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:53.371845    2558 generic.go:356] "Generic (PLEG): container finished" podID="62bb22b3-83fc-49ac-8cd2-44054ec16b21" containerID="d9041fb3593f38764325758fa8da40ee279de48bbdbf0ffd455428d31694fd68" exitCode=0
Jul 16 22:39:53.372294 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:53.371939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq" event={"ID":"62bb22b3-83fc-49ac-8cd2-44054ec16b21","Type":"ContainerDied","Data":"d9041fb3593f38764325758fa8da40ee279de48bbdbf0ffd455428d31694fd68"}
Jul 16 22:39:54.378555 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:54.378512    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq" event={"ID":"62bb22b3-83fc-49ac-8cd2-44054ec16b21","Type":"ContainerStarted","Data":"bbf668e0b83feca3edb071a13df2514bb083a2a0e7a60064bce42bcd424dc675"}
Jul 16 22:39:54.378926 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:54.378654    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:39:54.410784 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:39:54.410730    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq" podStartSLOduration=2.99519636 podStartE2EDuration="7.410712797s" totalImagesPullingTime="3.382464983s" totalInitContainerRuntime="1.033051454s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:39:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:39:54.409893442 +0000 UTC m=+375.338903654" watchObservedRunningTime="2026-07-16 22:39:54.410712797 +0000 UTC m=+375.339723009"
Jul 16 22:40:05.386293 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:05.386261    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bb6b77ff4-572sq"
Jul 16 22:40:21.600662 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.600624    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"]
Jul 16 22:40:21.607788 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.607762    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.615355 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.615294    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 22:40:21.615735 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.615578    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n7jqz\""
Jul 16 22:40:21.615923 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.615896    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 22:40:21.616415 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.616265    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 22:40:21.620122 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.620106    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 22:40:21.642633 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.642595    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"]
Jul 16 22:40:21.724458 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.724422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvr5t\" (UniqueName: \"kubernetes.io/projected/d94bd184-539f-4394-a1c8-f66a0976a56f-kube-api-access-zvr5t\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.724633 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.724521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d94bd184-539f-4394-a1c8-f66a0976a56f-tmp\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.724633 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.724551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94bd184-539f-4394-a1c8-f66a0976a56f-tls-certs\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.825375 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.825338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvr5t\" (UniqueName: \"kubernetes.io/projected/d94bd184-539f-4394-a1c8-f66a0976a56f-kube-api-access-zvr5t\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.825567 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.825442    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d94bd184-539f-4394-a1c8-f66a0976a56f-tmp\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.825567 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.825471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94bd184-539f-4394-a1c8-f66a0976a56f-tls-certs\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.827961 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.827938    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d94bd184-539f-4394-a1c8-f66a0976a56f-tmp\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.828192 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.828171    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94bd184-539f-4394-a1c8-f66a0976a56f-tls-certs\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.866883 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.866811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvr5t\" (UniqueName: \"kubernetes.io/projected/d94bd184-539f-4394-a1c8-f66a0976a56f-kube-api-access-zvr5t\") pod \"kube-auth-proxy-b54d476c5-jsj8z\" (UID: \"d94bd184-539f-4394-a1c8-f66a0976a56f\") " pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:21.920635 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:21.920600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"
Jul 16 22:40:22.090382 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:22.090340    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z"]
Jul 16 22:40:22.093885 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:40:22.093854    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94bd184_539f_4394_a1c8_f66a0976a56f.slice/crio-286a4c02f4f7ee2d2ebf5e329f243cf4e62f35f5ccff98481be1a6357932c9ba WatchSource:0}: Error finding container 286a4c02f4f7ee2d2ebf5e329f243cf4e62f35f5ccff98481be1a6357932c9ba: Status 404 returned error can't find the container with id 286a4c02f4f7ee2d2ebf5e329f243cf4e62f35f5ccff98481be1a6357932c9ba
Jul 16 22:40:22.511275 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:22.511216    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z" event={"ID":"d94bd184-539f-4394-a1c8-f66a0976a56f","Type":"ContainerStarted","Data":"286a4c02f4f7ee2d2ebf5e329f243cf4e62f35f5ccff98481be1a6357932c9ba"}
Jul 16 22:40:24.011356 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.011314    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-988mc"]
Jul 16 22:40:24.015267 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.015220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.018083 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.018053    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 22:40:24.018083 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.018054    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 22:40:24.018409 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.018384    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 22:40:24.018409 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.018403    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jnscn\""
Jul 16 22:40:24.018676 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.018647    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 22:40:24.033846 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.033820    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-988mc"]
Jul 16 22:40:24.046800 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.046762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbfadc-65b1-4289-85c1-137d123610c7-local-certs\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.046983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.046866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.046983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.046889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.046983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.046911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.047159 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.047032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-istio-token\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.047159 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.047065    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-cacerts\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.047159 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.047125    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2nj5\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-kube-api-access-z2nj5\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.148519 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.148483    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbfadc-65b1-4289-85c1-137d123610c7-local-certs\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.148709 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.148546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.148709 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.148575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.148709 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.148600    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.148709 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.148652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-istio-token\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.148709 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.148679    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-cacerts\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.148709 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.148703    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2nj5\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-kube-api-access-z2nj5\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.149454 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.149429    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.151510 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.151466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbfadc-65b1-4289-85c1-137d123610c7-local-certs\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.151639 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.151590    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-cacerts\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.151706 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.151692    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.151877 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.151860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.160705 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.160672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-istio-token\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.162204 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.162180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2nj5\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-kube-api-access-z2nj5\") pod \"istiod-openshift-gateway-7574459656-988mc\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.327768 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.327672    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:24.741013 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:24.740980    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-988mc"]
Jul 16 22:40:24.744618 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:40:24.744592    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bbfadc_65b1_4289_85c1_137d123610c7.slice/crio-db5c2cba6c57a0bbd81a4beeb79904d52c5efcd40d33fd679e06b45a39330005 WatchSource:0}: Error finding container db5c2cba6c57a0bbd81a4beeb79904d52c5efcd40d33fd679e06b45a39330005: Status 404 returned error can't find the container with id db5c2cba6c57a0bbd81a4beeb79904d52c5efcd40d33fd679e06b45a39330005
Jul 16 22:40:25.531052 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:25.531010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc" event={"ID":"84bbfadc-65b1-4289-85c1-137d123610c7","Type":"ContainerStarted","Data":"db5c2cba6c57a0bbd81a4beeb79904d52c5efcd40d33fd679e06b45a39330005"}
Jul 16 22:40:25.532468 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:25.532433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z" event={"ID":"d94bd184-539f-4394-a1c8-f66a0976a56f","Type":"ContainerStarted","Data":"da368f664ae6bdb8c778caf5f3da403c5794ef469594ecc6e61e1e4c41b74e36"}
Jul 16 22:40:25.559203 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:25.559145    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b54d476c5-jsj8z" podStartSLOduration=2.026104929 podStartE2EDuration="4.559126393s" totalImagesPullingTime="2.533021464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:40:25.557681358 +0000 UTC m=+406.486691592" watchObservedRunningTime="2026-07-16 22:40:25.559126393 +0000 UTC m=+406.488136606"
Jul 16 22:40:27.374569 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:27.374526    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 16 22:40:27.374864 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:27.374601    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 16 22:40:27.545758 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:27.545720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc" event={"ID":"84bbfadc-65b1-4289-85c1-137d123610c7","Type":"ContainerStarted","Data":"1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01"}
Jul 16 22:40:27.545971 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:27.545838    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:27.590697 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:27.590635    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc" podStartSLOduration=1.963084277 podStartE2EDuration="4.590615894s" totalImagesPullingTime="2.627531617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:40:27.58868218 +0000 UTC m=+408.517692392" watchObservedRunningTime="2026-07-16 22:40:27.590615894 +0000 UTC m=+408.519626106"
Jul 16 22:40:28.553101 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:28.553068    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-988mc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 22:40:28.553611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:28.553125    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc" podUID="84bbfadc-65b1-4289-85c1-137d123610c7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:40:31.552928 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:31.552890    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:34.210967 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.210934    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"]
Jul 16 22:40:34.213723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.213706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:34.217069 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.217048    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 22:40:34.217359 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.217344    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rd9vf\""
Jul 16 22:40:34.264253 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.264203    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"]
Jul 16 22:40:34.277325 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.277298    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"]
Jul 16 22:40:34.280141 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.280122    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:34.283192 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.283172    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-f5d2d\""
Jul 16 22:40:34.283320 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.283284    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 22:40:34.300933 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.300901    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"]
Jul 16 22:40:34.345685 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.345661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85kzv\" (UniqueName: \"kubernetes.io/projected/c1ba19ce-7c38-403c-a5a3-d3def7490a08-kube-api-access-85kzv\") pod \"kserve-controller-manager-d6f4b65b8-7zgcl\" (UID: \"c1ba19ce-7c38-403c-a5a3-d3def7490a08\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:34.345811 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.345700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbnkv\" (UniqueName: \"kubernetes.io/projected/60ea0656-f57e-4287-9331-a0fad6faf45d-kube-api-access-sbnkv\") pod \"llmisvc-controller-manager-777c6bd7d5-lsjk8\" (UID: \"60ea0656-f57e-4287-9331-a0fad6faf45d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:34.345811 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.345779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60ea0656-f57e-4287-9331-a0fad6faf45d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lsjk8\" (UID: \"60ea0656-f57e-4287-9331-a0fad6faf45d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:34.345897 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.345856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ba19ce-7c38-403c-a5a3-d3def7490a08-cert\") pod \"kserve-controller-manager-d6f4b65b8-7zgcl\" (UID: \"c1ba19ce-7c38-403c-a5a3-d3def7490a08\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:34.446920 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.446889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60ea0656-f57e-4287-9331-a0fad6faf45d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lsjk8\" (UID: \"60ea0656-f57e-4287-9331-a0fad6faf45d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:34.447073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.446966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ba19ce-7c38-403c-a5a3-d3def7490a08-cert\") pod \"kserve-controller-manager-d6f4b65b8-7zgcl\" (UID: \"c1ba19ce-7c38-403c-a5a3-d3def7490a08\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:34.447073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.446995    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kzv\" (UniqueName: \"kubernetes.io/projected/c1ba19ce-7c38-403c-a5a3-d3def7490a08-kube-api-access-85kzv\") pod \"kserve-controller-manager-d6f4b65b8-7zgcl\" (UID: \"c1ba19ce-7c38-403c-a5a3-d3def7490a08\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:34.447073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.447028    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbnkv\" (UniqueName: \"kubernetes.io/projected/60ea0656-f57e-4287-9331-a0fad6faf45d-kube-api-access-sbnkv\") pod \"llmisvc-controller-manager-777c6bd7d5-lsjk8\" (UID: \"60ea0656-f57e-4287-9331-a0fad6faf45d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:34.447073 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:40:34.447038    2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 16 22:40:34.447226 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:40:34.447105    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60ea0656-f57e-4287-9331-a0fad6faf45d-cert podName:60ea0656-f57e-4287-9331-a0fad6faf45d nodeName:}" failed. No retries permitted until 2026-07-16 22:40:34.947085442 +0000 UTC m=+415.876095646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60ea0656-f57e-4287-9331-a0fad6faf45d-cert") pod "llmisvc-controller-manager-777c6bd7d5-lsjk8" (UID: "60ea0656-f57e-4287-9331-a0fad6faf45d") : secret "llmisvc-webhook-server-cert" not found
Jul 16 22:40:34.449652 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.449631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ba19ce-7c38-403c-a5a3-d3def7490a08-cert\") pod \"kserve-controller-manager-d6f4b65b8-7zgcl\" (UID: \"c1ba19ce-7c38-403c-a5a3-d3def7490a08\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:34.467489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.467425    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85kzv\" (UniqueName: \"kubernetes.io/projected/c1ba19ce-7c38-403c-a5a3-d3def7490a08-kube-api-access-85kzv\") pod \"kserve-controller-manager-d6f4b65b8-7zgcl\" (UID: \"c1ba19ce-7c38-403c-a5a3-d3def7490a08\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:34.467582 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.467561    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbnkv\" (UniqueName: \"kubernetes.io/projected/60ea0656-f57e-4287-9331-a0fad6faf45d-kube-api-access-sbnkv\") pod \"llmisvc-controller-manager-777c6bd7d5-lsjk8\" (UID: \"60ea0656-f57e-4287-9331-a0fad6faf45d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:34.524472 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.524450    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:34.719129 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.719058    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"]
Jul 16 22:40:34.722142 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:40:34.722117    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ba19ce_7c38_403c_a5a3_d3def7490a08.slice/crio-9a7c13fd8ce7f95fc5373a9568ac01458aa9645ddf1016630ed1acc59db6582b WatchSource:0}: Error finding container 9a7c13fd8ce7f95fc5373a9568ac01458aa9645ddf1016630ed1acc59db6582b: Status 404 returned error can't find the container with id 9a7c13fd8ce7f95fc5373a9568ac01458aa9645ddf1016630ed1acc59db6582b
Jul 16 22:40:34.951513 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.951483    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60ea0656-f57e-4287-9331-a0fad6faf45d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lsjk8\" (UID: \"60ea0656-f57e-4287-9331-a0fad6faf45d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:34.953980 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:34.953953    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60ea0656-f57e-4287-9331-a0fad6faf45d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lsjk8\" (UID: \"60ea0656-f57e-4287-9331-a0fad6faf45d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:35.191002 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.190969    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:35.345853 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.345826    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"]
Jul 16 22:40:35.347801 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:40:35.347778    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod60ea0656_f57e_4287_9331_a0fad6faf45d.slice/crio-cbe1d7063e104b1937d8f59d4915dc829a4e483746717a4b294cabfb0239ba48 WatchSource:0}: Error finding container cbe1d7063e104b1937d8f59d4915dc829a4e483746717a4b294cabfb0239ba48: Status 404 returned error can't find the container with id cbe1d7063e104b1937d8f59d4915dc829a4e483746717a4b294cabfb0239ba48
Jul 16 22:40:35.588567 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.588484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8" event={"ID":"60ea0656-f57e-4287-9331-a0fad6faf45d","Type":"ContainerStarted","Data":"cbe1d7063e104b1937d8f59d4915dc829a4e483746717a4b294cabfb0239ba48"}
Jul 16 22:40:35.589623 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.589597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl" event={"ID":"c1ba19ce-7c38-403c-a5a3-d3def7490a08","Type":"ContainerStarted","Data":"9a7c13fd8ce7f95fc5373a9568ac01458aa9645ddf1016630ed1acc59db6582b"}
Jul 16 22:40:35.650076 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.650045    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-988mc"]
Jul 16 22:40:35.650307 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.650281    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc" podUID="84bbfadc-65b1-4289-85c1-137d123610c7" containerName="discovery" containerID="cri-o://1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01" gracePeriod=30
Jul 16 22:40:35.911544 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.911518    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:35.961437 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.961400    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2nj5\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-kube-api-access-z2nj5\") pod \"84bbfadc-65b1-4289-85c1-137d123610c7\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") "
Jul 16 22:40:35.961611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.961477    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-dns-cert\") pod \"84bbfadc-65b1-4289-85c1-137d123610c7\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") "
Jul 16 22:40:35.961611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.961516    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-ca-configmap\") pod \"84bbfadc-65b1-4289-85c1-137d123610c7\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") "
Jul 16 22:40:35.961611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.961574    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbfadc-65b1-4289-85c1-137d123610c7-local-certs\") pod \"84bbfadc-65b1-4289-85c1-137d123610c7\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") "
Jul 16 22:40:35.961611 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.961604    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-kubeconfig\") pod \"84bbfadc-65b1-4289-85c1-137d123610c7\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") "
Jul 16 22:40:35.961817 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.961627    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-istio-token\") pod \"84bbfadc-65b1-4289-85c1-137d123610c7\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") "
Jul 16 22:40:35.961817 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.961659    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-cacerts\") pod \"84bbfadc-65b1-4289-85c1-137d123610c7\" (UID: \"84bbfadc-65b1-4289-85c1-137d123610c7\") "
Jul 16 22:40:35.961985 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.961942    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "84bbfadc-65b1-4289-85c1-137d123610c7" (UID: "84bbfadc-65b1-4289-85c1-137d123610c7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:40:35.965002 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.964573    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "84bbfadc-65b1-4289-85c1-137d123610c7" (UID: "84bbfadc-65b1-4289-85c1-137d123610c7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:40:35.965002 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.964573    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bbfadc-65b1-4289-85c1-137d123610c7-local-certs" (OuterVolumeSpecName: "local-certs") pod "84bbfadc-65b1-4289-85c1-137d123610c7" (UID: "84bbfadc-65b1-4289-85c1-137d123610c7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:40:35.965002 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.964697    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-kube-api-access-z2nj5" (OuterVolumeSpecName: "kube-api-access-z2nj5") pod "84bbfadc-65b1-4289-85c1-137d123610c7" (UID: "84bbfadc-65b1-4289-85c1-137d123610c7"). InnerVolumeSpecName "kube-api-access-z2nj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:40:35.965002 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.964727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "84bbfadc-65b1-4289-85c1-137d123610c7" (UID: "84bbfadc-65b1-4289-85c1-137d123610c7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:40:35.965002 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.964838    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-cacerts" (OuterVolumeSpecName: "cacerts") pod "84bbfadc-65b1-4289-85c1-137d123610c7" (UID: "84bbfadc-65b1-4289-85c1-137d123610c7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:40:35.965879 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:35.965852    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "84bbfadc-65b1-4289-85c1-137d123610c7" (UID: "84bbfadc-65b1-4289-85c1-137d123610c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:40:36.062808 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.062777    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-dns-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:40:36.062808 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.062810    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84bbfadc-65b1-4289-85c1-137d123610c7-istio-csr-ca-configmap\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:40:36.062808 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.062823    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbfadc-65b1-4289-85c1-137d123610c7-local-certs\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:40:36.063057 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.062837    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-istio-kubeconfig\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:40:36.063057 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.062849    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-istio-token\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:40:36.063057 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.062860    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84bbfadc-65b1-4289-85c1-137d123610c7-cacerts\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:40:36.063057 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.062870    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2nj5\" (UniqueName: \"kubernetes.io/projected/84bbfadc-65b1-4289-85c1-137d123610c7-kube-api-access-z2nj5\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:40:36.598583 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.598545    2558 generic.go:356] "Generic (PLEG): container finished" podID="84bbfadc-65b1-4289-85c1-137d123610c7" containerID="1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01" exitCode=0
Jul 16 22:40:36.599029 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.598638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc" event={"ID":"84bbfadc-65b1-4289-85c1-137d123610c7","Type":"ContainerDied","Data":"1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01"}
Jul 16 22:40:36.599029 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.598717    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc" event={"ID":"84bbfadc-65b1-4289-85c1-137d123610c7","Type":"ContainerDied","Data":"db5c2cba6c57a0bbd81a4beeb79904d52c5efcd40d33fd679e06b45a39330005"}
Jul 16 22:40:36.599029 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.598743    2558 scope.go:117] "RemoveContainer" containerID="1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01"
Jul 16 22:40:36.599029 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.598897    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-988mc"
Jul 16 22:40:36.663158 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.663123    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-988mc"]
Jul 16 22:40:36.667552 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.667436    2558 scope.go:117] "RemoveContainer" containerID="1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01"
Jul 16 22:40:36.667850 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:40:36.667828    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01\": container with ID starting with 1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01 not found: ID does not exist" containerID="1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01"
Jul 16 22:40:36.667891 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.667861    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01"} err="failed to get container status \"1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01\": rpc error: code = NotFound desc = could not find container \"1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01\": container with ID starting with 1122a3ec2cfa230373956b06d2373ae9890eb9e2b25b2bacff140501a1a41d01 not found: ID does not exist"
Jul 16 22:40:36.674686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:36.674660    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-988mc"]
Jul 16 22:40:37.607675 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:37.607641    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl" event={"ID":"c1ba19ce-7c38-403c-a5a3-d3def7490a08","Type":"ContainerStarted","Data":"f722eba223c5c08bfd0d96d65866066811b59004afa5cd3520b348867a9cb621"}
Jul 16 22:40:37.608092 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:37.607780    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:40:37.636019 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:37.635981    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84bbfadc-65b1-4289-85c1-137d123610c7" path="/var/lib/kubelet/pods/84bbfadc-65b1-4289-85c1-137d123610c7/volumes"
Jul 16 22:40:37.646155 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:37.646103    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl" podStartSLOduration=0.928873484 podStartE2EDuration="3.646081085s" totalImagesPullingTime="2.717207601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:40:37.644749284 +0000 UTC m=+418.573759497" watchObservedRunningTime="2026-07-16 22:40:37.646081085 +0000 UTC m=+418.575091297"
Jul 16 22:40:39.618775 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:39.618731    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8" event={"ID":"60ea0656-f57e-4287-9331-a0fad6faf45d","Type":"ContainerStarted","Data":"7d5d3c10f387a84e6fbfce5ced4349d2d6204e6c162feb3b9761538642b4ef0c"}
Jul 16 22:40:39.619257 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:39.618812    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:40:39.644501 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:40:39.644448    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8" podStartSLOduration=1.961862076 podStartE2EDuration="5.644432445s" totalImagesPullingTime="3.682570369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:40:39.642087294 +0000 UTC m=+420.571097506" watchObservedRunningTime="2026-07-16 22:40:39.644432445 +0000 UTC m=+420.573442657"
Jul 16 22:41:08.618829 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:08.618751    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7zgcl"
Jul 16 22:41:10.627364 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:10.627335    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsjk8"
Jul 16 22:41:22.431915 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.431877    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rkbh8"]
Jul 16 22:41:22.432302 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.432222    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bbfadc-65b1-4289-85c1-137d123610c7" containerName="discovery"
Jul 16 22:41:22.432302 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.432244    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bbfadc-65b1-4289-85c1-137d123610c7" containerName="discovery"
Jul 16 22:41:22.432421 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.432307    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84bbfadc-65b1-4289-85c1-137d123610c7" containerName="discovery"
Jul 16 22:41:22.437163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.437134    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8"
Jul 16 22:41:22.444459 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.444426    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-58nrs\""
Jul 16 22:41:22.445928 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.445685    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 22:41:22.446046 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.445981    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 22:41:22.448690 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.448660    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rkbh8"]
Jul 16 22:41:22.570218 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.570185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5sq\" (UniqueName: \"kubernetes.io/projected/a078f7ff-ae43-4a4c-bacc-46c4676490c3-kube-api-access-qm5sq\") pod \"kuadrant-operator-catalog-rkbh8\" (UID: \"a078f7ff-ae43-4a4c-bacc-46c4676490c3\") " pod="kuadrant-system/kuadrant-operator-catalog-rkbh8"
Jul 16 22:41:22.670984 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.670953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5sq\" (UniqueName: \"kubernetes.io/projected/a078f7ff-ae43-4a4c-bacc-46c4676490c3-kube-api-access-qm5sq\") pod \"kuadrant-operator-catalog-rkbh8\" (UID: \"a078f7ff-ae43-4a4c-bacc-46c4676490c3\") " pod="kuadrant-system/kuadrant-operator-catalog-rkbh8"
Jul 16 22:41:22.679645 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.679617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5sq\" (UniqueName: \"kubernetes.io/projected/a078f7ff-ae43-4a4c-bacc-46c4676490c3-kube-api-access-qm5sq\") pod \"kuadrant-operator-catalog-rkbh8\" (UID: \"a078f7ff-ae43-4a4c-bacc-46c4676490c3\") " pod="kuadrant-system/kuadrant-operator-catalog-rkbh8"
Jul 16 22:41:22.747848 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.747777    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8"
Jul 16 22:41:22.789939 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.789911    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rkbh8"]
Jul 16 22:41:22.906255 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.906218    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rkbh8"]
Jul 16 22:41:22.908079 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:41:22.908049    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda078f7ff_ae43_4a4c_bacc_46c4676490c3.slice/crio-cec016ec1c9cce480ad8c1d84ebde88bdf15ed2148ba121b89ad595f6afd551c WatchSource:0}: Error finding container cec016ec1c9cce480ad8c1d84ebde88bdf15ed2148ba121b89ad595f6afd551c: Status 404 returned error can't find the container with id cec016ec1c9cce480ad8c1d84ebde88bdf15ed2148ba121b89ad595f6afd551c
Jul 16 22:41:22.999122 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:22.999043    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vxc5"]
Jul 16 22:41:23.001926 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.001909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:23.011342 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.011308    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vxc5"]
Jul 16 22:41:23.075457 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.075428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvcmx\" (UniqueName: \"kubernetes.io/projected/8977d783-9cb1-4631-9199-57e2267adaea-kube-api-access-pvcmx\") pod \"kuadrant-operator-catalog-5vxc5\" (UID: \"8977d783-9cb1-4631-9199-57e2267adaea\") " pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:23.176624 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.176588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvcmx\" (UniqueName: \"kubernetes.io/projected/8977d783-9cb1-4631-9199-57e2267adaea-kube-api-access-pvcmx\") pod \"kuadrant-operator-catalog-5vxc5\" (UID: \"8977d783-9cb1-4631-9199-57e2267adaea\") " pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:23.185339 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.185308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvcmx\" (UniqueName: \"kubernetes.io/projected/8977d783-9cb1-4631-9199-57e2267adaea-kube-api-access-pvcmx\") pod \"kuadrant-operator-catalog-5vxc5\" (UID: \"8977d783-9cb1-4631-9199-57e2267adaea\") " pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:23.312017 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.311943    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:23.449529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.449502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vxc5"]
Jul 16 22:41:23.488207 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:41:23.488171    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8977d783_9cb1_4631_9199_57e2267adaea.slice/crio-6edee22e700a4bd69be04cff5f9a8156e37ae622e6809ae3175c5b018df78374 WatchSource:0}: Error finding container 6edee22e700a4bd69be04cff5f9a8156e37ae622e6809ae3175c5b018df78374: Status 404 returned error can't find the container with id 6edee22e700a4bd69be04cff5f9a8156e37ae622e6809ae3175c5b018df78374
Jul 16 22:41:23.818076 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.818026    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8" event={"ID":"a078f7ff-ae43-4a4c-bacc-46c4676490c3","Type":"ContainerStarted","Data":"cec016ec1c9cce480ad8c1d84ebde88bdf15ed2148ba121b89ad595f6afd551c"}
Jul 16 22:41:23.819792 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:23.819753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5" event={"ID":"8977d783-9cb1-4631-9199-57e2267adaea","Type":"ContainerStarted","Data":"6edee22e700a4bd69be04cff5f9a8156e37ae622e6809ae3175c5b018df78374"}
Jul 16 22:41:25.830177 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:25.830140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8" event={"ID":"a078f7ff-ae43-4a4c-bacc-46c4676490c3","Type":"ContainerStarted","Data":"2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387"}
Jul 16 22:41:25.830664 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:25.830169    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8" podUID="a078f7ff-ae43-4a4c-bacc-46c4676490c3" containerName="registry-server" containerID="cri-o://2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387" gracePeriod=2
Jul 16 22:41:25.831729 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:25.831696    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5" event={"ID":"8977d783-9cb1-4631-9199-57e2267adaea","Type":"ContainerStarted","Data":"1b53f11c5e76c011b9b9c3e99b9c17270d55754c00719bd0a6b3765103cc3972"}
Jul 16 22:41:25.851485 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:25.851445    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8" podStartSLOduration=1.95092482 podStartE2EDuration="3.851432808s" totalImagesPullingTime="1.900507988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:41:25.849351653 +0000 UTC m=+466.778361862" watchObservedRunningTime="2026-07-16 22:41:25.851432808 +0000 UTC m=+466.780443046"
Jul 16 22:41:25.871138 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:25.871088    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5" podStartSLOduration=2.549950491 podStartE2EDuration="3.871071832s" totalImagesPullingTime="1.321121341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:41:25.869063742 +0000 UTC m=+466.798073964" watchObservedRunningTime="2026-07-16 22:41:25.871071832 +0000 UTC m=+466.800082043"
Jul 16 22:41:26.068427 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.068404    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8"
Jul 16 22:41:26.205831 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.205797    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm5sq\" (UniqueName: \"kubernetes.io/projected/a078f7ff-ae43-4a4c-bacc-46c4676490c3-kube-api-access-qm5sq\") pod \"a078f7ff-ae43-4a4c-bacc-46c4676490c3\" (UID: \"a078f7ff-ae43-4a4c-bacc-46c4676490c3\") "
Jul 16 22:41:26.207996 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.207965    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a078f7ff-ae43-4a4c-bacc-46c4676490c3-kube-api-access-qm5sq" (OuterVolumeSpecName: "kube-api-access-qm5sq") pod "a078f7ff-ae43-4a4c-bacc-46c4676490c3" (UID: "a078f7ff-ae43-4a4c-bacc-46c4676490c3"). InnerVolumeSpecName "kube-api-access-qm5sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:41:26.307066 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.307036    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm5sq\" (UniqueName: \"kubernetes.io/projected/a078f7ff-ae43-4a4c-bacc-46c4676490c3-kube-api-access-qm5sq\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:41:26.837955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.837922    2558 generic.go:356] "Generic (PLEG): container finished" podID="a078f7ff-ae43-4a4c-bacc-46c4676490c3" containerID="2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387" exitCode=0
Jul 16 22:41:26.837955 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.837958    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8"
Jul 16 22:41:26.838489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.838006    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8" event={"ID":"a078f7ff-ae43-4a4c-bacc-46c4676490c3","Type":"ContainerDied","Data":"2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387"}
Jul 16 22:41:26.838489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.838046    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rkbh8" event={"ID":"a078f7ff-ae43-4a4c-bacc-46c4676490c3","Type":"ContainerDied","Data":"cec016ec1c9cce480ad8c1d84ebde88bdf15ed2148ba121b89ad595f6afd551c"}
Jul 16 22:41:26.838489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.838064    2558 scope.go:117] "RemoveContainer" containerID="2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387"
Jul 16 22:41:26.847032 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.847017    2558 scope.go:117] "RemoveContainer" containerID="2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387"
Jul 16 22:41:26.847287 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:41:26.847268    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387\": container with ID starting with 2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387 not found: ID does not exist" containerID="2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387"
Jul 16 22:41:26.847343 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.847297    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387"} err="failed to get container status \"2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387\": rpc error: code = NotFound desc = could not find container \"2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387\": container with ID starting with 2c848acd7074f1ad6a1be178865ee1ad2b7350a5bcd1149bbe082111a7125387 not found: ID does not exist"
Jul 16 22:41:26.867453 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.867430    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rkbh8"]
Jul 16 22:41:26.874619 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:26.874597    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rkbh8"]
Jul 16 22:41:27.634380 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:27.634349    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a078f7ff-ae43-4a4c-bacc-46c4676490c3" path="/var/lib/kubelet/pods/a078f7ff-ae43-4a4c-bacc-46c4676490c3/volumes"
Jul 16 22:41:33.312126 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:33.312082    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:33.312559 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:33.312154    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:33.334729 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:33.334698    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:33.894106 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:33.894079    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5vxc5"
Jul 16 22:41:50.399251 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.399210    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-786c7c6899-88mgx"]
Jul 16 22:41:50.399671 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.399631    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a078f7ff-ae43-4a4c-bacc-46c4676490c3" containerName="registry-server"
Jul 16 22:41:50.399671 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.399650    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a078f7ff-ae43-4a4c-bacc-46c4676490c3" containerName="registry-server"
Jul 16 22:41:50.399749 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.399738    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a078f7ff-ae43-4a4c-bacc-46c4676490c3" containerName="registry-server"
Jul 16 22:41:50.404097 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.404070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.415200 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.415170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634cef60-1160-47b1-9098-d03f4028a505-console-serving-cert\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.415490 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.415462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634cef60-1160-47b1-9098-d03f4028a505-console-oauth-config\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.415490 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.415500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-oauth-serving-cert\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.415658 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.415535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-trusted-ca-bundle\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.415658 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.415562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-console-config\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.415658 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.415586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmg5z\" (UniqueName: \"kubernetes.io/projected/634cef60-1160-47b1-9098-d03f4028a505-kube-api-access-tmg5z\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.415658 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.415641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-service-ca\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.417656 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.417633    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786c7c6899-88mgx"]
Jul 16 22:41:50.516373 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.516342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-trusted-ca-bundle\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.516373 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.516373    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-console-config\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.516568 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.516391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmg5z\" (UniqueName: \"kubernetes.io/projected/634cef60-1160-47b1-9098-d03f4028a505-kube-api-access-tmg5z\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.516568 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.516455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-service-ca\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.516568 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.516477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634cef60-1160-47b1-9098-d03f4028a505-console-serving-cert\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.516698 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.516577    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634cef60-1160-47b1-9098-d03f4028a505-console-oauth-config\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.516698 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.516598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-oauth-serving-cert\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.517121 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.517097    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-console-config\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.517267 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.517184    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-service-ca\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.517267 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.517191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-oauth-serving-cert\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.517267 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.517222    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634cef60-1160-47b1-9098-d03f4028a505-trusted-ca-bundle\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.519603 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.519579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634cef60-1160-47b1-9098-d03f4028a505-console-oauth-config\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.519702 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.519646    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634cef60-1160-47b1-9098-d03f4028a505-console-serving-cert\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.526118 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.526093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmg5z\" (UniqueName: \"kubernetes.io/projected/634cef60-1160-47b1-9098-d03f4028a505-kube-api-access-tmg5z\") pod \"console-786c7c6899-88mgx\" (UID: \"634cef60-1160-47b1-9098-d03f4028a505\") " pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.713380 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.713306    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:41:50.882161 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.882104    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786c7c6899-88mgx"]
Jul 16 22:41:50.884346 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:41:50.884318    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634cef60_1160_47b1_9098_d03f4028a505.slice/crio-f2d0d497b12f161fc44b7d7e5dc4fb324d419bc04f2f9d4ffe6c0a28ca2ca0a3 WatchSource:0}: Error finding container f2d0d497b12f161fc44b7d7e5dc4fb324d419bc04f2f9d4ffe6c0a28ca2ca0a3: Status 404 returned error can't find the container with id f2d0d497b12f161fc44b7d7e5dc4fb324d419bc04f2f9d4ffe6c0a28ca2ca0a3
Jul 16 22:41:50.949449 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.949421    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786c7c6899-88mgx" event={"ID":"634cef60-1160-47b1-9098-d03f4028a505","Type":"ContainerStarted","Data":"ff476c33528964340be25daa1ea6a2f352e0c72c9fed71b98f4d46e404422c51"}
Jul 16 22:41:50.949567 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.949474    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786c7c6899-88mgx" event={"ID":"634cef60-1160-47b1-9098-d03f4028a505","Type":"ContainerStarted","Data":"f2d0d497b12f161fc44b7d7e5dc4fb324d419bc04f2f9d4ffe6c0a28ca2ca0a3"}
Jul 16 22:41:50.971151 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:50.971007    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-786c7c6899-88mgx" podStartSLOduration=0.970986319 podStartE2EDuration="970.986319ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:41:50.970021355 +0000 UTC m=+491.899031567" watchObservedRunningTime="2026-07-16 22:41:50.970986319 +0000 UTC m=+491.899996557"
Jul 16 22:41:56.977325 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:56.977284    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"]
Jul 16 22:41:56.981902 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:56.981883    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:41:56.986109 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:56.986091    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6qtv7\""
Jul 16 22:41:57.002513 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.002486    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"]
Jul 16 22:41:57.073220 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.073186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmc74\" (UniqueName: \"kubernetes.io/projected/0f827c0b-d633-4343-8bd8-e00978e501af-kube-api-access-zmc74\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" (UID: \"0f827c0b-d633-4343-8bd8-e00978e501af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:41:57.073409 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.073252    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f827c0b-d633-4343-8bd8-e00978e501af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" (UID: \"0f827c0b-d633-4343-8bd8-e00978e501af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:41:57.174178 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.174146    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmc74\" (UniqueName: \"kubernetes.io/projected/0f827c0b-d633-4343-8bd8-e00978e501af-kube-api-access-zmc74\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" (UID: \"0f827c0b-d633-4343-8bd8-e00978e501af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:41:57.174392 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.174214    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f827c0b-d633-4343-8bd8-e00978e501af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" (UID: \"0f827c0b-d633-4343-8bd8-e00978e501af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:41:57.174671 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.174650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f827c0b-d633-4343-8bd8-e00978e501af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" (UID: \"0f827c0b-d633-4343-8bd8-e00978e501af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:41:57.192514 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.192483    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmc74\" (UniqueName: \"kubernetes.io/projected/0f827c0b-d633-4343-8bd8-e00978e501af-kube-api-access-zmc74\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" (UID: \"0f827c0b-d633-4343-8bd8-e00978e501af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:41:57.292345 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.292261    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:41:57.455720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.455687    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"]
Jul 16 22:41:57.456557 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:41:57.456534    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f827c0b_d633_4343_8bd8_e00978e501af.slice/crio-9d1094d5f8d3c38609265fd2705d00215cc949abfdce4bbd49bfe8a5bbd12bcc WatchSource:0}: Error finding container 9d1094d5f8d3c38609265fd2705d00215cc949abfdce4bbd49bfe8a5bbd12bcc: Status 404 returned error can't find the container with id 9d1094d5f8d3c38609265fd2705d00215cc949abfdce4bbd49bfe8a5bbd12bcc
Jul 16 22:41:57.985012 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:57.984977    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst" event={"ID":"0f827c0b-d633-4343-8bd8-e00978e501af","Type":"ContainerStarted","Data":"9d1094d5f8d3c38609265fd2705d00215cc949abfdce4bbd49bfe8a5bbd12bcc"}
Jul 16 22:41:59.777818 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:59.777780    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"]
Jul 16 22:41:59.784072 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:59.784049    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"
Jul 16 22:41:59.787113 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:59.787091    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5b6mr\""
Jul 16 22:41:59.796854 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:59.796830    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"]
Jul 16 22:41:59.900078 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:41:59.900042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzg2x\" (UniqueName: \"kubernetes.io/projected/653f9670-3447-4628-906b-98fd30d82a5d-kube-api-access-lzg2x\") pod \"authorino-operator-75cc8d5cb7-4jmmf\" (UID: \"653f9670-3447-4628-906b-98fd30d82a5d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"
Jul 16 22:42:00.000603 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:00.000566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzg2x\" (UniqueName: \"kubernetes.io/projected/653f9670-3447-4628-906b-98fd30d82a5d-kube-api-access-lzg2x\") pod \"authorino-operator-75cc8d5cb7-4jmmf\" (UID: \"653f9670-3447-4628-906b-98fd30d82a5d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"
Jul 16 22:42:00.012040 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:00.012009    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzg2x\" (UniqueName: \"kubernetes.io/projected/653f9670-3447-4628-906b-98fd30d82a5d-kube-api-access-lzg2x\") pod \"authorino-operator-75cc8d5cb7-4jmmf\" (UID: \"653f9670-3447-4628-906b-98fd30d82a5d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"
Jul 16 22:42:00.098890 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:00.098800    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"
Jul 16 22:42:00.253255 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:00.253206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"]
Jul 16 22:42:00.255624 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:42:00.255595    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653f9670_3447_4628_906b_98fd30d82a5d.slice/crio-79e92f26d703a833fe0c40ef142a635b2f8131755246153c9f09b7e78d2eb70d WatchSource:0}: Error finding container 79e92f26d703a833fe0c40ef142a635b2f8131755246153c9f09b7e78d2eb70d: Status 404 returned error can't find the container with id 79e92f26d703a833fe0c40ef142a635b2f8131755246153c9f09b7e78d2eb70d
Jul 16 22:42:00.713436 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:00.713394    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:42:00.713759 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:00.713453    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:42:00.720197 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:00.720174    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:42:01.003567 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.003491    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf" event={"ID":"653f9670-3447-4628-906b-98fd30d82a5d","Type":"ContainerStarted","Data":"79e92f26d703a833fe0c40ef142a635b2f8131755246153c9f09b7e78d2eb70d"}
Jul 16 22:42:01.008735 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.008706    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-786c7c6899-88mgx"
Jul 16 22:42:01.097071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.097032    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f79db6d4b-rbblz"]
Jul 16 22:42:01.669031 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.669003    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"]
Jul 16 22:42:01.672577 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.672548    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:01.676298 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.676277    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5czj6\""
Jul 16 22:42:01.687384 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.687358    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"]
Jul 16 22:42:01.716373 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.716332    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49twz\" (UniqueName: \"kubernetes.io/projected/68628648-92d7-47ec-9963-672033ed290b-kube-api-access-49twz\") pod \"limitador-operator-controller-manager-859d7b78bd-th97h\" (UID: \"68628648-92d7-47ec-9963-672033ed290b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:01.817509 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.817472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49twz\" (UniqueName: \"kubernetes.io/projected/68628648-92d7-47ec-9963-672033ed290b-kube-api-access-49twz\") pod \"limitador-operator-controller-manager-859d7b78bd-th97h\" (UID: \"68628648-92d7-47ec-9963-672033ed290b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:01.827934 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.827907    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49twz\" (UniqueName: \"kubernetes.io/projected/68628648-92d7-47ec-9963-672033ed290b-kube-api-access-49twz\") pod \"limitador-operator-controller-manager-859d7b78bd-th97h\" (UID: \"68628648-92d7-47ec-9963-672033ed290b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:01.984850 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:01.984767    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:04.092923 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.092897    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"]
Jul 16 22:42:04.095344 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:42:04.095313    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68628648_92d7_47ec_9963_672033ed290b.slice/crio-574a222044e277fc65187e06c57729fc16e8c3b1cc2ff5a7f63219ce75eb1002 WatchSource:0}: Error finding container 574a222044e277fc65187e06c57729fc16e8c3b1cc2ff5a7f63219ce75eb1002: Status 404 returned error can't find the container with id 574a222044e277fc65187e06c57729fc16e8c3b1cc2ff5a7f63219ce75eb1002
Jul 16 22:42:04.303564 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.303484    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"]
Jul 16 22:42:04.307191 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.307174    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"
Jul 16 22:42:04.309924 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.309902    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hcm6r\""
Jul 16 22:42:04.310327 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.310309    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 22:42:04.321728 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.321709    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"]
Jul 16 22:42:04.347285 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.347256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8mns\" (UniqueName: \"kubernetes.io/projected/18665db2-b421-47c1-855f-9ce19d359d49-kube-api-access-t8mns\") pod \"dns-operator-controller-manager-864dd78c4c-pv4sk\" (UID: \"18665db2-b421-47c1-855f-9ce19d359d49\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"
Jul 16 22:42:04.448006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.447968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8mns\" (UniqueName: \"kubernetes.io/projected/18665db2-b421-47c1-855f-9ce19d359d49-kube-api-access-t8mns\") pod \"dns-operator-controller-manager-864dd78c4c-pv4sk\" (UID: \"18665db2-b421-47c1-855f-9ce19d359d49\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"
Jul 16 22:42:04.457776 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.457756    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8mns\" (UniqueName: \"kubernetes.io/projected/18665db2-b421-47c1-855f-9ce19d359d49-kube-api-access-t8mns\") pod \"dns-operator-controller-manager-864dd78c4c-pv4sk\" (UID: \"18665db2-b421-47c1-855f-9ce19d359d49\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"
Jul 16 22:42:04.617408 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.617342    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"
Jul 16 22:42:04.989599 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:04.989562    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"]
Jul 16 22:42:05.000921 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:42:05.000889    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18665db2_b421_47c1_855f_9ce19d359d49.slice/crio-bdf324183cfc2a262bfed14e31c385517a1bd517fdb262bcff7a0c28873ee9c7 WatchSource:0}: Error finding container bdf324183cfc2a262bfed14e31c385517a1bd517fdb262bcff7a0c28873ee9c7: Status 404 returned error can't find the container with id bdf324183cfc2a262bfed14e31c385517a1bd517fdb262bcff7a0c28873ee9c7
Jul 16 22:42:05.033025 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:05.032990    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf" event={"ID":"653f9670-3447-4628-906b-98fd30d82a5d","Type":"ContainerStarted","Data":"25026dd2091f17c76c7590cefde1fc8b19fd7a246a2b725d405ae649cac0fe1a"}
Jul 16 22:42:05.033185 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:05.033130    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"
Jul 16 22:42:05.034294 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:05.034272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk" event={"ID":"18665db2-b421-47c1-855f-9ce19d359d49","Type":"ContainerStarted","Data":"bdf324183cfc2a262bfed14e31c385517a1bd517fdb262bcff7a0c28873ee9c7"}
Jul 16 22:42:05.035477 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:05.035457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h" event={"ID":"68628648-92d7-47ec-9963-672033ed290b","Type":"ContainerStarted","Data":"574a222044e277fc65187e06c57729fc16e8c3b1cc2ff5a7f63219ce75eb1002"}
Jul 16 22:42:05.036933 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:05.036910    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst" event={"ID":"0f827c0b-d633-4343-8bd8-e00978e501af","Type":"ContainerStarted","Data":"bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25"}
Jul 16 22:42:05.037019 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:05.036951    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:05.057359 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:05.057316    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf" podStartSLOduration=2.36383534 podStartE2EDuration="6.057302107s" totalImagesPullingTime="3.693466767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:05.055484222 +0000 UTC m=+505.984494427" watchObservedRunningTime="2026-07-16 22:42:05.057302107 +0000 UTC m=+505.986312320"
Jul 16 22:42:05.077277 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:05.077206    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst" podStartSLOduration=2.569732886 podStartE2EDuration="9.077185788s" totalImagesPullingTime="6.507452902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:05.076818932 +0000 UTC m=+506.005829144" watchObservedRunningTime="2026-07-16 22:42:05.077185788 +0000 UTC m=+506.006196001"
Jul 16 22:42:06.045373 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:06.045186    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h" event={"ID":"68628648-92d7-47ec-9963-672033ed290b","Type":"ContainerStarted","Data":"3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166"}
Jul 16 22:42:06.045845 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:06.045428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:06.072836 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:06.072782    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h" podStartSLOduration=3.449244033 podStartE2EDuration="5.072765093s" totalImagesPullingTime="1.62352106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:06.070948418 +0000 UTC m=+506.999958630" watchObservedRunningTime="2026-07-16 22:42:06.072765093 +0000 UTC m=+507.001775365"
Jul 16 22:42:07.192765 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.192731    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"]
Jul 16 22:42:07.196638 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.196616    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.200322 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.200298    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 22:42:07.200565 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.200548    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhn47\""
Jul 16 22:42:07.201525 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.201464    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 22:42:07.231341 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.231307    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"]
Jul 16 22:42:07.276573 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.276459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be3b5cd9-3d30-4aac-9818-630888aba1d6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.276573 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.276547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/be3b5cd9-3d30-4aac-9818-630888aba1d6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.276788 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.276631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqkvd\" (UniqueName: \"kubernetes.io/projected/be3b5cd9-3d30-4aac-9818-630888aba1d6-kube-api-access-fqkvd\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.377691 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.377666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be3b5cd9-3d30-4aac-9818-630888aba1d6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.377814 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.377714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/be3b5cd9-3d30-4aac-9818-630888aba1d6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.377814 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.377747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqkvd\" (UniqueName: \"kubernetes.io/projected/be3b5cd9-3d30-4aac-9818-630888aba1d6-kube-api-access-fqkvd\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.378280 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.378259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be3b5cd9-3d30-4aac-9818-630888aba1d6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.380158 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.380137    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/be3b5cd9-3d30-4aac-9818-630888aba1d6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.399948 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.399920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqkvd\" (UniqueName: \"kubernetes.io/projected/be3b5cd9-3d30-4aac-9818-630888aba1d6-kube-api-access-fqkvd\") pod \"kuadrant-console-plugin-66b5774985-khzcl\" (UID: \"be3b5cd9-3d30-4aac-9818-630888aba1d6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.507581 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.507503    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"
Jul 16 22:42:07.669749 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:07.669726    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl"]
Jul 16 22:42:07.671913 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:42:07.671886    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe3b5cd9_3d30_4aac_9818_630888aba1d6.slice/crio-e5b00867c3d5c28d7be9c613aff8ee0ba4d771c92d3b0e77c04995b3accaf061 WatchSource:0}: Error finding container e5b00867c3d5c28d7be9c613aff8ee0ba4d771c92d3b0e77c04995b3accaf061: Status 404 returned error can't find the container with id e5b00867c3d5c28d7be9c613aff8ee0ba4d771c92d3b0e77c04995b3accaf061
Jul 16 22:42:08.057113 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:08.057080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl" event={"ID":"be3b5cd9-3d30-4aac-9818-630888aba1d6","Type":"ContainerStarted","Data":"e5b00867c3d5c28d7be9c613aff8ee0ba4d771c92d3b0e77c04995b3accaf061"}
Jul 16 22:42:08.059011 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:08.058981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk" event={"ID":"18665db2-b421-47c1-855f-9ce19d359d49","Type":"ContainerStarted","Data":"67117f43d5768e8b2da3570f3f4b8c93c4bd16a5fca45b122ecc0e3d9535a491"}
Jul 16 22:42:08.059152 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:08.059131    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"
Jul 16 22:42:08.086641 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:08.086592    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk" podStartSLOduration=1.737408661 podStartE2EDuration="4.086577839s" totalImagesPullingTime="2.349169178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:08.083347407 +0000 UTC m=+509.012357618" watchObservedRunningTime="2026-07-16 22:42:08.086577839 +0000 UTC m=+509.015588122"
Jul 16 22:42:16.048530 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:16.048495    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:16.049017 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:16.048997    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4jmmf"
Jul 16 22:42:17.053374 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:17.053345    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:18.547411 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.547373    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"]
Jul 16 22:42:18.547836 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.547604    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" containerName="manager" containerID="cri-o://bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25" gracePeriod=2
Jul 16 22:42:18.569504 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.569433    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"]
Jul 16 22:42:18.585596 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.585566    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"]
Jul 16 22:42:18.585797 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.585760    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h" podUID="68628648-92d7-47ec-9963-672033ed290b" containerName="manager" containerID="cri-o://3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166" gracePeriod=2
Jul 16 22:42:18.596887 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:18.595051    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0f827c0b-d633-4343-8bd8-e00978e501af\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-dzkst\": pods \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:18.598419 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.598392    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"]
Jul 16 22:42:18.600151 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:18.600107    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" is forbidden: User \"system:node:ip-10-0-134-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-116.ec2.internal' and this object" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:18.604487 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:18.604301    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-th97h\" is forbidden: User \"system:node:ip-10-0-134-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-116.ec2.internal' and this object" podUID="68628648-92d7-47ec-9963-672033ed290b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:18.938334 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.938300    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"]
Jul 16 22:42:18.938788 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.938769    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68628648-92d7-47ec-9963-672033ed290b" containerName="manager"
Jul 16 22:42:18.938788 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.938790    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="68628648-92d7-47ec-9963-672033ed290b" containerName="manager"
Jul 16 22:42:18.938965 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.938817    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" containerName="manager"
Jul 16 22:42:18.938965 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.938825    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" containerName="manager"
Jul 16 22:42:18.938965 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.938960    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="68628648-92d7-47ec-9963-672033ed290b" containerName="manager"
Jul 16 22:42:18.939099 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.938977    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" containerName="manager"
Jul 16 22:42:18.955903 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:18.955865    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"
Jul 16 22:42:18.985104 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:18.985073    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" is forbidden: User \"system:node:ip-10-0-134-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-116.ec2.internal' and this object" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:19.002311 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:19.002268    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-th97h\" is forbidden: User \"system:node:ip-10-0-134-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-116.ec2.internal' and this object" podUID="68628648-92d7-47ec-9963-672033ed290b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:19.004610 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.004582    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"]
Jul 16 22:42:19.017727 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.017698    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"]
Jul 16 22:42:19.032183 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.032158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:19.067488 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.067464    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pv4sk"
Jul 16 22:42:19.101467 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.101428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq97g\" (UniqueName: \"kubernetes.io/projected/0d19fcef-84b1-4508-ad25-f9832918a7fa-kube-api-access-mq97g\") pod \"limitador-operator-controller-manager-859d7b78bd-md42z\" (UID: \"0d19fcef-84b1-4508-ad25-f9832918a7fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"
Jul 16 22:42:19.202589 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.202505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzprb\" (UniqueName: \"kubernetes.io/projected/57663a84-ccc7-4142-bab9-4ab18665498f-kube-api-access-gzprb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scb2p\" (UID: \"57663a84-ccc7-4142-bab9-4ab18665498f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:19.202589 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.202576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57663a84-ccc7-4142-bab9-4ab18665498f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scb2p\" (UID: \"57663a84-ccc7-4142-bab9-4ab18665498f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:19.202838 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.202692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq97g\" (UniqueName: \"kubernetes.io/projected/0d19fcef-84b1-4508-ad25-f9832918a7fa-kube-api-access-mq97g\") pod \"limitador-operator-controller-manager-859d7b78bd-md42z\" (UID: \"0d19fcef-84b1-4508-ad25-f9832918a7fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"
Jul 16 22:42:19.237443 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.237401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq97g\" (UniqueName: \"kubernetes.io/projected/0d19fcef-84b1-4508-ad25-f9832918a7fa-kube-api-access-mq97g\") pod \"limitador-operator-controller-manager-859d7b78bd-md42z\" (UID: \"0d19fcef-84b1-4508-ad25-f9832918a7fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"
Jul 16 22:42:19.239160 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.239060    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"]
Jul 16 22:42:19.268624 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.268590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"
Jul 16 22:42:19.303768 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.303733    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzprb\" (UniqueName: \"kubernetes.io/projected/57663a84-ccc7-4142-bab9-4ab18665498f-kube-api-access-gzprb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scb2p\" (UID: \"57663a84-ccc7-4142-bab9-4ab18665498f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:19.303921 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.303832    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57663a84-ccc7-4142-bab9-4ab18665498f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scb2p\" (UID: \"57663a84-ccc7-4142-bab9-4ab18665498f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:19.304247 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.304210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57663a84-ccc7-4142-bab9-4ab18665498f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scb2p\" (UID: \"57663a84-ccc7-4142-bab9-4ab18665498f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:19.341905 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.341873    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzprb\" (UniqueName: \"kubernetes.io/projected/57663a84-ccc7-4142-bab9-4ab18665498f-kube-api-access-gzprb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scb2p\" (UID: \"57663a84-ccc7-4142-bab9-4ab18665498f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:19.343547 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:19.343528    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:19.514191 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:19.514098    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" is forbidden: User \"system:node:ip-10-0-134-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-116.ec2.internal' and this object" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:19.519333 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:19.519292    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-th97h\" is forbidden: User \"system:node:ip-10-0-134-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-116.ec2.internal' and this object" podUID="68628648-92d7-47ec-9963-672033ed290b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:19.635531 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:19.635486    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzkst\" is forbidden: User \"system:node:ip-10-0-134-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-116.ec2.internal' and this object" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:19.664061 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:19.664022    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-th97h\" is forbidden: User \"system:node:ip-10-0-134-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-116.ec2.internal' and this object" podUID="68628648-92d7-47ec-9963-672033ed290b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:24.155536 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.155432    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"]
Jul 16 22:42:24.176783 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.176754    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:24.195530 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.195477    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"]
Jul 16 22:42:24.355436 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.355388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgs9\" (UniqueName: \"kubernetes.io/projected/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-kube-api-access-tcgs9\") pod \"kuadrant-operator-controller-manager-86878c769f-rqdjx\" (UID: \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:24.355621 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.355590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rqdjx\" (UID: \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:24.457028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.456937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rqdjx\" (UID: \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:24.457028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.457011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgs9\" (UniqueName: \"kubernetes.io/projected/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-kube-api-access-tcgs9\") pod \"kuadrant-operator-controller-manager-86878c769f-rqdjx\" (UID: \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:24.457403 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.457378    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rqdjx\" (UID: \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:24.474087 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.474057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgs9\" (UniqueName: \"kubernetes.io/projected/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-kube-api-access-tcgs9\") pod \"kuadrant-operator-controller-manager-86878c769f-rqdjx\" (UID: \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:24.505389 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:24.505346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:26.129023 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:26.128976    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f79db6d4b-rbblz" podUID="69209a16-b241-4894-a49f-881dc22e73fb" containerName="console" containerID="cri-o://8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd" gracePeriod=15
Jul 16 22:42:29.408807 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.408775    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:42:29.432756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.432719    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:29.445047 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.445019    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:29.446498 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:42:29.446466    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d19fcef_84b1_4508_ad25_f9832918a7fa.slice/crio-3f1047a405bda62e5e7a0b1cbc8070f75be8805e995281589b613c2ac795c0d2 WatchSource:0}: Error finding container 3f1047a405bda62e5e7a0b1cbc8070f75be8805e995281589b613c2ac795c0d2: Status 404 returned error can't find the container with id 3f1047a405bda62e5e7a0b1cbc8070f75be8805e995281589b613c2ac795c0d2
Jul 16 22:42:29.448516 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.448494    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"]
Jul 16 22:42:29.507650 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.507625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-service-ca\") pod \"69209a16-b241-4894-a49f-881dc22e73fb\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") "
Jul 16 22:42:29.507763 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.507695    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-console-config\") pod \"69209a16-b241-4894-a49f-881dc22e73fb\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") "
Jul 16 22:42:29.507763 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.507728    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-oauth-config\") pod \"69209a16-b241-4894-a49f-881dc22e73fb\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") "
Jul 16 22:42:29.507763 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.507753    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvmg6\" (UniqueName: \"kubernetes.io/projected/69209a16-b241-4894-a49f-881dc22e73fb-kube-api-access-xvmg6\") pod \"69209a16-b241-4894-a49f-881dc22e73fb\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") "
Jul 16 22:42:29.507941 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.507845    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-oauth-serving-cert\") pod \"69209a16-b241-4894-a49f-881dc22e73fb\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") "
Jul 16 22:42:29.507941 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.507896    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-trusted-ca-bundle\") pod \"69209a16-b241-4894-a49f-881dc22e73fb\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") "
Jul 16 22:42:29.507941 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.507937    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-serving-cert\") pod \"69209a16-b241-4894-a49f-881dc22e73fb\" (UID: \"69209a16-b241-4894-a49f-881dc22e73fb\") "
Jul 16 22:42:29.508100 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.508066    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "69209a16-b241-4894-a49f-881dc22e73fb" (UID: "69209a16-b241-4894-a49f-881dc22e73fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:42:29.508157 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.508122    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-console-config" (OuterVolumeSpecName: "console-config") pod "69209a16-b241-4894-a49f-881dc22e73fb" (UID: "69209a16-b241-4894-a49f-881dc22e73fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:42:29.508380 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.508361    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-console-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.508468 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.508385    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-service-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.508722 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.508673    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69209a16-b241-4894-a49f-881dc22e73fb" (UID: "69209a16-b241-4894-a49f-881dc22e73fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:42:29.508821 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.508733    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "69209a16-b241-4894-a49f-881dc22e73fb" (UID: "69209a16-b241-4894-a49f-881dc22e73fb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:42:29.510684 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.510662    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69209a16-b241-4894-a49f-881dc22e73fb" (UID: "69209a16-b241-4894-a49f-881dc22e73fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:42:29.510781 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.510681    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69209a16-b241-4894-a49f-881dc22e73fb-kube-api-access-xvmg6" (OuterVolumeSpecName: "kube-api-access-xvmg6") pod "69209a16-b241-4894-a49f-881dc22e73fb" (UID: "69209a16-b241-4894-a49f-881dc22e73fb"). InnerVolumeSpecName "kube-api-access-xvmg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:42:29.510951 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.510937    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69209a16-b241-4894-a49f-881dc22e73fb" (UID: "69209a16-b241-4894-a49f-881dc22e73fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:42:29.609422 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.609394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmc74\" (UniqueName: \"kubernetes.io/projected/0f827c0b-d633-4343-8bd8-e00978e501af-kube-api-access-zmc74\") pod \"0f827c0b-d633-4343-8bd8-e00978e501af\" (UID: \"0f827c0b-d633-4343-8bd8-e00978e501af\") "
Jul 16 22:42:29.609626 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.609458    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f827c0b-d633-4343-8bd8-e00978e501af-extensions-socket-volume\") pod \"0f827c0b-d633-4343-8bd8-e00978e501af\" (UID: \"0f827c0b-d633-4343-8bd8-e00978e501af\") "
Jul 16 22:42:29.609626 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.609510    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49twz\" (UniqueName: \"kubernetes.io/projected/68628648-92d7-47ec-9963-672033ed290b-kube-api-access-49twz\") pod \"68628648-92d7-47ec-9963-672033ed290b\" (UID: \"68628648-92d7-47ec-9963-672033ed290b\") "
Jul 16 22:42:29.609736 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.609668    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-oauth-config\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.609736 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.609680    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvmg6\" (UniqueName: \"kubernetes.io/projected/69209a16-b241-4894-a49f-881dc22e73fb-kube-api-access-xvmg6\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.609736 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.609689    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-oauth-serving-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.609736 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.609698    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69209a16-b241-4894-a49f-881dc22e73fb-trusted-ca-bundle\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.609736 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.609707    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69209a16-b241-4894-a49f-881dc22e73fb-console-serving-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.610069 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.610040    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f827c0b-d633-4343-8bd8-e00978e501af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0f827c0b-d633-4343-8bd8-e00978e501af" (UID: "0f827c0b-d633-4343-8bd8-e00978e501af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:29.611723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.611693    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f827c0b-d633-4343-8bd8-e00978e501af-kube-api-access-zmc74" (OuterVolumeSpecName: "kube-api-access-zmc74") pod "0f827c0b-d633-4343-8bd8-e00978e501af" (UID: "0f827c0b-d633-4343-8bd8-e00978e501af"). InnerVolumeSpecName "kube-api-access-zmc74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:42:29.611827 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.611740    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68628648-92d7-47ec-9963-672033ed290b-kube-api-access-49twz" (OuterVolumeSpecName: "kube-api-access-49twz") pod "68628648-92d7-47ec-9963-672033ed290b" (UID: "68628648-92d7-47ec-9963-672033ed290b"). InnerVolumeSpecName "kube-api-access-49twz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:42:29.634850 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.634823    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f827c0b-d633-4343-8bd8-e00978e501af" path="/var/lib/kubelet/pods/0f827c0b-d633-4343-8bd8-e00978e501af/volumes"
Jul 16 22:42:29.635173 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.635161    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68628648-92d7-47ec-9963-672033ed290b" path="/var/lib/kubelet/pods/68628648-92d7-47ec-9963-672033ed290b/volumes"
Jul 16 22:42:29.710768 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.710670    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49twz\" (UniqueName: \"kubernetes.io/projected/68628648-92d7-47ec-9963-672033ed290b-kube-api-access-49twz\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.710768 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.710707    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmc74\" (UniqueName: \"kubernetes.io/projected/0f827c0b-d633-4343-8bd8-e00978e501af-kube-api-access-zmc74\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.710768 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.710721    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f827c0b-d633-4343-8bd8-e00978e501af-extensions-socket-volume\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:29.729176 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.729149    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"]
Jul 16 22:42:29.731107 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:42:29.731081    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57663a84_ccc7_4142_bab9_4ab18665498f.slice/crio-324e70c9534946efb8a9c28189e22832a7d20d3b44d404eb4bce79bf28f8e920 WatchSource:0}: Error finding container 324e70c9534946efb8a9c28189e22832a7d20d3b44d404eb4bce79bf28f8e920: Status 404 returned error can't find the container with id 324e70c9534946efb8a9c28189e22832a7d20d3b44d404eb4bce79bf28f8e920
Jul 16 22:42:29.743394 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:42:29.743368    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ff7b7f_1e2c_4d64_a0ac_f44f9b634673.slice/crio-89b1407ca5bf1570bdd08865ad11afeb811faa900325989c5009451b9cd7d489 WatchSource:0}: Error finding container 89b1407ca5bf1570bdd08865ad11afeb811faa900325989c5009451b9cd7d489: Status 404 returned error can't find the container with id 89b1407ca5bf1570bdd08865ad11afeb811faa900325989c5009451b9cd7d489
Jul 16 22:42:29.745069 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:29.745046    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"]
Jul 16 22:42:30.197804 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.197732    2558 generic.go:356] "Generic (PLEG): container finished" podID="69209a16-b241-4894-a49f-881dc22e73fb" containerID="8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd" exitCode=0
Jul 16 22:42:30.197965 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.197813    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f79db6d4b-rbblz"
Jul 16 22:42:30.197965 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.197812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f79db6d4b-rbblz" event={"ID":"69209a16-b241-4894-a49f-881dc22e73fb","Type":"ContainerDied","Data":"8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd"}
Jul 16 22:42:30.197965 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.197879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f79db6d4b-rbblz" event={"ID":"69209a16-b241-4894-a49f-881dc22e73fb","Type":"ContainerDied","Data":"f01b5dab8e5738fe45761e647d7a9dd82d3524241e61c8c275b76421878e82a1"}
Jul 16 22:42:30.197965 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.197909    2558 scope.go:117] "RemoveContainer" containerID="8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd"
Jul 16 22:42:30.199565 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.199540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl" event={"ID":"be3b5cd9-3d30-4aac-9818-630888aba1d6","Type":"ContainerStarted","Data":"5404fbd6f1e00cb871bb80fbedcbfad883d2ead39d94971f6df2c8baad5b46bf"}
Jul 16 22:42:30.201298 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.201272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p" event={"ID":"57663a84-ccc7-4142-bab9-4ab18665498f","Type":"ContainerStarted","Data":"3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb"}
Jul 16 22:42:30.201420 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.201319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p" event={"ID":"57663a84-ccc7-4142-bab9-4ab18665498f","Type":"ContainerStarted","Data":"324e70c9534946efb8a9c28189e22832a7d20d3b44d404eb4bce79bf28f8e920"}
Jul 16 22:42:30.201420 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.201348    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:30.203152 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.203128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z" event={"ID":"0d19fcef-84b1-4508-ad25-f9832918a7fa","Type":"ContainerStarted","Data":"f712aca0be9b25423cffa4e7aede4f3036f4c1a9f601e071acc2d01b8c42a579"}
Jul 16 22:42:30.203276 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.203176    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z" event={"ID":"0d19fcef-84b1-4508-ad25-f9832918a7fa","Type":"ContainerStarted","Data":"3f1047a405bda62e5e7a0b1cbc8070f75be8805e995281589b613c2ac795c0d2"}
Jul 16 22:42:30.203276 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.203204    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"
Jul 16 22:42:30.204538 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.204379    2558 generic.go:356] "Generic (PLEG): container finished" podID="68628648-92d7-47ec-9963-672033ed290b" containerID="3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166" exitCode=0
Jul 16 22:42:30.204538 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.204423    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-th97h"
Jul 16 22:42:30.205905 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.205850    2558 generic.go:356] "Generic (PLEG): container finished" podID="0f827c0b-d633-4343-8bd8-e00978e501af" containerID="bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25" exitCode=0
Jul 16 22:42:30.205964 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.205906    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzkst"
Jul 16 22:42:30.207905 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.207872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx" event={"ID":"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673","Type":"ContainerStarted","Data":"f02e035afdf7285c72e5c69cd62181041058822ca3d8627926d62e643ffda363"}
Jul 16 22:42:30.208010 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.207918    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx" event={"ID":"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673","Type":"ContainerStarted","Data":"89b1407ca5bf1570bdd08865ad11afeb811faa900325989c5009451b9cd7d489"}
Jul 16 22:42:30.208010 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.207971    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:30.223723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.223589    2558 scope.go:117] "RemoveContainer" containerID="8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd"
Jul 16 22:42:30.223851 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:30.223833    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd\": container with ID starting with 8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd not found: ID does not exist" containerID="8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd"
Jul 16 22:42:30.223891 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.223860    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd"} err="failed to get container status \"8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd\": rpc error: code = NotFound desc = could not find container \"8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd\": container with ID starting with 8e8c66c1ae0e65e48efb6d61f2f1ddc5f05028c2e244fc22fb0d991af999defd not found: ID does not exist"
Jul 16 22:42:30.223891 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.223877    2558 scope.go:117] "RemoveContainer" containerID="3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166"
Jul 16 22:42:30.231675 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.231659    2558 scope.go:117] "RemoveContainer" containerID="3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166"
Jul 16 22:42:30.231914 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:30.231897    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166\": container with ID starting with 3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166 not found: ID does not exist" containerID="3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166"
Jul 16 22:42:30.231969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.231920    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166"} err="failed to get container status \"3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166\": rpc error: code = NotFound desc = could not find container \"3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166\": container with ID starting with 3115248f4b103200f2a092da8c89f180a50bdfa31ad42563c194270b03f4c166 not found: ID does not exist"
Jul 16 22:42:30.231969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.231935    2558 scope.go:117] "RemoveContainer" containerID="bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25"
Jul 16 22:42:30.239501 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.239484    2558 scope.go:117] "RemoveContainer" containerID="bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25"
Jul 16 22:42:30.239752 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:30.239731    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25\": container with ID starting with bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25 not found: ID does not exist" containerID="bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25"
Jul 16 22:42:30.239814 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.239762    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25"} err="failed to get container status \"bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25\": rpc error: code = NotFound desc = could not find container \"bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25\": container with ID starting with bf235d8932771f4acf91f18311ada602796ddfd055fc858fc2352854fb097e25 not found: ID does not exist"
Jul 16 22:42:30.244681 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.244644    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z" podStartSLOduration=12.244633494 podStartE2EDuration="12.244633494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:30.242122181 +0000 UTC m=+531.171132394" watchObservedRunningTime="2026-07-16 22:42:30.244633494 +0000 UTC m=+531.173643706"
Jul 16 22:42:30.274272 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.274213    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p" podStartSLOduration=12.2741876 podStartE2EDuration="12.2741876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:30.271771654 +0000 UTC m=+531.200781897" watchObservedRunningTime="2026-07-16 22:42:30.2741876 +0000 UTC m=+531.203197813"
Jul 16 22:42:30.332320 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.332270    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-khzcl" podStartSLOduration=1.703742336 podStartE2EDuration="23.332227307s" totalImagesPullingTime="21.628484971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:30.331938154 +0000 UTC m=+531.260948370" watchObservedRunningTime="2026-07-16 22:42:30.332227307 +0000 UTC m=+531.261237518"
Jul 16 22:42:30.333956 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.333927    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx" podStartSLOduration=6.333917903 podStartE2EDuration="6.333917903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:30.302246178 +0000 UTC m=+531.231256382" watchObservedRunningTime="2026-07-16 22:42:30.333917903 +0000 UTC m=+531.262928109"
Jul 16 22:42:30.360460 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.360431    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f79db6d4b-rbblz"]
Jul 16 22:42:30.366720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:30.366695    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f79db6d4b-rbblz"]
Jul 16 22:42:31.635641 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:31.635606    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69209a16-b241-4894-a49f-881dc22e73fb" path="/var/lib/kubelet/pods/69209a16-b241-4894-a49f-881dc22e73fb/volumes"
Jul 16 22:42:41.222603 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:41.222573    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-md42z"
Jul 16 22:42:41.223094 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:41.222648    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:41.223094 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:41.222682    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:42:41.428261 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:41.428213    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"]
Jul 16 22:42:41.428423 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:41.428404    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p" podUID="57663a84-ccc7-4142-bab9-4ab18665498f" containerName="manager" containerID="cri-o://3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb" gracePeriod=10
Jul 16 22:42:42.217038 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.217012    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:42.278743 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.278712    2558 generic.go:356] "Generic (PLEG): container finished" podID="57663a84-ccc7-4142-bab9-4ab18665498f" containerID="3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb" exitCode=0
Jul 16 22:42:42.279134 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.278754    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"
Jul 16 22:42:42.279134 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.278775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p" event={"ID":"57663a84-ccc7-4142-bab9-4ab18665498f","Type":"ContainerDied","Data":"3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb"}
Jul 16 22:42:42.279134 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.278843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p" event={"ID":"57663a84-ccc7-4142-bab9-4ab18665498f","Type":"ContainerDied","Data":"324e70c9534946efb8a9c28189e22832a7d20d3b44d404eb4bce79bf28f8e920"}
Jul 16 22:42:42.279134 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.278884    2558 scope.go:117] "RemoveContainer" containerID="3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb"
Jul 16 22:42:42.291328 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.291313    2558 scope.go:117] "RemoveContainer" containerID="3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb"
Jul 16 22:42:42.291603 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:42:42.291583    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb\": container with ID starting with 3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb not found: ID does not exist" containerID="3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb"
Jul 16 22:42:42.291756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.291609    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb"} err="failed to get container status \"3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb\": rpc error: code = NotFound desc = could not find container \"3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb\": container with ID starting with 3db515f869bcc282f23219583b7067e6a7297a12e23d20e212917bef0742dfdb not found: ID does not exist"
Jul 16 22:42:42.331470 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.331399    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57663a84-ccc7-4142-bab9-4ab18665498f-extensions-socket-volume\") pod \"57663a84-ccc7-4142-bab9-4ab18665498f\" (UID: \"57663a84-ccc7-4142-bab9-4ab18665498f\") "
Jul 16 22:42:42.331609 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.331510    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzprb\" (UniqueName: \"kubernetes.io/projected/57663a84-ccc7-4142-bab9-4ab18665498f-kube-api-access-gzprb\") pod \"57663a84-ccc7-4142-bab9-4ab18665498f\" (UID: \"57663a84-ccc7-4142-bab9-4ab18665498f\") "
Jul 16 22:42:42.331763 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.331738    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57663a84-ccc7-4142-bab9-4ab18665498f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "57663a84-ccc7-4142-bab9-4ab18665498f" (UID: "57663a84-ccc7-4142-bab9-4ab18665498f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:42.333773 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.333749    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57663a84-ccc7-4142-bab9-4ab18665498f-kube-api-access-gzprb" (OuterVolumeSpecName: "kube-api-access-gzprb") pod "57663a84-ccc7-4142-bab9-4ab18665498f" (UID: "57663a84-ccc7-4142-bab9-4ab18665498f"). InnerVolumeSpecName "kube-api-access-gzprb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:42:42.432404 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.432372    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzprb\" (UniqueName: \"kubernetes.io/projected/57663a84-ccc7-4142-bab9-4ab18665498f-kube-api-access-gzprb\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:42.432404 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.432401    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57663a84-ccc7-4142-bab9-4ab18665498f-extensions-socket-volume\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:42:42.605360 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.605323    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"]
Jul 16 22:42:42.624714 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:42.624680    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scb2p"]
Jul 16 22:42:43.635177 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:42:43.635130    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57663a84-ccc7-4142-bab9-4ab18665498f" path="/var/lib/kubelet/pods/57663a84-ccc7-4142-bab9-4ab18665498f/volumes"
Jul 16 22:43:00.206993 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.206960    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"]
Jul 16 22:43:00.207401 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.207356    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57663a84-ccc7-4142-bab9-4ab18665498f" containerName="manager"
Jul 16 22:43:00.207401 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.207368    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="57663a84-ccc7-4142-bab9-4ab18665498f" containerName="manager"
Jul 16 22:43:00.207401 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.207378    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69209a16-b241-4894-a49f-881dc22e73fb" containerName="console"
Jul 16 22:43:00.207401 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.207384    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="69209a16-b241-4894-a49f-881dc22e73fb" containerName="console"
Jul 16 22:43:00.207535 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.207455    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="69209a16-b241-4894-a49f-881dc22e73fb" containerName="console"
Jul 16 22:43:00.207535 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.207463    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="57663a84-ccc7-4142-bab9-4ab18665498f" containerName="manager"
Jul 16 22:43:00.267444 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.267378    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"]
Jul 16 22:43:00.267617 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.267497    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:00.271476 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.271395    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 22:43:00.298295 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.298266    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"]
Jul 16 22:43:00.399732 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.399693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82eea723-3317-4ec0-9969-2c55ce716c70-config-file\") pod \"limitador-limitador-64c94fd64f-bcgzd\" (UID: \"82eea723-3317-4ec0-9969-2c55ce716c70\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:00.399930 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.399745    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mt7\" (UniqueName: \"kubernetes.io/projected/82eea723-3317-4ec0-9969-2c55ce716c70-kube-api-access-z6mt7\") pod \"limitador-limitador-64c94fd64f-bcgzd\" (UID: \"82eea723-3317-4ec0-9969-2c55ce716c70\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:00.501259 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.501142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mt7\" (UniqueName: \"kubernetes.io/projected/82eea723-3317-4ec0-9969-2c55ce716c70-kube-api-access-z6mt7\") pod \"limitador-limitador-64c94fd64f-bcgzd\" (UID: \"82eea723-3317-4ec0-9969-2c55ce716c70\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:00.501428 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.501315    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82eea723-3317-4ec0-9969-2c55ce716c70-config-file\") pod \"limitador-limitador-64c94fd64f-bcgzd\" (UID: \"82eea723-3317-4ec0-9969-2c55ce716c70\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:00.501971 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.501945    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82eea723-3317-4ec0-9969-2c55ce716c70-config-file\") pod \"limitador-limitador-64c94fd64f-bcgzd\" (UID: \"82eea723-3317-4ec0-9969-2c55ce716c70\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:00.510817 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.510792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mt7\" (UniqueName: \"kubernetes.io/projected/82eea723-3317-4ec0-9969-2c55ce716c70-kube-api-access-z6mt7\") pod \"limitador-limitador-64c94fd64f-bcgzd\" (UID: \"82eea723-3317-4ec0-9969-2c55ce716c70\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:00.581309 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.581277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:00.755615 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:00.755583    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"]
Jul 16 22:43:00.757475 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:43:00.757450    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82eea723_3317_4ec0_9969_2c55ce716c70.slice/crio-f6f8a32aaceac988c030a90ce6d7b332a44ce515b91593e3ac8b818e0382464c WatchSource:0}: Error finding container f6f8a32aaceac988c030a90ce6d7b332a44ce515b91593e3ac8b818e0382464c: Status 404 returned error can't find the container with id f6f8a32aaceac988c030a90ce6d7b332a44ce515b91593e3ac8b818e0382464c
Jul 16 22:43:01.023546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.023471    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xgdnc"]
Jul 16 22:43:01.133410 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.133368    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xgdnc"]
Jul 16 22:43:01.133567 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.133464    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xgdnc"
Jul 16 22:43:01.140757 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.140726    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gs42m\""
Jul 16 22:43:01.208605 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.208575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87g9k\" (UniqueName: \"kubernetes.io/projected/1f91c845-6003-4701-b332-4bd70407ab56-kube-api-access-87g9k\") pod \"authorino-58cd955675-xgdnc\" (UID: \"1f91c845-6003-4701-b332-4bd70407ab56\") " pod="kuadrant-system/authorino-58cd955675-xgdnc"
Jul 16 22:43:01.238166 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.238129    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-b96bq"]
Jul 16 22:43:01.250246 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.250205    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b96bq"
Jul 16 22:43:01.251296 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.251271    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b96bq"]
Jul 16 22:43:01.310263 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.310154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87g9k\" (UniqueName: \"kubernetes.io/projected/1f91c845-6003-4701-b332-4bd70407ab56-kube-api-access-87g9k\") pod \"authorino-58cd955675-xgdnc\" (UID: \"1f91c845-6003-4701-b332-4bd70407ab56\") " pod="kuadrant-system/authorino-58cd955675-xgdnc"
Jul 16 22:43:01.319720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.319690    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87g9k\" (UniqueName: \"kubernetes.io/projected/1f91c845-6003-4701-b332-4bd70407ab56-kube-api-access-87g9k\") pod \"authorino-58cd955675-xgdnc\" (UID: \"1f91c845-6003-4701-b332-4bd70407ab56\") " pod="kuadrant-system/authorino-58cd955675-xgdnc"
Jul 16 22:43:01.377443 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.377403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd" event={"ID":"82eea723-3317-4ec0-9969-2c55ce716c70","Type":"ContainerStarted","Data":"f6f8a32aaceac988c030a90ce6d7b332a44ce515b91593e3ac8b818e0382464c"}
Jul 16 22:43:01.411339 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.411298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8456\" (UniqueName: \"kubernetes.io/projected/6fd6851e-3c64-4b74-8b02-7cf34b49ec7b-kube-api-access-v8456\") pod \"authorino-75d556bd77-b96bq\" (UID: \"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b\") " pod="kuadrant-system/authorino-75d556bd77-b96bq"
Jul 16 22:43:01.450459 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.450429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xgdnc"
Jul 16 22:43:01.511987 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.511950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8456\" (UniqueName: \"kubernetes.io/projected/6fd6851e-3c64-4b74-8b02-7cf34b49ec7b-kube-api-access-v8456\") pod \"authorino-75d556bd77-b96bq\" (UID: \"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b\") " pod="kuadrant-system/authorino-75d556bd77-b96bq"
Jul 16 22:43:01.528050 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.526494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8456\" (UniqueName: \"kubernetes.io/projected/6fd6851e-3c64-4b74-8b02-7cf34b49ec7b-kube-api-access-v8456\") pod \"authorino-75d556bd77-b96bq\" (UID: \"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b\") " pod="kuadrant-system/authorino-75d556bd77-b96bq"
Jul 16 22:43:01.560572 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.560500    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b96bq"
Jul 16 22:43:01.639603 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:43:01.639569    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f91c845_6003_4701_b332_4bd70407ab56.slice/crio-fa8c171fdec6fe8d5042503b9b0204e48aa334f008d669453680b6ccdbfc85e5 WatchSource:0}: Error finding container fa8c171fdec6fe8d5042503b9b0204e48aa334f008d669453680b6ccdbfc85e5: Status 404 returned error can't find the container with id fa8c171fdec6fe8d5042503b9b0204e48aa334f008d669453680b6ccdbfc85e5
Jul 16 22:43:01.641581 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.641555    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xgdnc"]
Jul 16 22:43:01.772794 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:01.772766    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b96bq"]
Jul 16 22:43:01.777578 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:43:01.777340    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fd6851e_3c64_4b74_8b02_7cf34b49ec7b.slice/crio-dd1b21e564ebd6fc1edb65c751a94e6413d71146bdf97daa16f8464e352be0f7 WatchSource:0}: Error finding container dd1b21e564ebd6fc1edb65c751a94e6413d71146bdf97daa16f8464e352be0f7: Status 404 returned error can't find the container with id dd1b21e564ebd6fc1edb65c751a94e6413d71146bdf97daa16f8464e352be0f7
Jul 16 22:43:02.388723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:02.388647    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b96bq" event={"ID":"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b","Type":"ContainerStarted","Data":"dd1b21e564ebd6fc1edb65c751a94e6413d71146bdf97daa16f8464e352be0f7"}
Jul 16 22:43:02.397417 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:02.397338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xgdnc" event={"ID":"1f91c845-6003-4701-b332-4bd70407ab56","Type":"ContainerStarted","Data":"fa8c171fdec6fe8d5042503b9b0204e48aa334f008d669453680b6ccdbfc85e5"}
Jul 16 22:43:06.428129 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:06.428026    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd" event={"ID":"82eea723-3317-4ec0-9969-2c55ce716c70","Type":"ContainerStarted","Data":"9020f78965c8fa44ba52ba40c42cfe166a029a80cda848adb8bd5cacdeca0ac4"}
Jul 16 22:43:06.428619 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:06.428143    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:06.429550 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:06.429526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xgdnc" event={"ID":"1f91c845-6003-4701-b332-4bd70407ab56","Type":"ContainerStarted","Data":"b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7"}
Jul 16 22:43:06.430995 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:06.430975    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b96bq" event={"ID":"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b","Type":"ContainerStarted","Data":"31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325"}
Jul 16 22:43:06.449737 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:06.449692    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd" podStartSLOduration=1.07062896 podStartE2EDuration="6.449678351s" totalImagesPullingTime="5.379049391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:43:06.448466656 +0000 UTC m=+567.377476869" watchObservedRunningTime="2026-07-16 22:43:06.449678351 +0000 UTC m=+567.378688563"
Jul 16 22:43:06.468724 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:06.468672    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xgdnc" podStartSLOduration=0.959296914 podStartE2EDuration="5.46865909s" totalImagesPullingTime="4.509362176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:43:06.468184236 +0000 UTC m=+567.397194450" watchObservedRunningTime="2026-07-16 22:43:06.46865909 +0000 UTC m=+567.397669301"
Jul 16 22:43:06.488727 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:06.488668    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-b96bq" podStartSLOduration=1.128603635 podStartE2EDuration="5.488647904s" totalImagesPullingTime="4.360044269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:43:06.487500536 +0000 UTC m=+567.416510749" watchObservedRunningTime="2026-07-16 22:43:06.488647904 +0000 UTC m=+567.417658120"
Jul 16 22:43:06.515982 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:06.515944    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xgdnc"]
Jul 16 22:43:08.441546 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:08.441509    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xgdnc" podUID="1f91c845-6003-4701-b332-4bd70407ab56" containerName="authorino" containerID="cri-o://b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7" gracePeriod=30
Jul 16 22:43:08.693528 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:08.693465    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xgdnc"
Jul 16 22:43:08.783445 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:08.783406    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87g9k\" (UniqueName: \"kubernetes.io/projected/1f91c845-6003-4701-b332-4bd70407ab56-kube-api-access-87g9k\") pod \"1f91c845-6003-4701-b332-4bd70407ab56\" (UID: \"1f91c845-6003-4701-b332-4bd70407ab56\") "
Jul 16 22:43:08.785563 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:08.785531    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f91c845-6003-4701-b332-4bd70407ab56-kube-api-access-87g9k" (OuterVolumeSpecName: "kube-api-access-87g9k") pod "1f91c845-6003-4701-b332-4bd70407ab56" (UID: "1f91c845-6003-4701-b332-4bd70407ab56"). InnerVolumeSpecName "kube-api-access-87g9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:43:08.884933 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:08.884892    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87g9k\" (UniqueName: \"kubernetes.io/projected/1f91c845-6003-4701-b332-4bd70407ab56-kube-api-access-87g9k\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:43:09.448025 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.447986    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f91c845-6003-4701-b332-4bd70407ab56" containerID="b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7" exitCode=0
Jul 16 22:43:09.448442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.448032    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xgdnc"
Jul 16 22:43:09.448442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.448068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xgdnc" event={"ID":"1f91c845-6003-4701-b332-4bd70407ab56","Type":"ContainerDied","Data":"b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7"}
Jul 16 22:43:09.448442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.448111    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xgdnc" event={"ID":"1f91c845-6003-4701-b332-4bd70407ab56","Type":"ContainerDied","Data":"fa8c171fdec6fe8d5042503b9b0204e48aa334f008d669453680b6ccdbfc85e5"}
Jul 16 22:43:09.448442 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.448131    2558 scope.go:117] "RemoveContainer" containerID="b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7"
Jul 16 22:43:09.457305 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.457287    2558 scope.go:117] "RemoveContainer" containerID="b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7"
Jul 16 22:43:09.457605 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:43:09.457586    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7\": container with ID starting with b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7 not found: ID does not exist" containerID="b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7"
Jul 16 22:43:09.457655 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.457614    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7"} err="failed to get container status \"b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7\": rpc error: code = NotFound desc = could not find container \"b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7\": container with ID starting with b0b790d8b7194ce3e204edf458b328a86d9eff52d973728e58ec7d4d1a4fc5a7 not found: ID does not exist"
Jul 16 22:43:09.473705 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.473678    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xgdnc"]
Jul 16 22:43:09.479596 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.479577    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xgdnc"]
Jul 16 22:43:09.635161 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:09.635131    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f91c845-6003-4701-b332-4bd70407ab56" path="/var/lib/kubelet/pods/1f91c845-6003-4701-b332-4bd70407ab56/volumes"
Jul 16 22:43:14.855278 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:14.855227    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"]
Jul 16 22:43:14.855748 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:14.855435    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd" podUID="82eea723-3317-4ec0-9969-2c55ce716c70" containerName="limitador" containerID="cri-o://9020f78965c8fa44ba52ba40c42cfe166a029a80cda848adb8bd5cacdeca0ac4" gracePeriod=30
Jul 16 22:43:14.857775 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:14.857752    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:15.482214 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:15.482115    2558 generic.go:356] "Generic (PLEG): container finished" podID="82eea723-3317-4ec0-9969-2c55ce716c70" containerID="9020f78965c8fa44ba52ba40c42cfe166a029a80cda848adb8bd5cacdeca0ac4" exitCode=0
Jul 16 22:43:15.482214 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:15.482196    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd" event={"ID":"82eea723-3317-4ec0-9969-2c55ce716c70","Type":"ContainerDied","Data":"9020f78965c8fa44ba52ba40c42cfe166a029a80cda848adb8bd5cacdeca0ac4"}
Jul 16 22:43:15.802668 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:15.802640    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:15.947954 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:15.947923    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82eea723-3317-4ec0-9969-2c55ce716c70-config-file\") pod \"82eea723-3317-4ec0-9969-2c55ce716c70\" (UID: \"82eea723-3317-4ec0-9969-2c55ce716c70\") "
Jul 16 22:43:15.947954 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:15.947958    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6mt7\" (UniqueName: \"kubernetes.io/projected/82eea723-3317-4ec0-9969-2c55ce716c70-kube-api-access-z6mt7\") pod \"82eea723-3317-4ec0-9969-2c55ce716c70\" (UID: \"82eea723-3317-4ec0-9969-2c55ce716c70\") "
Jul 16 22:43:15.948465 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:15.948306    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82eea723-3317-4ec0-9969-2c55ce716c70-config-file" (OuterVolumeSpecName: "config-file") pod "82eea723-3317-4ec0-9969-2c55ce716c70" (UID: "82eea723-3317-4ec0-9969-2c55ce716c70"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:43:15.950314 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:15.950290    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82eea723-3317-4ec0-9969-2c55ce716c70-kube-api-access-z6mt7" (OuterVolumeSpecName: "kube-api-access-z6mt7") pod "82eea723-3317-4ec0-9969-2c55ce716c70" (UID: "82eea723-3317-4ec0-9969-2c55ce716c70"). InnerVolumeSpecName "kube-api-access-z6mt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:43:16.049344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.049272    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82eea723-3317-4ec0-9969-2c55ce716c70-config-file\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:43:16.049344 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.049298    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6mt7\" (UniqueName: \"kubernetes.io/projected/82eea723-3317-4ec0-9969-2c55ce716c70-kube-api-access-z6mt7\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:43:16.488790 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.488747    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd" event={"ID":"82eea723-3317-4ec0-9969-2c55ce716c70","Type":"ContainerDied","Data":"f6f8a32aaceac988c030a90ce6d7b332a44ce515b91593e3ac8b818e0382464c"}
Jul 16 22:43:16.488982 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.488842    2558 scope.go:117] "RemoveContainer" containerID="9020f78965c8fa44ba52ba40c42cfe166a029a80cda848adb8bd5cacdeca0ac4"
Jul 16 22:43:16.488982 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.488767    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"
Jul 16 22:43:16.516140 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.516115    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"]
Jul 16 22:43:16.523666 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.523642    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bcgzd"]
Jul 16 22:43:16.743927 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.743834    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"]
Jul 16 22:43:16.744347 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.744328    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f91c845-6003-4701-b332-4bd70407ab56" containerName="authorino"
Jul 16 22:43:16.744448 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.744349    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f91c845-6003-4701-b332-4bd70407ab56" containerName="authorino"
Jul 16 22:43:16.744448 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.744363    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82eea723-3317-4ec0-9969-2c55ce716c70" containerName="limitador"
Jul 16 22:43:16.744448 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.744371    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="82eea723-3317-4ec0-9969-2c55ce716c70" containerName="limitador"
Jul 16 22:43:16.744613 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.744467    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="82eea723-3317-4ec0-9969-2c55ce716c70" containerName="limitador"
Jul 16 22:43:16.744613 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.744484    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f91c845-6003-4701-b332-4bd70407ab56" containerName="authorino"
Jul 16 22:43:16.748917 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.748894    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:16.753218 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.753191    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-ntmtg\""
Jul 16 22:43:16.753218 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.753215    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 22:43:16.753412 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.753394    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 22:43:16.753564 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.753544    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 22:43:16.753983 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.753961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23da33df-52f7-4a4d-a3bb-1547c0a1aa49-data\") pod \"postgres-69fb4594cf-zlqsw\" (UID: \"23da33df-52f7-4a4d-a3bb-1547c0a1aa49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:16.754065 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.754052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82889\" (UniqueName: \"kubernetes.io/projected/23da33df-52f7-4a4d-a3bb-1547c0a1aa49-kube-api-access-82889\") pod \"postgres-69fb4594cf-zlqsw\" (UID: \"23da33df-52f7-4a4d-a3bb-1547c0a1aa49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:16.760556 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.760537    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"]
Jul 16 22:43:16.855051 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.855017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82889\" (UniqueName: \"kubernetes.io/projected/23da33df-52f7-4a4d-a3bb-1547c0a1aa49-kube-api-access-82889\") pod \"postgres-69fb4594cf-zlqsw\" (UID: \"23da33df-52f7-4a4d-a3bb-1547c0a1aa49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:16.855202 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.855069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23da33df-52f7-4a4d-a3bb-1547c0a1aa49-data\") pod \"postgres-69fb4594cf-zlqsw\" (UID: \"23da33df-52f7-4a4d-a3bb-1547c0a1aa49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:16.855472 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.855454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23da33df-52f7-4a4d-a3bb-1547c0a1aa49-data\") pod \"postgres-69fb4594cf-zlqsw\" (UID: \"23da33df-52f7-4a4d-a3bb-1547c0a1aa49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:16.870887 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:16.870851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82889\" (UniqueName: \"kubernetes.io/projected/23da33df-52f7-4a4d-a3bb-1547c0a1aa49-kube-api-access-82889\") pod \"postgres-69fb4594cf-zlqsw\" (UID: \"23da33df-52f7-4a4d-a3bb-1547c0a1aa49\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:17.059637 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:17.059559    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:17.216933 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:17.216908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"]
Jul 16 22:43:17.219276 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:43:17.219246    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23da33df_52f7_4a4d_a3bb_1547c0a1aa49.slice/crio-efeeefa2946264719cb9db497c823ec302842cfdabb18aec7296c31e0721f2d4 WatchSource:0}: Error finding container efeeefa2946264719cb9db497c823ec302842cfdabb18aec7296c31e0721f2d4: Status 404 returned error can't find the container with id efeeefa2946264719cb9db497c823ec302842cfdabb18aec7296c31e0721f2d4
Jul 16 22:43:17.494927 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:17.494891    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw" event={"ID":"23da33df-52f7-4a4d-a3bb-1547c0a1aa49","Type":"ContainerStarted","Data":"efeeefa2946264719cb9db497c823ec302842cfdabb18aec7296c31e0721f2d4"}
Jul 16 22:43:17.635424 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:17.635390    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82eea723-3317-4ec0-9969-2c55ce716c70" path="/var/lib/kubelet/pods/82eea723-3317-4ec0-9969-2c55ce716c70/volumes"
Jul 16 22:43:22.530143 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:22.530103    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw" event={"ID":"23da33df-52f7-4a4d-a3bb-1547c0a1aa49","Type":"ContainerStarted","Data":"b21e81ac42a092804b89307cb0ff236dfe0c35844ca79a776acaa33a75d07512"}
Jul 16 22:43:22.530560 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:22.530181    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:22.547642 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:22.547593    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw" podStartSLOduration=1.6565730680000001 podStartE2EDuration="6.547574025s" totalImagesPullingTime="4.891000957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:43:22.546750036 +0000 UTC m=+583.475760248" watchObservedRunningTime="2026-07-16 22:43:22.547574025 +0000 UTC m=+583.476584237"
Jul 16 22:43:28.566720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:28.566691    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zlqsw"
Jul 16 22:43:29.180409 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.180374    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dwpz5"]
Jul 16 22:43:29.186775 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.186751    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dwpz5"
Jul 16 22:43:29.197701 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.197677    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dwpz5"]
Jul 16 22:43:29.261535 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.261502    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svcst\" (UniqueName: \"kubernetes.io/projected/0292e613-2ae9-41ed-9c5f-8f226e35bb1c-kube-api-access-svcst\") pod \"authorino-5d4b67c446-dwpz5\" (UID: \"0292e613-2ae9-41ed-9c5f-8f226e35bb1c\") " pod="kuadrant-system/authorino-5d4b67c446-dwpz5"
Jul 16 22:43:29.360562 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.360529    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dwpz5"]
Jul 16 22:43:29.360860 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:43:29.360838    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-svcst], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-dwpz5" podUID="0292e613-2ae9-41ed-9c5f-8f226e35bb1c"
Jul 16 22:43:29.362810 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.362775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svcst\" (UniqueName: \"kubernetes.io/projected/0292e613-2ae9-41ed-9c5f-8f226e35bb1c-kube-api-access-svcst\") pod \"authorino-5d4b67c446-dwpz5\" (UID: \"0292e613-2ae9-41ed-9c5f-8f226e35bb1c\") " pod="kuadrant-system/authorino-5d4b67c446-dwpz5"
Jul 16 22:43:29.374601 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.374573    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svcst\" (UniqueName: \"kubernetes.io/projected/0292e613-2ae9-41ed-9c5f-8f226e35bb1c-kube-api-access-svcst\") pod \"authorino-5d4b67c446-dwpz5\" (UID: \"0292e613-2ae9-41ed-9c5f-8f226e35bb1c\") " pod="kuadrant-system/authorino-5d4b67c446-dwpz5"
Jul 16 22:43:29.394400 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.394370    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-778dc6647f-wlgr8"]
Jul 16 22:43:29.398500 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.398482    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:43:29.401394 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.401376    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 22:43:29.408669 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.408646    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778dc6647f-wlgr8"]
Jul 16 22:43:29.464121 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.464052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eb6247-6772-4853-bab3-e58387315a97-tls-cert\") pod \"authorino-778dc6647f-wlgr8\" (UID: \"c4eb6247-6772-4853-bab3-e58387315a97\") " pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:43:29.464121 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.464088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzlts\" (UniqueName: \"kubernetes.io/projected/c4eb6247-6772-4853-bab3-e58387315a97-kube-api-access-pzlts\") pod \"authorino-778dc6647f-wlgr8\" (UID: \"c4eb6247-6772-4853-bab3-e58387315a97\") " pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:43:29.564570 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.564539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eb6247-6772-4853-bab3-e58387315a97-tls-cert\") pod \"authorino-778dc6647f-wlgr8\" (UID: \"c4eb6247-6772-4853-bab3-e58387315a97\") " pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:43:29.564733 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.564580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzlts\" (UniqueName: \"kubernetes.io/projected/c4eb6247-6772-4853-bab3-e58387315a97-kube-api-access-pzlts\") pod \"authorino-778dc6647f-wlgr8\" (UID: \"c4eb6247-6772-4853-bab3-e58387315a97\") " pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:43:29.567528 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.567499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eb6247-6772-4853-bab3-e58387315a97-tls-cert\") pod \"authorino-778dc6647f-wlgr8\" (UID: \"c4eb6247-6772-4853-bab3-e58387315a97\") " pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:43:29.572044 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.572021    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dwpz5"
Jul 16 22:43:29.573987 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.573964    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzlts\" (UniqueName: \"kubernetes.io/projected/c4eb6247-6772-4853-bab3-e58387315a97-kube-api-access-pzlts\") pod \"authorino-778dc6647f-wlgr8\" (UID: \"c4eb6247-6772-4853-bab3-e58387315a97\") " pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:43:29.590879 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.590849    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dwpz5"
Jul 16 22:43:29.664919 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.664891    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svcst\" (UniqueName: \"kubernetes.io/projected/0292e613-2ae9-41ed-9c5f-8f226e35bb1c-kube-api-access-svcst\") pod \"0292e613-2ae9-41ed-9c5f-8f226e35bb1c\" (UID: \"0292e613-2ae9-41ed-9c5f-8f226e35bb1c\") "
Jul 16 22:43:29.667485 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.667452    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0292e613-2ae9-41ed-9c5f-8f226e35bb1c-kube-api-access-svcst" (OuterVolumeSpecName: "kube-api-access-svcst") pod "0292e613-2ae9-41ed-9c5f-8f226e35bb1c" (UID: "0292e613-2ae9-41ed-9c5f-8f226e35bb1c"). InnerVolumeSpecName "kube-api-access-svcst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:43:29.708602 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.708572    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:43:29.766440 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.766401    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svcst\" (UniqueName: \"kubernetes.io/projected/0292e613-2ae9-41ed-9c5f-8f226e35bb1c-kube-api-access-svcst\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:43:29.849050 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:29.848976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778dc6647f-wlgr8"]
Jul 16 22:43:29.851756 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:43:29.851724    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4eb6247_6772_4853_bab3_e58387315a97.slice/crio-80c867d7266c29bcec2bc644d83a03dc8dbdf81dc4c8899c72c297c6ceaf775f WatchSource:0}: Error finding container 80c867d7266c29bcec2bc644d83a03dc8dbdf81dc4c8899c72c297c6ceaf775f: Status 404 returned error can't find the container with id 80c867d7266c29bcec2bc644d83a03dc8dbdf81dc4c8899c72c297c6ceaf775f
Jul 16 22:43:30.578863 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.578784    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dwpz5"
Jul 16 22:43:30.578863 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.578820    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778dc6647f-wlgr8" event={"ID":"c4eb6247-6772-4853-bab3-e58387315a97","Type":"ContainerStarted","Data":"d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1"}
Jul 16 22:43:30.579278 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.578864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778dc6647f-wlgr8" event={"ID":"c4eb6247-6772-4853-bab3-e58387315a97","Type":"ContainerStarted","Data":"80c867d7266c29bcec2bc644d83a03dc8dbdf81dc4c8899c72c297c6ceaf775f"}
Jul 16 22:43:30.600683 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.600627    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-778dc6647f-wlgr8" podStartSLOduration=1.182785076 podStartE2EDuration="1.600613246s" totalImagesPullingTime="417.82817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:43:30.599394448 +0000 UTC m=+591.528404671" watchObservedRunningTime="2026-07-16 22:43:30.600613246 +0000 UTC m=+591.529623480"
Jul 16 22:43:30.627210 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.627168    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b96bq"]
Jul 16 22:43:30.627449 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.627417    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-b96bq" podUID="6fd6851e-3c64-4b74-8b02-7cf34b49ec7b" containerName="authorino" containerID="cri-o://31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325" gracePeriod=30
Jul 16 22:43:30.640476 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.640442    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dwpz5"]
Jul 16 22:43:30.643777 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.643753    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dwpz5"]
Jul 16 22:43:30.900819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.900792    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b96bq"
Jul 16 22:43:30.974303 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.974270    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8456\" (UniqueName: \"kubernetes.io/projected/6fd6851e-3c64-4b74-8b02-7cf34b49ec7b-kube-api-access-v8456\") pod \"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b\" (UID: \"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b\") "
Jul 16 22:43:30.976435 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:30.976412    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd6851e-3c64-4b74-8b02-7cf34b49ec7b-kube-api-access-v8456" (OuterVolumeSpecName: "kube-api-access-v8456") pod "6fd6851e-3c64-4b74-8b02-7cf34b49ec7b" (UID: "6fd6851e-3c64-4b74-8b02-7cf34b49ec7b"). InnerVolumeSpecName "kube-api-access-v8456". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:43:31.075722 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.075682    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8456\" (UniqueName: \"kubernetes.io/projected/6fd6851e-3c64-4b74-8b02-7cf34b49ec7b-kube-api-access-v8456\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:43:31.585289 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.585247    2558 generic.go:356] "Generic (PLEG): container finished" podID="6fd6851e-3c64-4b74-8b02-7cf34b49ec7b" containerID="31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325" exitCode=0
Jul 16 22:43:31.585289 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.585271    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b96bq" event={"ID":"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b","Type":"ContainerDied","Data":"31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325"}
Jul 16 22:43:31.585829 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.585304    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b96bq"
Jul 16 22:43:31.585829 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.585325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b96bq" event={"ID":"6fd6851e-3c64-4b74-8b02-7cf34b49ec7b","Type":"ContainerDied","Data":"dd1b21e564ebd6fc1edb65c751a94e6413d71146bdf97daa16f8464e352be0f7"}
Jul 16 22:43:31.585829 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.585348    2558 scope.go:117] "RemoveContainer" containerID="31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325"
Jul 16 22:43:31.594356 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.594340    2558 scope.go:117] "RemoveContainer" containerID="31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325"
Jul 16 22:43:31.594593 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:43:31.594573    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325\": container with ID starting with 31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325 not found: ID does not exist" containerID="31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325"
Jul 16 22:43:31.594650 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.594601    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325"} err="failed to get container status \"31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325\": rpc error: code = NotFound desc = could not find container \"31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325\": container with ID starting with 31118a8f248a70960933d7c8b135853ff91bd9c14b94aca58ada3b09abe5e325 not found: ID does not exist"
Jul 16 22:43:31.606946 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.606925    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b96bq"]
Jul 16 22:43:31.610723 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.610702    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b96bq"]
Jul 16 22:43:31.634827 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.634803    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0292e613-2ae9-41ed-9c5f-8f226e35bb1c" path="/var/lib/kubelet/pods/0292e613-2ae9-41ed-9c5f-8f226e35bb1c/volumes"
Jul 16 22:43:31.635050 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:31.635037    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fd6851e-3c64-4b74-8b02-7cf34b49ec7b" path="/var/lib/kubelet/pods/6fd6851e-3c64-4b74-8b02-7cf34b49ec7b/volumes"
Jul 16 22:43:35.185717 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.185681    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5578d5449c-r6ch2"]
Jul 16 22:43:35.186104 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.186091    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd6851e-3c64-4b74-8b02-7cf34b49ec7b" containerName="authorino"
Jul 16 22:43:35.186151 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.186106    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd6851e-3c64-4b74-8b02-7cf34b49ec7b" containerName="authorino"
Jul 16 22:43:35.186205 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.186184    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd6851e-3c64-4b74-8b02-7cf34b49ec7b" containerName="authorino"
Jul 16 22:43:35.293841 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.293805    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5578d5449c-r6ch2"]
Jul 16 22:43:35.293997 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.293945    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:35.299529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.299503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r9kv4\""
Jul 16 22:43:35.299529 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.299516    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 22:43:35.299799 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.299780    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 22:43:35.310107 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.310087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7lrz\" (UniqueName: \"kubernetes.io/projected/44b8b919-0325-4e82-ae84-372551ddbbcd-kube-api-access-d7lrz\") pod \"maas-controller-5578d5449c-r6ch2\" (UID: \"44b8b919-0325-4e82-ae84-372551ddbbcd\") " pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:35.310215 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.310155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44b8b919-0325-4e82-ae84-372551ddbbcd-webhook-cert\") pod \"maas-controller-5578d5449c-r6ch2\" (UID: \"44b8b919-0325-4e82-ae84-372551ddbbcd\") " pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:35.360562 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.360536    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5575c64b5c-hvhl9"]
Jul 16 22:43:35.394949 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.394925    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-hvhl9"]
Jul 16 22:43:35.395087 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.395022    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:35.411569 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.411546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8mlv\" (UniqueName: \"kubernetes.io/projected/f78dae17-8780-4367-bb1d-a5be605b24c2-kube-api-access-f8mlv\") pod \"maas-controller-5575c64b5c-hvhl9\" (UID: \"f78dae17-8780-4367-bb1d-a5be605b24c2\") " pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:35.411700 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.411607    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44b8b919-0325-4e82-ae84-372551ddbbcd-webhook-cert\") pod \"maas-controller-5578d5449c-r6ch2\" (UID: \"44b8b919-0325-4e82-ae84-372551ddbbcd\") " pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:35.411762 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.411705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78dae17-8780-4367-bb1d-a5be605b24c2-webhook-cert\") pod \"maas-controller-5575c64b5c-hvhl9\" (UID: \"f78dae17-8780-4367-bb1d-a5be605b24c2\") " pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:35.411818 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.411775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7lrz\" (UniqueName: \"kubernetes.io/projected/44b8b919-0325-4e82-ae84-372551ddbbcd-kube-api-access-d7lrz\") pod \"maas-controller-5578d5449c-r6ch2\" (UID: \"44b8b919-0325-4e82-ae84-372551ddbbcd\") " pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:35.414334 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.414314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44b8b919-0325-4e82-ae84-372551ddbbcd-webhook-cert\") pod \"maas-controller-5578d5449c-r6ch2\" (UID: \"44b8b919-0325-4e82-ae84-372551ddbbcd\") " pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:35.422667 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.422647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7lrz\" (UniqueName: \"kubernetes.io/projected/44b8b919-0325-4e82-ae84-372551ddbbcd-kube-api-access-d7lrz\") pod \"maas-controller-5578d5449c-r6ch2\" (UID: \"44b8b919-0325-4e82-ae84-372551ddbbcd\") " pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:35.512940 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.512858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78dae17-8780-4367-bb1d-a5be605b24c2-webhook-cert\") pod \"maas-controller-5575c64b5c-hvhl9\" (UID: \"f78dae17-8780-4367-bb1d-a5be605b24c2\") " pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:35.512940 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.512930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8mlv\" (UniqueName: \"kubernetes.io/projected/f78dae17-8780-4367-bb1d-a5be605b24c2-kube-api-access-f8mlv\") pod \"maas-controller-5575c64b5c-hvhl9\" (UID: \"f78dae17-8780-4367-bb1d-a5be605b24c2\") " pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:35.515329 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.515300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78dae17-8780-4367-bb1d-a5be605b24c2-webhook-cert\") pod \"maas-controller-5575c64b5c-hvhl9\" (UID: \"f78dae17-8780-4367-bb1d-a5be605b24c2\") " pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:35.522462 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.522440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8mlv\" (UniqueName: \"kubernetes.io/projected/f78dae17-8780-4367-bb1d-a5be605b24c2-kube-api-access-f8mlv\") pod \"maas-controller-5575c64b5c-hvhl9\" (UID: \"f78dae17-8780-4367-bb1d-a5be605b24c2\") " pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:35.604819 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.604789    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:35.705506 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.705477    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:35.755216 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.755187    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5578d5449c-r6ch2"]
Jul 16 22:43:35.756516 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:43:35.756488    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b8b919_0325_4e82_ae84_372551ddbbcd.slice/crio-b3f5fcb5d248903c5568d1a64f8c2ea145a923851fb182fc56da9e7351c14686 WatchSource:0}: Error finding container b3f5fcb5d248903c5568d1a64f8c2ea145a923851fb182fc56da9e7351c14686: Status 404 returned error can't find the container with id b3f5fcb5d248903c5568d1a64f8c2ea145a923851fb182fc56da9e7351c14686
Jul 16 22:43:35.878528 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:35.878499    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-hvhl9"]
Jul 16 22:43:35.879928 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:43:35.879901    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78dae17_8780_4367_bb1d_a5be605b24c2.slice/crio-99409754dcb1b8abd5ef67595f0beb4412c3e19ff283aa2448627cf6b8ac1cec WatchSource:0}: Error finding container 99409754dcb1b8abd5ef67595f0beb4412c3e19ff283aa2448627cf6b8ac1cec: Status 404 returned error can't find the container with id 99409754dcb1b8abd5ef67595f0beb4412c3e19ff283aa2448627cf6b8ac1cec
Jul 16 22:43:36.618365 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:36.618320    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-hvhl9" event={"ID":"f78dae17-8780-4367-bb1d-a5be605b24c2","Type":"ContainerStarted","Data":"99409754dcb1b8abd5ef67595f0beb4412c3e19ff283aa2448627cf6b8ac1cec"}
Jul 16 22:43:36.620062 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:36.620000    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5578d5449c-r6ch2" event={"ID":"44b8b919-0325-4e82-ae84-372551ddbbcd","Type":"ContainerStarted","Data":"b3f5fcb5d248903c5568d1a64f8c2ea145a923851fb182fc56da9e7351c14686"}
Jul 16 22:43:39.491165 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.491136    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:43:39.493935 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.493909    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:43:39.495090 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.495067    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:43:39.497867 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.497850    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:43:39.638440 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.638399    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-hvhl9" event={"ID":"f78dae17-8780-4367-bb1d-a5be605b24c2","Type":"ContainerStarted","Data":"911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472"}
Jul 16 22:43:39.638637 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.638465    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:39.639785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.639762    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5578d5449c-r6ch2" event={"ID":"44b8b919-0325-4e82-ae84-372551ddbbcd","Type":"ContainerStarted","Data":"1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9"}
Jul 16 22:43:39.639891 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.639810    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:39.666533 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.664593    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5575c64b5c-hvhl9" podStartSLOduration=1.8474830770000001 podStartE2EDuration="4.664567459s" totalImagesPullingTime="2.817084382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:43:39.664202253 +0000 UTC m=+600.593212467" watchObservedRunningTime="2026-07-16 22:43:39.664567459 +0000 UTC m=+600.593577671"
Jul 16 22:43:39.688489 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:39.688446    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5578d5449c-r6ch2" podStartSLOduration=1.7442639359999998 podStartE2EDuration="4.688428224s" totalImagesPullingTime="2.944164288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:43:39.685121136 +0000 UTC m=+600.614131349" watchObservedRunningTime="2026-07-16 22:43:39.688428224 +0000 UTC m=+600.617438435"
Jul 16 22:43:50.647989 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:50.647957    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:43:50.649665 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:50.648026    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:50.720818 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:50.720781    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5578d5449c-r6ch2"]
Jul 16 22:43:50.721006 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:50.720987    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5578d5449c-r6ch2" podUID="44b8b919-0325-4e82-ae84-372551ddbbcd" containerName="manager" containerID="cri-o://1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9" gracePeriod=30
Jul 16 22:43:50.970018 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:50.969988    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:51.065348 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.065315    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7lrz\" (UniqueName: \"kubernetes.io/projected/44b8b919-0325-4e82-ae84-372551ddbbcd-kube-api-access-d7lrz\") pod \"44b8b919-0325-4e82-ae84-372551ddbbcd\" (UID: \"44b8b919-0325-4e82-ae84-372551ddbbcd\") "
Jul 16 22:43:51.065348 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.065354    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44b8b919-0325-4e82-ae84-372551ddbbcd-webhook-cert\") pod \"44b8b919-0325-4e82-ae84-372551ddbbcd\" (UID: \"44b8b919-0325-4e82-ae84-372551ddbbcd\") "
Jul 16 22:43:51.074423 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.074377    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b8b919-0325-4e82-ae84-372551ddbbcd-kube-api-access-d7lrz" (OuterVolumeSpecName: "kube-api-access-d7lrz") pod "44b8b919-0325-4e82-ae84-372551ddbbcd" (UID: "44b8b919-0325-4e82-ae84-372551ddbbcd"). InnerVolumeSpecName "kube-api-access-d7lrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:43:51.074673 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.074649    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b8b919-0325-4e82-ae84-372551ddbbcd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "44b8b919-0325-4e82-ae84-372551ddbbcd" (UID: "44b8b919-0325-4e82-ae84-372551ddbbcd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:43:51.167373 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.167341    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7lrz\" (UniqueName: \"kubernetes.io/projected/44b8b919-0325-4e82-ae84-372551ddbbcd-kube-api-access-d7lrz\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:43:51.167373 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.167368    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44b8b919-0325-4e82-ae84-372551ddbbcd-webhook-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:43:51.704298 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.704267    2558 generic.go:356] "Generic (PLEG): container finished" podID="44b8b919-0325-4e82-ae84-372551ddbbcd" containerID="1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9" exitCode=0
Jul 16 22:43:51.704751 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.704309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5578d5449c-r6ch2" event={"ID":"44b8b919-0325-4e82-ae84-372551ddbbcd","Type":"ContainerDied","Data":"1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9"}
Jul 16 22:43:51.704751 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.704325    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5578d5449c-r6ch2"
Jul 16 22:43:51.704751 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.704356    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5578d5449c-r6ch2" event={"ID":"44b8b919-0325-4e82-ae84-372551ddbbcd","Type":"ContainerDied","Data":"b3f5fcb5d248903c5568d1a64f8c2ea145a923851fb182fc56da9e7351c14686"}
Jul 16 22:43:51.704751 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.704381    2558 scope.go:117] "RemoveContainer" containerID="1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9"
Jul 16 22:43:51.713369 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.713347    2558 scope.go:117] "RemoveContainer" containerID="1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9"
Jul 16 22:43:51.713601 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:43:51.713580    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9\": container with ID starting with 1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9 not found: ID does not exist" containerID="1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9"
Jul 16 22:43:51.713648 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.713608    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9"} err="failed to get container status \"1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9\": rpc error: code = NotFound desc = could not find container \"1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9\": container with ID starting with 1dcf71200c839de1a84d2bd42554936eea814db049fe43b7a836db1ab641a0a9 not found: ID does not exist"
Jul 16 22:43:51.725209 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.725185    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5578d5449c-r6ch2"]
Jul 16 22:43:51.733032 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:51.733007    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5578d5449c-r6ch2"]
Jul 16 22:43:53.634433 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:43:53.634402    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b8b919-0325-4e82-ae84-372551ddbbcd" path="/var/lib/kubelet/pods/44b8b919-0325-4e82-ae84-372551ddbbcd/volumes"
Jul 16 22:44:13.786512 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.786433    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rwkxd"]
Jul 16 22:44:13.786892 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.786875    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b8b919-0325-4e82-ae84-372551ddbbcd" containerName="manager"
Jul 16 22:44:13.786944 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.786898    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b8b919-0325-4e82-ae84-372551ddbbcd" containerName="manager"
Jul 16 22:44:13.786997 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.786986    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b8b919-0325-4e82-ae84-372551ddbbcd" containerName="manager"
Jul 16 22:44:13.791429 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.791409    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:13.800747 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.800712    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 22:44:13.800865 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.800775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kjr8j\""
Jul 16 22:44:13.807756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.807733    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rwkxd"]
Jul 16 22:44:13.888884 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.888843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnpc7\" (UniqueName: \"kubernetes.io/projected/e2d830b1-4e83-4b8e-96be-d697f999b2c2-kube-api-access-lnpc7\") pod \"payload-processing-5bf47cd988-rwkxd\" (UID: \"e2d830b1-4e83-4b8e-96be-d697f999b2c2\") " pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:13.889081 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.888911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2d830b1-4e83-4b8e-96be-d697f999b2c2-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rwkxd\" (UID: \"e2d830b1-4e83-4b8e-96be-d697f999b2c2\") " pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:13.989768 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.989723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2d830b1-4e83-4b8e-96be-d697f999b2c2-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rwkxd\" (UID: \"e2d830b1-4e83-4b8e-96be-d697f999b2c2\") " pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:13.989966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.989841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnpc7\" (UniqueName: \"kubernetes.io/projected/e2d830b1-4e83-4b8e-96be-d697f999b2c2-kube-api-access-lnpc7\") pod \"payload-processing-5bf47cd988-rwkxd\" (UID: \"e2d830b1-4e83-4b8e-96be-d697f999b2c2\") " pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:13.990500 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.990474    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2d830b1-4e83-4b8e-96be-d697f999b2c2-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rwkxd\" (UID: \"e2d830b1-4e83-4b8e-96be-d697f999b2c2\") " pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:13.999336 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:13.999310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnpc7\" (UniqueName: \"kubernetes.io/projected/e2d830b1-4e83-4b8e-96be-d697f999b2c2-kube-api-access-lnpc7\") pod \"payload-processing-5bf47cd988-rwkxd\" (UID: \"e2d830b1-4e83-4b8e-96be-d697f999b2c2\") " pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:14.102768 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:14.102670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:14.257953 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:14.257926    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rwkxd"]
Jul 16 22:44:14.260311 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:44:14.260277    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d830b1_4e83_4b8e_96be_d697f999b2c2.slice/crio-5d75f78f6ead75e103ac9d8d8bf7a48b702d5e5f9e35bf1580731796a95382fb WatchSource:0}: Error finding container 5d75f78f6ead75e103ac9d8d8bf7a48b702d5e5f9e35bf1580731796a95382fb: Status 404 returned error can't find the container with id 5d75f78f6ead75e103ac9d8d8bf7a48b702d5e5f9e35bf1580731796a95382fb
Jul 16 22:44:14.262397 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:14.262375    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:44:14.825545 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:14.825507    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd" event={"ID":"e2d830b1-4e83-4b8e-96be-d697f999b2c2","Type":"ContainerStarted","Data":"5d75f78f6ead75e103ac9d8d8bf7a48b702d5e5f9e35bf1580731796a95382fb"}
Jul 16 22:44:16.838471 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:16.838433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd" event={"ID":"e2d830b1-4e83-4b8e-96be-d697f999b2c2","Type":"ContainerStarted","Data":"36d7f72dc81d60715d6b4c510c8b1b6d9ab370714991ed423c819039134495c9"}
Jul 16 22:44:16.838926 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:16.838514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:16.859745 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:16.859695    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd" podStartSLOduration=2.089152724 podStartE2EDuration="3.859678325s" totalImagesPullingTime="1.770525601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:44:16.857357133 +0000 UTC m=+637.786367346" watchObservedRunningTime="2026-07-16 22:44:16.859678325 +0000 UTC m=+637.788688581"
Jul 16 22:44:27.845106 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:27.845074    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-rwkxd"
Jul 16 22:44:43.056087 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.056051    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"]
Jul 16 22:44:43.060795 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.060773    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.064750 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.064722    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 22:44:43.064854 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.064755    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 22:44:43.064854 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.064755    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 22:44:43.064971 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.064760    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dgvpk\""
Jul 16 22:44:43.071376 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.071355    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"]
Jul 16 22:44:43.173625 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.173584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.173625 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.173631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.173865 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.173688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.173865 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.173744    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4be0fa-b000-4d68-aa76-4be8b808652b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.173865 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.173782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.174014 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.173909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgjws\" (UniqueName: \"kubernetes.io/projected/6c4be0fa-b000-4d68-aa76-4be8b808652b-kube-api-access-qgjws\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.275264 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.275198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.275462 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.275339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgjws\" (UniqueName: \"kubernetes.io/projected/6c4be0fa-b000-4d68-aa76-4be8b808652b-kube-api-access-qgjws\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.275462 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.275397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.275462 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.275427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.275462 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.275452    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.275692 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.275497    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4be0fa-b000-4d68-aa76-4be8b808652b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.275692 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.275659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.275942 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.275921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.276153 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.276129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.278759 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.278732    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4be0fa-b000-4d68-aa76-4be8b808652b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.278905 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.278871    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4be0fa-b000-4d68-aa76-4be8b808652b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.285518 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.285487    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgjws\" (UniqueName: \"kubernetes.io/projected/6c4be0fa-b000-4d68-aa76-4be8b808652b-kube-api-access-qgjws\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n\" (UID: \"6c4be0fa-b000-4d68-aa76-4be8b808652b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.372106 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.372072    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:44:43.514660 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.514632    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"]
Jul 16 22:44:43.516385 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:44:43.516353    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4be0fa_b000_4d68_aa76_4be8b808652b.slice/crio-840513eac4e280b5342eaf9d77a2a5451f16fbf6bd443190a0d4d46a6a5f95b7 WatchSource:0}: Error finding container 840513eac4e280b5342eaf9d77a2a5451f16fbf6bd443190a0d4d46a6a5f95b7: Status 404 returned error can't find the container with id 840513eac4e280b5342eaf9d77a2a5451f16fbf6bd443190a0d4d46a6a5f95b7
Jul 16 22:44:43.979708 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:44:43.979663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n" event={"ID":"6c4be0fa-b000-4d68-aa76-4be8b808652b","Type":"ContainerStarted","Data":"840513eac4e280b5342eaf9d77a2a5451f16fbf6bd443190a0d4d46a6a5f95b7"}
Jul 16 22:45:03.080898 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:03.080793    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n" event={"ID":"6c4be0fa-b000-4d68-aa76-4be8b808652b","Type":"ContainerStarted","Data":"6b98ea4589200d04bdaec44452bdfb7b2f0755a5bdd1383319948394da551028"}
Jul 16 22:45:03.101107 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:03.101055    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n" podStartSLOduration=0.875072704 podStartE2EDuration="20.101039586s" totalImagesPullingTime="19.225966882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:45:03.099621582 +0000 UTC m=+684.028631796" watchObservedRunningTime="2026-07-16 22:45:03.101039586 +0000 UTC m=+684.030049798"
Jul 16 22:45:03.372686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:03.372660    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:45:03.372827 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:03.372712    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:45:03.385925 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:03.385902    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:45:04.098876 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:04.098845    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n"
Jul 16 22:45:10.041999 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.041960    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"]
Jul 16 22:45:10.046113 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.046089    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.050573 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.050552    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 16 22:45:10.063783 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.063752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"]
Jul 16 22:45:10.138124 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.138091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a7cb9e-5633-4367-a5ce-8783bb04a001-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.138124 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.138128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.138371 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.138284    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jkjh\" (UniqueName: \"kubernetes.io/projected/42a7cb9e-5633-4367-a5ce-8783bb04a001-kube-api-access-9jkjh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.138371 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.138315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.138371 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.138335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.138485 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.138383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.239485 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.239453    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jkjh\" (UniqueName: \"kubernetes.io/projected/42a7cb9e-5633-4367-a5ce-8783bb04a001-kube-api-access-9jkjh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.239654 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.239492    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.239654 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.239514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.239654 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.239552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.239799 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.239669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a7cb9e-5633-4367-a5ce-8783bb04a001-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.239799 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.239716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.239969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.239950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.240028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.240011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.240137 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.240115    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.242053 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.242027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a7cb9e-5633-4367-a5ce-8783bb04a001-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.242296 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.242280    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a7cb9e-5633-4367-a5ce-8783bb04a001-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.248318 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.248297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jkjh\" (UniqueName: \"kubernetes.io/projected/42a7cb9e-5633-4367-a5ce-8783bb04a001-kube-api-access-9jkjh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j98t6\" (UID: \"42a7cb9e-5633-4367-a5ce-8783bb04a001\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.357585 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.357487    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:10.500550 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:10.500526    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"]
Jul 16 22:45:10.502832 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:45:10.502800    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a7cb9e_5633_4367_a5ce_8783bb04a001.slice/crio-43e1082ca03d770f7a2c6633f1b8b2381a2e129c04320a03ec587137021a7f8b WatchSource:0}: Error finding container 43e1082ca03d770f7a2c6633f1b8b2381a2e129c04320a03ec587137021a7f8b: Status 404 returned error can't find the container with id 43e1082ca03d770f7a2c6633f1b8b2381a2e129c04320a03ec587137021a7f8b
Jul 16 22:45:11.125603 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:11.125570    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6" event={"ID":"42a7cb9e-5633-4367-a5ce-8783bb04a001","Type":"ContainerStarted","Data":"cfb9aa3abb76dc8a42c9eb102ebc25dc6cc7eb4e9f8117fcc5dc2b9398b96810"}
Jul 16 22:45:11.126036 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:11.125619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6" event={"ID":"42a7cb9e-5633-4367-a5ce-8783bb04a001","Type":"ContainerStarted","Data":"43e1082ca03d770f7a2c6633f1b8b2381a2e129c04320a03ec587137021a7f8b"}
Jul 16 22:45:11.147012 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:11.146954    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6" podStartSLOduration=0.648436762 podStartE2EDuration="1.14693865s" totalImagesPullingTime="498.501888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:45:11.145072601 +0000 UTC m=+692.074082824" watchObservedRunningTime="2026-07-16 22:45:11.14693865 +0000 UTC m=+692.075948861"
Jul 16 22:45:20.357858 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:20.357827    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:20.358262 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:20.357983    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:20.370519 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:20.370499    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:21.190110 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:21.190078    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j98t6"
Jul 16 22:45:35.741079 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.741001    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"]
Jul 16 22:45:35.744926 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.744903    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.747631 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.747611    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 22:45:35.757968 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.757940    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"]
Jul 16 22:45:35.768059 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.767974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.768283 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.768109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37626db3-ed04-4eeb-b9f8-a6ce059007ca-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.768283 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.768161    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.768283 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.768177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.768283 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.768279    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.768532 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.768353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzjpv\" (UniqueName: \"kubernetes.io/projected/37626db3-ed04-4eeb-b9f8-a6ce059007ca-kube-api-access-qzjpv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.869813 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.869776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.869813 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.869823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzjpv\" (UniqueName: \"kubernetes.io/projected/37626db3-ed04-4eeb-b9f8-a6ce059007ca-kube-api-access-qzjpv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.870073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.869864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.870073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.869886    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37626db3-ed04-4eeb-b9f8-a6ce059007ca-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.870073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.869912    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.870073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.870007    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.870350 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.870328    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.870401 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.870346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.870437 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.870401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.872372 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.872348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37626db3-ed04-4eeb-b9f8-a6ce059007ca-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.872646 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.872624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37626db3-ed04-4eeb-b9f8-a6ce059007ca-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:35.879451 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:35.879420    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzjpv\" (UniqueName: \"kubernetes.io/projected/37626db3-ed04-4eeb-b9f8-a6ce059007ca-kube-api-access-qzjpv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-978pj\" (UID: \"37626db3-ed04-4eeb-b9f8-a6ce059007ca\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:36.057266 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:36.057142    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:36.209934 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:36.209829    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"]
Jul 16 22:45:36.210115 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:45:36.210094    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37626db3_ed04_4eeb_b9f8_a6ce059007ca.slice/crio-df79b4c18faf439dc9e28fc69a28e2f11dea04b6baf8b2711779190b73fbc6c8 WatchSource:0}: Error finding container df79b4c18faf439dc9e28fc69a28e2f11dea04b6baf8b2711779190b73fbc6c8: Status 404 returned error can't find the container with id df79b4c18faf439dc9e28fc69a28e2f11dea04b6baf8b2711779190b73fbc6c8
Jul 16 22:45:36.259045 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:36.259011    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj" event={"ID":"37626db3-ed04-4eeb-b9f8-a6ce059007ca","Type":"ContainerStarted","Data":"df79b4c18faf439dc9e28fc69a28e2f11dea04b6baf8b2711779190b73fbc6c8"}
Jul 16 22:45:45.310303 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:45.310265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj" event={"ID":"37626db3-ed04-4eeb-b9f8-a6ce059007ca","Type":"ContainerStarted","Data":"ef7a705b0f48e8df39b9245f336e677ad1cd89030c6ab2fd4e64d868edddc297"}
Jul 16 22:45:46.057427 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:46.057398    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:46.057616 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:46.057448    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:46.070001 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:46.069974    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:45:46.090898 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:46.090825    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj" podStartSLOduration=2.559483963 podStartE2EDuration="11.090810268s" totalImagesPullingTime="8.531326305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:45:45.335515773 +0000 UTC m=+726.264525984" watchObservedRunningTime="2026-07-16 22:45:46.090810268 +0000 UTC m=+727.019820481"
Jul 16 22:45:46.327753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:45:46.327672    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-978pj"
Jul 16 22:46:47.700812 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.700769    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b9bf489db-8sjm8"]
Jul 16 22:46:47.704463 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.704440    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9bf489db-8sjm8"
Jul 16 22:46:47.713369 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.713339    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b9bf489db-8sjm8"]
Jul 16 22:46:47.783708 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.783661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq2pw\" (UniqueName: \"kubernetes.io/projected/d7e41239-1ddf-42fc-887d-ae11f186f1cf-kube-api-access-cq2pw\") pod \"authorino-b9bf489db-8sjm8\" (UID: \"d7e41239-1ddf-42fc-887d-ae11f186f1cf\") " pod="kuadrant-system/authorino-b9bf489db-8sjm8"
Jul 16 22:46:47.783708 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.783711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d7e41239-1ddf-42fc-887d-ae11f186f1cf-tls-cert\") pod \"authorino-b9bf489db-8sjm8\" (UID: \"d7e41239-1ddf-42fc-887d-ae11f186f1cf\") " pod="kuadrant-system/authorino-b9bf489db-8sjm8"
Jul 16 22:46:47.885400 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.885352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq2pw\" (UniqueName: \"kubernetes.io/projected/d7e41239-1ddf-42fc-887d-ae11f186f1cf-kube-api-access-cq2pw\") pod \"authorino-b9bf489db-8sjm8\" (UID: \"d7e41239-1ddf-42fc-887d-ae11f186f1cf\") " pod="kuadrant-system/authorino-b9bf489db-8sjm8"
Jul 16 22:46:47.885400 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.885406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d7e41239-1ddf-42fc-887d-ae11f186f1cf-tls-cert\") pod \"authorino-b9bf489db-8sjm8\" (UID: \"d7e41239-1ddf-42fc-887d-ae11f186f1cf\") " pod="kuadrant-system/authorino-b9bf489db-8sjm8"
Jul 16 22:46:47.888174 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.888140    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d7e41239-1ddf-42fc-887d-ae11f186f1cf-tls-cert\") pod \"authorino-b9bf489db-8sjm8\" (UID: \"d7e41239-1ddf-42fc-887d-ae11f186f1cf\") " pod="kuadrant-system/authorino-b9bf489db-8sjm8"
Jul 16 22:46:47.895487 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:47.895456    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq2pw\" (UniqueName: \"kubernetes.io/projected/d7e41239-1ddf-42fc-887d-ae11f186f1cf-kube-api-access-cq2pw\") pod \"authorino-b9bf489db-8sjm8\" (UID: \"d7e41239-1ddf-42fc-887d-ae11f186f1cf\") " pod="kuadrant-system/authorino-b9bf489db-8sjm8"
Jul 16 22:46:48.015678 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:48.015578    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9bf489db-8sjm8"
Jul 16 22:46:48.177849 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:48.177820    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b9bf489db-8sjm8"]
Jul 16 22:46:48.180407 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:46:48.180379    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7e41239_1ddf_42fc_887d_ae11f186f1cf.slice/crio-72d6dff1bc9390a50ce8ab335d62b90810d20c2cabc01d8ca40ee9165420c2a4 WatchSource:0}: Error finding container 72d6dff1bc9390a50ce8ab335d62b90810d20c2cabc01d8ca40ee9165420c2a4: Status 404 returned error can't find the container with id 72d6dff1bc9390a50ce8ab335d62b90810d20c2cabc01d8ca40ee9165420c2a4
Jul 16 22:46:48.661956 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:48.661930    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9bf489db-8sjm8" event={"ID":"d7e41239-1ddf-42fc-887d-ae11f186f1cf","Type":"ContainerStarted","Data":"72d6dff1bc9390a50ce8ab335d62b90810d20c2cabc01d8ca40ee9165420c2a4"}
Jul 16 22:46:49.671285 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:49.671210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9bf489db-8sjm8" event={"ID":"d7e41239-1ddf-42fc-887d-ae11f186f1cf","Type":"ContainerStarted","Data":"e2846c57e4d57889352182a078c4fda3dd088847a82e8787a7f3673855802a69"}
Jul 16 22:46:49.728498 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:49.728436    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b9bf489db-8sjm8" podStartSLOduration=2.319613532 podStartE2EDuration="2.728415903s" totalImagesPullingTime="408.802371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:46:49.727812504 +0000 UTC m=+790.656822718" watchObservedRunningTime="2026-07-16 22:46:49.728415903 +0000 UTC m=+790.657426116"
Jul 16 22:46:49.787340 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:49.787298    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778dc6647f-wlgr8"]
Jul 16 22:46:49.787820 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:49.787790    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-778dc6647f-wlgr8" podUID="c4eb6247-6772-4853-bab3-e58387315a97" containerName="authorino" containerID="cri-o://d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1" gracePeriod=30
Jul 16 22:46:50.076958 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.076929    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:46:50.105966 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.105935    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzlts\" (UniqueName: \"kubernetes.io/projected/c4eb6247-6772-4853-bab3-e58387315a97-kube-api-access-pzlts\") pod \"c4eb6247-6772-4853-bab3-e58387315a97\" (UID: \"c4eb6247-6772-4853-bab3-e58387315a97\") "
Jul 16 22:46:50.106136 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.106035    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eb6247-6772-4853-bab3-e58387315a97-tls-cert\") pod \"c4eb6247-6772-4853-bab3-e58387315a97\" (UID: \"c4eb6247-6772-4853-bab3-e58387315a97\") "
Jul 16 22:46:50.108685 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.108648    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4eb6247-6772-4853-bab3-e58387315a97-kube-api-access-pzlts" (OuterVolumeSpecName: "kube-api-access-pzlts") pod "c4eb6247-6772-4853-bab3-e58387315a97" (UID: "c4eb6247-6772-4853-bab3-e58387315a97"). InnerVolumeSpecName "kube-api-access-pzlts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:46:50.119793 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.119764    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4eb6247-6772-4853-bab3-e58387315a97-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c4eb6247-6772-4853-bab3-e58387315a97" (UID: "c4eb6247-6772-4853-bab3-e58387315a97"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:46:50.206785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.206751    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzlts\" (UniqueName: \"kubernetes.io/projected/c4eb6247-6772-4853-bab3-e58387315a97-kube-api-access-pzlts\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:46:50.206785 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.206781    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4eb6247-6772-4853-bab3-e58387315a97-tls-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:46:50.677760 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.677721    2558 generic.go:356] "Generic (PLEG): container finished" podID="c4eb6247-6772-4853-bab3-e58387315a97" containerID="d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1" exitCode=0
Jul 16 22:46:50.678263 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.677767    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778dc6647f-wlgr8"
Jul 16 22:46:50.678263 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.677802    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778dc6647f-wlgr8" event={"ID":"c4eb6247-6772-4853-bab3-e58387315a97","Type":"ContainerDied","Data":"d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1"}
Jul 16 22:46:50.678263 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.677845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778dc6647f-wlgr8" event={"ID":"c4eb6247-6772-4853-bab3-e58387315a97","Type":"ContainerDied","Data":"80c867d7266c29bcec2bc644d83a03dc8dbdf81dc4c8899c72c297c6ceaf775f"}
Jul 16 22:46:50.678263 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.677862    2558 scope.go:117] "RemoveContainer" containerID="d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1"
Jul 16 22:46:50.688167 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.688149    2558 scope.go:117] "RemoveContainer" containerID="d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1"
Jul 16 22:46:50.688511 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:46:50.688492    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1\": container with ID starting with d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1 not found: ID does not exist" containerID="d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1"
Jul 16 22:46:50.688589 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.688522    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1"} err="failed to get container status \"d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1\": rpc error: code = NotFound desc = could not find container \"d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1\": container with ID starting with d1a3f6b3863d93956b0accc884179a2f246cc52ef6990fc54ebcd0531dd6bde1 not found: ID does not exist"
Jul 16 22:46:50.710753 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.710714    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778dc6647f-wlgr8"]
Jul 16 22:46:50.721011 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:50.720981    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-778dc6647f-wlgr8"]
Jul 16 22:46:51.635720 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:46:51.635688    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4eb6247-6772-4853-bab3-e58387315a97" path="/var/lib/kubelet/pods/c4eb6247-6772-4853-bab3-e58387315a97/volumes"
Jul 16 22:47:34.441899 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.441852    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-hvhl9"]
Jul 16 22:47:34.442500 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.442088    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5575c64b5c-hvhl9" podUID="f78dae17-8780-4367-bb1d-a5be605b24c2" containerName="manager" containerID="cri-o://911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472" gracePeriod=30
Jul 16 22:47:34.725825 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.725796    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:47:34.868765 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.868722    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8mlv\" (UniqueName: \"kubernetes.io/projected/f78dae17-8780-4367-bb1d-a5be605b24c2-kube-api-access-f8mlv\") pod \"f78dae17-8780-4367-bb1d-a5be605b24c2\" (UID: \"f78dae17-8780-4367-bb1d-a5be605b24c2\") "
Jul 16 22:47:34.868969 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.868788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78dae17-8780-4367-bb1d-a5be605b24c2-webhook-cert\") pod \"f78dae17-8780-4367-bb1d-a5be605b24c2\" (UID: \"f78dae17-8780-4367-bb1d-a5be605b24c2\") "
Jul 16 22:47:34.871163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.871129    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f78dae17-8780-4367-bb1d-a5be605b24c2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f78dae17-8780-4367-bb1d-a5be605b24c2" (UID: "f78dae17-8780-4367-bb1d-a5be605b24c2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:47:34.871163 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.871137    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78dae17-8780-4367-bb1d-a5be605b24c2-kube-api-access-f8mlv" (OuterVolumeSpecName: "kube-api-access-f8mlv") pod "f78dae17-8780-4367-bb1d-a5be605b24c2" (UID: "f78dae17-8780-4367-bb1d-a5be605b24c2"). InnerVolumeSpecName "kube-api-access-f8mlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:47:34.932721 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.932684    2558 generic.go:356] "Generic (PLEG): container finished" podID="f78dae17-8780-4367-bb1d-a5be605b24c2" containerID="911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472" exitCode=0
Jul 16 22:47:34.932916 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.932779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-hvhl9" event={"ID":"f78dae17-8780-4367-bb1d-a5be605b24c2","Type":"ContainerDied","Data":"911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472"}
Jul 16 22:47:34.932916 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.932814    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-hvhl9"
Jul 16 22:47:34.932916 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.932831    2558 scope.go:117] "RemoveContainer" containerID="911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472"
Jul 16 22:47:34.933067 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.932820    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-hvhl9" event={"ID":"f78dae17-8780-4367-bb1d-a5be605b24c2","Type":"ContainerDied","Data":"99409754dcb1b8abd5ef67595f0beb4412c3e19ff283aa2448627cf6b8ac1cec"}
Jul 16 22:47:34.944035 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.944016    2558 scope.go:117] "RemoveContainer" containerID="911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472"
Jul 16 22:47:34.944405 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:47:34.944376    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472\": container with ID starting with 911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472 not found: ID does not exist" containerID="911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472"
Jul 16 22:47:34.944469 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.944420    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472"} err="failed to get container status \"911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472\": rpc error: code = NotFound desc = could not find container \"911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472\": container with ID starting with 911fa1a41b7fbef73eb358c2cc3528a591f7f37fede618126dc8484ac68e8472 not found: ID does not exist"
Jul 16 22:47:34.958572 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.958492    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-hvhl9"]
Jul 16 22:47:34.962877 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.962839    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-hvhl9"]
Jul 16 22:47:34.970370 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.970348    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8mlv\" (UniqueName: \"kubernetes.io/projected/f78dae17-8780-4367-bb1d-a5be605b24c2-kube-api-access-f8mlv\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:47:34.970470 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:34.970373    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78dae17-8780-4367-bb1d-a5be605b24c2-webhook-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:47:35.634695 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:47:35.634659    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f78dae17-8780-4367-bb1d-a5be605b24c2" path="/var/lib/kubelet/pods/f78dae17-8780-4367-bb1d-a5be605b24c2/volumes"
Jul 16 22:48:35.774649 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.774566    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5575c64b5c-rckvq"]
Jul 16 22:48:35.775188 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.775165    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4eb6247-6772-4853-bab3-e58387315a97" containerName="authorino"
Jul 16 22:48:35.775304 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.775192    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4eb6247-6772-4853-bab3-e58387315a97" containerName="authorino"
Jul 16 22:48:35.775304 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.775213    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78dae17-8780-4367-bb1d-a5be605b24c2" containerName="manager"
Jul 16 22:48:35.775304 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.775222    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78dae17-8780-4367-bb1d-a5be605b24c2" containerName="manager"
Jul 16 22:48:35.775476 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.775381    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4eb6247-6772-4853-bab3-e58387315a97" containerName="authorino"
Jul 16 22:48:35.775476 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.775403    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78dae17-8780-4367-bb1d-a5be605b24c2" containerName="manager"
Jul 16 22:48:35.779023 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.778999    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:35.782001 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.781976    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 22:48:35.783886 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.783859    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r9kv4\""
Jul 16 22:48:35.784030 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.783859    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 22:48:35.787203 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.787171    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-rckvq"]
Jul 16 22:48:35.875712 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.875671    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69774\" (UniqueName: \"kubernetes.io/projected/4db0a1a6-509f-4d21-adb8-045da3de79ef-kube-api-access-69774\") pod \"maas-controller-5575c64b5c-rckvq\" (UID: \"4db0a1a6-509f-4d21-adb8-045da3de79ef\") " pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:35.875892 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.875738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4db0a1a6-509f-4d21-adb8-045da3de79ef-webhook-cert\") pod \"maas-controller-5575c64b5c-rckvq\" (UID: \"4db0a1a6-509f-4d21-adb8-045da3de79ef\") " pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:35.977071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.977014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69774\" (UniqueName: \"kubernetes.io/projected/4db0a1a6-509f-4d21-adb8-045da3de79ef-kube-api-access-69774\") pod \"maas-controller-5575c64b5c-rckvq\" (UID: \"4db0a1a6-509f-4d21-adb8-045da3de79ef\") " pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:35.977071 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.977075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4db0a1a6-509f-4d21-adb8-045da3de79ef-webhook-cert\") pod \"maas-controller-5575c64b5c-rckvq\" (UID: \"4db0a1a6-509f-4d21-adb8-045da3de79ef\") " pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:35.979882 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.979845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4db0a1a6-509f-4d21-adb8-045da3de79ef-webhook-cert\") pod \"maas-controller-5575c64b5c-rckvq\" (UID: \"4db0a1a6-509f-4d21-adb8-045da3de79ef\") " pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:35.985896 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:35.985868    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69774\" (UniqueName: \"kubernetes.io/projected/4db0a1a6-509f-4d21-adb8-045da3de79ef-kube-api-access-69774\") pod \"maas-controller-5575c64b5c-rckvq\" (UID: \"4db0a1a6-509f-4d21-adb8-045da3de79ef\") " pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:36.109875 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:36.109778    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:36.265356 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:36.265317    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-rckvq"]
Jul 16 22:48:36.268958 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:48:36.268919    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db0a1a6_509f_4d21_adb8_045da3de79ef.slice/crio-c88c92b136607c56415d2fb2d579acbe226b25ed7fb6a2c9bf94bba80f6b612c WatchSource:0}: Error finding container c88c92b136607c56415d2fb2d579acbe226b25ed7fb6a2c9bf94bba80f6b612c: Status 404 returned error can't find the container with id c88c92b136607c56415d2fb2d579acbe226b25ed7fb6a2c9bf94bba80f6b612c
Jul 16 22:48:37.280028 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:37.279991    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-rckvq" event={"ID":"4db0a1a6-509f-4d21-adb8-045da3de79ef","Type":"ContainerStarted","Data":"f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc"}
Jul 16 22:48:37.280542 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:37.280052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-rckvq" event={"ID":"4db0a1a6-509f-4d21-adb8-045da3de79ef","Type":"ContainerStarted","Data":"c88c92b136607c56415d2fb2d579acbe226b25ed7fb6a2c9bf94bba80f6b612c"}
Jul 16 22:48:37.280542 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:37.280091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:37.298433 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:37.298385    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5575c64b5c-rckvq" podStartSLOduration=1.886498432 podStartE2EDuration="2.298367779s" totalImagesPullingTime="411.869347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:48:37.296898345 +0000 UTC m=+898.225908563" watchObservedRunningTime="2026-07-16 22:48:37.298367779 +0000 UTC m=+898.227377990"
Jul 16 22:48:39.538495 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:39.538466    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:48:39.539988 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:39.539966    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:48:39.541707 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:39.541683    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:48:39.542942 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:39.542919    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:48:48.287779 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:48.287741    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:52.935930 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:52.935894    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-rckvq"]
Jul 16 22:48:52.938249 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:52.936162    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5575c64b5c-rckvq" podUID="4db0a1a6-509f-4d21-adb8-045da3de79ef" containerName="manager" containerID="cri-o://f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc" gracePeriod=30
Jul 16 22:48:53.193652 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.193587    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:53.246880 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.246845    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69774\" (UniqueName: \"kubernetes.io/projected/4db0a1a6-509f-4d21-adb8-045da3de79ef-kube-api-access-69774\") pod \"4db0a1a6-509f-4d21-adb8-045da3de79ef\" (UID: \"4db0a1a6-509f-4d21-adb8-045da3de79ef\") "
Jul 16 22:48:53.247078 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.247002    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4db0a1a6-509f-4d21-adb8-045da3de79ef-webhook-cert\") pod \"4db0a1a6-509f-4d21-adb8-045da3de79ef\" (UID: \"4db0a1a6-509f-4d21-adb8-045da3de79ef\") "
Jul 16 22:48:53.249304 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.249263    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db0a1a6-509f-4d21-adb8-045da3de79ef-kube-api-access-69774" (OuterVolumeSpecName: "kube-api-access-69774") pod "4db0a1a6-509f-4d21-adb8-045da3de79ef" (UID: "4db0a1a6-509f-4d21-adb8-045da3de79ef"). InnerVolumeSpecName "kube-api-access-69774". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:48:53.249469 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.249445    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db0a1a6-509f-4d21-adb8-045da3de79ef-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4db0a1a6-509f-4d21-adb8-045da3de79ef" (UID: "4db0a1a6-509f-4d21-adb8-045da3de79ef"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:48:53.348686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.348646    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4db0a1a6-509f-4d21-adb8-045da3de79ef-webhook-cert\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:48:53.348686 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.348683    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69774\" (UniqueName: \"kubernetes.io/projected/4db0a1a6-509f-4d21-adb8-045da3de79ef-kube-api-access-69774\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:48:53.372668 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.372633    2558 generic.go:356] "Generic (PLEG): container finished" podID="4db0a1a6-509f-4d21-adb8-045da3de79ef" containerID="f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc" exitCode=0
Jul 16 22:48:53.372856 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.372735    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-rckvq" event={"ID":"4db0a1a6-509f-4d21-adb8-045da3de79ef","Type":"ContainerDied","Data":"f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc"}
Jul 16 22:48:53.372856 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.372745    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-rckvq"
Jul 16 22:48:53.372856 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.372785    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-rckvq" event={"ID":"4db0a1a6-509f-4d21-adb8-045da3de79ef","Type":"ContainerDied","Data":"c88c92b136607c56415d2fb2d579acbe226b25ed7fb6a2c9bf94bba80f6b612c"}
Jul 16 22:48:53.372856 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.372813    2558 scope.go:117] "RemoveContainer" containerID="f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc"
Jul 16 22:48:53.383200 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.383177    2558 scope.go:117] "RemoveContainer" containerID="f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc"
Jul 16 22:48:53.383593 ip-10-0-134-116 kubenswrapper[2558]: E0716 22:48:53.383572    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc\": container with ID starting with f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc not found: ID does not exist" containerID="f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc"
Jul 16 22:48:53.383643 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.383603    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc"} err="failed to get container status \"f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc\": rpc error: code = NotFound desc = could not find container \"f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc\": container with ID starting with f2b02f253f52be013413347fe7b749b59987522ff49fde2cc273338320641bfc not found: ID does not exist"
Jul 16 22:48:53.396638 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.396614    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-rckvq"]
Jul 16 22:48:53.400663 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.400639    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-rckvq"]
Jul 16 22:48:53.635623 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:53.635586    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4db0a1a6-509f-4d21-adb8-045da3de79ef" path="/var/lib/kubelet/pods/4db0a1a6-509f-4d21-adb8-045da3de79ef/volumes"
Jul 16 22:48:54.155544 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.155509    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5575c64b5c-jd6pp"]
Jul 16 22:48:54.156073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.156056    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db0a1a6-509f-4d21-adb8-045da3de79ef" containerName="manager"
Jul 16 22:48:54.156117 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.156075    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db0a1a6-509f-4d21-adb8-045da3de79ef" containerName="manager"
Jul 16 22:48:54.156162 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.156153    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4db0a1a6-509f-4d21-adb8-045da3de79ef" containerName="manager"
Jul 16 22:48:54.159474 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.159456    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:54.162315 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.162286    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 22:48:54.162464 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.162451    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 22:48:54.163460 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.163440    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r9kv4\""
Jul 16 22:48:54.168523 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.168501    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-jd6pp"]
Jul 16 22:48:54.258825 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.258792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc17a7e0-44f1-4258-b8e6-6cb222f140dc-webhook-cert\") pod \"maas-controller-5575c64b5c-jd6pp\" (UID: \"fc17a7e0-44f1-4258-b8e6-6cb222f140dc\") " pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:54.259023 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.258838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8nf\" (UniqueName: \"kubernetes.io/projected/fc17a7e0-44f1-4258-b8e6-6cb222f140dc-kube-api-access-4k8nf\") pod \"maas-controller-5575c64b5c-jd6pp\" (UID: \"fc17a7e0-44f1-4258-b8e6-6cb222f140dc\") " pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:54.360014 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.359969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc17a7e0-44f1-4258-b8e6-6cb222f140dc-webhook-cert\") pod \"maas-controller-5575c64b5c-jd6pp\" (UID: \"fc17a7e0-44f1-4258-b8e6-6cb222f140dc\") " pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:54.360014 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.360022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8nf\" (UniqueName: \"kubernetes.io/projected/fc17a7e0-44f1-4258-b8e6-6cb222f140dc-kube-api-access-4k8nf\") pod \"maas-controller-5575c64b5c-jd6pp\" (UID: \"fc17a7e0-44f1-4258-b8e6-6cb222f140dc\") " pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:54.362759 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.362735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc17a7e0-44f1-4258-b8e6-6cb222f140dc-webhook-cert\") pod \"maas-controller-5575c64b5c-jd6pp\" (UID: \"fc17a7e0-44f1-4258-b8e6-6cb222f140dc\") " pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:54.368778 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.368750    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8nf\" (UniqueName: \"kubernetes.io/projected/fc17a7e0-44f1-4258-b8e6-6cb222f140dc-kube-api-access-4k8nf\") pod \"maas-controller-5575c64b5c-jd6pp\" (UID: \"fc17a7e0-44f1-4258-b8e6-6cb222f140dc\") " pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:54.472468 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.472371    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:54.617205 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:54.617177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5575c64b5c-jd6pp"]
Jul 16 22:48:54.620078 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:48:54.620051    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc17a7e0_44f1_4258_b8e6_6cb222f140dc.slice/crio-3a53bbc93d82e2b9c5e3eae889089a5a7cbb82798da0fb48cfbac2cfa912ffa1 WatchSource:0}: Error finding container 3a53bbc93d82e2b9c5e3eae889089a5a7cbb82798da0fb48cfbac2cfa912ffa1: Status 404 returned error can't find the container with id 3a53bbc93d82e2b9c5e3eae889089a5a7cbb82798da0fb48cfbac2cfa912ffa1
Jul 16 22:48:55.386102 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:55.386069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-jd6pp" event={"ID":"fc17a7e0-44f1-4258-b8e6-6cb222f140dc","Type":"ContainerStarted","Data":"b6b3a638524e2500e40a82a723e3d77db34765d00912ee64646386e76ef32162"}
Jul 16 22:48:55.386484 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:55.386128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5575c64b5c-jd6pp" event={"ID":"fc17a7e0-44f1-4258-b8e6-6cb222f140dc","Type":"ContainerStarted","Data":"3a53bbc93d82e2b9c5e3eae889089a5a7cbb82798da0fb48cfbac2cfa912ffa1"}
Jul 16 22:48:55.386484 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:55.386255    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:48:55.411456 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:48:55.411391    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5575c64b5c-jd6pp" podStartSLOduration=1.030057261 podStartE2EDuration="1.41137251s" totalImagesPullingTime="381.315249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:48:55.406423473 +0000 UTC m=+916.335433685" watchObservedRunningTime="2026-07-16 22:48:55.41137251 +0000 UTC m=+916.340382721"
Jul 16 22:49:06.395378 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:49:06.395342    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5575c64b5c-jd6pp"
Jul 16 22:53:39.574062 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:39.574036    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:53:39.574627 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:39.574307    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:53:39.576834 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:39.576815    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:53:39.577014 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:39.576999    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:53:43.429805 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:43.429765    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"]
Jul 16 22:53:43.430211 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:43.429998    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx" podUID="33ff7b7f-1e2c-4d64-a0ac-f44f9b634673" containerName="manager" containerID="cri-o://f02e035afdf7285c72e5c69cd62181041058822ca3d8627926d62e643ffda363" gracePeriod=10
Jul 16 22:53:45.990103 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:45.990067    2558 generic.go:356] "Generic (PLEG): container finished" podID="33ff7b7f-1e2c-4d64-a0ac-f44f9b634673" containerID="f02e035afdf7285c72e5c69cd62181041058822ca3d8627926d62e643ffda363" exitCode=0
Jul 16 22:53:45.990498 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:45.990127    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx" event={"ID":"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673","Type":"ContainerDied","Data":"f02e035afdf7285c72e5c69cd62181041058822ca3d8627926d62e643ffda363"}
Jul 16 22:53:46.381784 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.381754    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:53:46.490050 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.490023    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-extensions-socket-volume\") pod \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\" (UID: \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\") "
Jul 16 22:53:46.490223 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.490090    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcgs9\" (UniqueName: \"kubernetes.io/projected/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-kube-api-access-tcgs9\") pod \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\" (UID: \"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673\") "
Jul 16 22:53:46.490472 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.490439    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "33ff7b7f-1e2c-4d64-a0ac-f44f9b634673" (UID: "33ff7b7f-1e2c-4d64-a0ac-f44f9b634673"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:53:46.492278 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.492255    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-kube-api-access-tcgs9" (OuterVolumeSpecName: "kube-api-access-tcgs9") pod "33ff7b7f-1e2c-4d64-a0ac-f44f9b634673" (UID: "33ff7b7f-1e2c-4d64-a0ac-f44f9b634673"). InnerVolumeSpecName "kube-api-access-tcgs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:53:46.591494 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.591466    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-extensions-socket-volume\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:53:46.591494 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.591493    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcgs9\" (UniqueName: \"kubernetes.io/projected/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673-kube-api-access-tcgs9\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 22:53:46.996524 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.996481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx" event={"ID":"33ff7b7f-1e2c-4d64-a0ac-f44f9b634673","Type":"ContainerDied","Data":"89b1407ca5bf1570bdd08865ad11afeb811faa900325989c5009451b9cd7d489"}
Jul 16 22:53:46.996960 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.996548    2558 scope.go:117] "RemoveContainer" containerID="f02e035afdf7285c72e5c69cd62181041058822ca3d8627926d62e643ffda363"
Jul 16 22:53:46.996960 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:46.996495    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"
Jul 16 22:53:47.020936 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:47.020913    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"]
Jul 16 22:53:47.025486 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:47.025453    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rqdjx"]
Jul 16 22:53:47.635457 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:53:47.635420    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33ff7b7f-1e2c-4d64-a0ac-f44f9b634673" path="/var/lib/kubelet/pods/33ff7b7f-1e2c-4d64-a0ac-f44f9b634673/volumes"
Jul 16 22:54:44.535144 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.535105    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"]
Jul 16 22:54:44.535595 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.535581    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33ff7b7f-1e2c-4d64-a0ac-f44f9b634673" containerName="manager"
Jul 16 22:54:44.535640 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.535596    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="33ff7b7f-1e2c-4d64-a0ac-f44f9b634673" containerName="manager"
Jul 16 22:54:44.535675 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.535659    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="33ff7b7f-1e2c-4d64-a0ac-f44f9b634673" containerName="manager"
Jul 16 22:54:44.539756 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.539741    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:44.542790 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.542767    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6qtv7\""
Jul 16 22:54:44.559012 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.558984    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"]
Jul 16 22:54:44.645073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.645036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eab251d9-12b5-4a47-9f50-6ddc3cd39391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d29kk\" (UID: \"eab251d9-12b5-4a47-9f50-6ddc3cd39391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:44.645073 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.645075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zblw7\" (UniqueName: \"kubernetes.io/projected/eab251d9-12b5-4a47-9f50-6ddc3cd39391-kube-api-access-zblw7\") pod \"kuadrant-operator-controller-manager-86878c769f-d29kk\" (UID: \"eab251d9-12b5-4a47-9f50-6ddc3cd39391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:44.745744 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.745712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eab251d9-12b5-4a47-9f50-6ddc3cd39391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d29kk\" (UID: \"eab251d9-12b5-4a47-9f50-6ddc3cd39391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:44.745744 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.745750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zblw7\" (UniqueName: \"kubernetes.io/projected/eab251d9-12b5-4a47-9f50-6ddc3cd39391-kube-api-access-zblw7\") pod \"kuadrant-operator-controller-manager-86878c769f-d29kk\" (UID: \"eab251d9-12b5-4a47-9f50-6ddc3cd39391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:44.746186 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.746158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eab251d9-12b5-4a47-9f50-6ddc3cd39391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d29kk\" (UID: \"eab251d9-12b5-4a47-9f50-6ddc3cd39391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:44.754883 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.754862    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zblw7\" (UniqueName: \"kubernetes.io/projected/eab251d9-12b5-4a47-9f50-6ddc3cd39391-kube-api-access-zblw7\") pod \"kuadrant-operator-controller-manager-86878c769f-d29kk\" (UID: \"eab251d9-12b5-4a47-9f50-6ddc3cd39391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:44.850340 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:44.850219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:45.008497 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:45.008463    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"]
Jul 16 22:54:45.009454 ip-10-0-134-116 kubenswrapper[2558]: W0716 22:54:45.009428    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab251d9_12b5_4a47_9f50_6ddc3cd39391.slice/crio-b5f2e5e9fdd789884476eee284802c42da3c9357a78990b30a5a8eea519b56ef WatchSource:0}: Error finding container b5f2e5e9fdd789884476eee284802c42da3c9357a78990b30a5a8eea519b56ef: Status 404 returned error can't find the container with id b5f2e5e9fdd789884476eee284802c42da3c9357a78990b30a5a8eea519b56ef
Jul 16 22:54:45.307093 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:45.307055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk" event={"ID":"eab251d9-12b5-4a47-9f50-6ddc3cd39391","Type":"ContainerStarted","Data":"ed95ae69a09bcd0bc0e36ab8c7aea251112e2a5d86b79a426ae9a62ed9e4f75d"}
Jul 16 22:54:45.307298 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:45.307115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk" event={"ID":"eab251d9-12b5-4a47-9f50-6ddc3cd39391","Type":"ContainerStarted","Data":"b5f2e5e9fdd789884476eee284802c42da3c9357a78990b30a5a8eea519b56ef"}
Jul 16 22:54:45.307298 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:45.307144    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:54:45.332755 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:45.332695    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk" podStartSLOduration=1.332675146 podStartE2EDuration="1.332675146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:54:45.330923496 +0000 UTC m=+1266.259933710" watchObservedRunningTime="2026-07-16 22:54:45.332675146 +0000 UTC m=+1266.261685359"
Jul 16 22:54:56.315268 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:54:56.315217    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d29kk"
Jul 16 22:58:39.610343 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:58:39.610300    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:58:39.613036 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:58:39.613012    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 22:58:39.613604 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:58:39.613582    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 22:58:39.616060 ip-10-0-134-116 kubenswrapper[2558]: I0716 22:58:39.616040    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:01:22.153453 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.153419    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"]
Jul 16 23:01:22.157106 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.157087    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"
Jul 16 23:01:22.159862 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.159838    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dfwcd\""
Jul 16 23:01:22.180111 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.180079    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"]
Jul 16 23:01:22.255749 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.255706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2f18289-668a-4893-9fc0-f22c3e170d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-zv4xz\" (UID: \"e2f18289-668a-4893-9fc0-f22c3e170d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"
Jul 16 23:01:22.357157 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.357117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2f18289-668a-4893-9fc0-f22c3e170d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-zv4xz\" (UID: \"e2f18289-668a-4893-9fc0-f22c3e170d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"
Jul 16 23:01:22.357813 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.357793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2f18289-668a-4893-9fc0-f22c3e170d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-zv4xz\" (UID: \"e2f18289-668a-4893-9fc0-f22c3e170d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"
Jul 16 23:01:22.467745 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.467641    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"
Jul 16 23:01:22.831586 ip-10-0-134-116 kubenswrapper[2558]: W0716 23:01:22.831549    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f18289_668a_4893_9fc0_f22c3e170d46.slice/crio-3db70850a5916785a6b73654d1c827a9c5a190f9e618ab266dfb43df144899ab WatchSource:0}: Error finding container 3db70850a5916785a6b73654d1c827a9c5a190f9e618ab266dfb43df144899ab: Status 404 returned error can't find the container with id 3db70850a5916785a6b73654d1c827a9c5a190f9e618ab266dfb43df144899ab
Jul 16 23:01:22.833622 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.833602    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 23:01:22.834681 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:22.834660    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"]
Jul 16 23:01:23.509737 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:23.509700    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" event={"ID":"e2f18289-668a-4893-9fc0-f22c3e170d46","Type":"ContainerStarted","Data":"3db70850a5916785a6b73654d1c827a9c5a190f9e618ab266dfb43df144899ab"}
Jul 16 23:01:25.523149 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:25.523116    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" event={"ID":"e2f18289-668a-4893-9fc0-f22c3e170d46","Type":"ContainerStarted","Data":"2da0cc1c66ea3a76ab71415e5438f9bbcc2aa56d4c6af3579a2eaa178b7c3031"}
Jul 16 23:01:25.550067 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:25.549971    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" podStartSLOduration=1.349214329 podStartE2EDuration="3.549958185s" totalImagesPullingTime="2.200743856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 23:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 23:01:25.54846716 +0000 UTC m=+1666.477477370" watchObservedRunningTime="2026-07-16 23:01:25.549958185 +0000 UTC m=+1666.478968395"
Jul 16 23:01:26.529793 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:26.529758    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerID="2da0cc1c66ea3a76ab71415e5438f9bbcc2aa56d4c6af3579a2eaa178b7c3031" exitCode=7
Jul 16 23:01:26.530285 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:26.529818    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" event={"ID":"e2f18289-668a-4893-9fc0-f22c3e170d46","Type":"ContainerDied","Data":"2da0cc1c66ea3a76ab71415e5438f9bbcc2aa56d4c6af3579a2eaa178b7c3031"}
Jul 16 23:01:26.530285 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:26.530084    2558 scope.go:117] "RemoveContainer" containerID="2da0cc1c66ea3a76ab71415e5438f9bbcc2aa56d4c6af3579a2eaa178b7c3031"
Jul 16 23:01:27.537645 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:27.537561    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerID="b9859e51edfba3f735d05de8d4c91c92a26d88904f3c719efada31d29de7faf5" exitCode=7
Jul 16 23:01:27.537645 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:27.537632    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" event={"ID":"e2f18289-668a-4893-9fc0-f22c3e170d46","Type":"ContainerDied","Data":"b9859e51edfba3f735d05de8d4c91c92a26d88904f3c719efada31d29de7faf5"}
Jul 16 23:01:27.538068 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:27.537673    2558 scope.go:117] "RemoveContainer" containerID="2da0cc1c66ea3a76ab71415e5438f9bbcc2aa56d4c6af3579a2eaa178b7c3031"
Jul 16 23:01:27.538068 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:27.537842    2558 scope.go:117] "RemoveContainer" containerID="b9859e51edfba3f735d05de8d4c91c92a26d88904f3c719efada31d29de7faf5"
Jul 16 23:01:27.538172 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:01:27.538095    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-zv4xz_odh-ai-gateway-infra(e2f18289-668a-4893-9fc0-f22c3e170d46)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46"
Jul 16 23:01:28.544764 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:28.544738    2558 scope.go:117] "RemoveContainer" containerID="b9859e51edfba3f735d05de8d4c91c92a26d88904f3c719efada31d29de7faf5"
Jul 16 23:01:28.545110 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:01:28.544931    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-zv4xz_odh-ai-gateway-infra(e2f18289-668a-4893-9fc0-f22c3e170d46)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46"
Jul 16 23:01:42.628494 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:42.628462    2558 scope.go:117] "RemoveContainer" containerID="b9859e51edfba3f735d05de8d4c91c92a26d88904f3c719efada31d29de7faf5"
Jul 16 23:01:43.628336 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:43.628303    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerID="3ef86f5ee753d79a7f2b42d4e689635eb434b058132713c147882e53df401c67" exitCode=7
Jul 16 23:01:43.634243 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:43.634198    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" event={"ID":"e2f18289-668a-4893-9fc0-f22c3e170d46","Type":"ContainerDied","Data":"3ef86f5ee753d79a7f2b42d4e689635eb434b058132713c147882e53df401c67"}
Jul 16 23:01:43.634605 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:43.634270    2558 scope.go:117] "RemoveContainer" containerID="b9859e51edfba3f735d05de8d4c91c92a26d88904f3c719efada31d29de7faf5"
Jul 16 23:01:43.634605 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:43.634529    2558 scope.go:117] "RemoveContainer" containerID="3ef86f5ee753d79a7f2b42d4e689635eb434b058132713c147882e53df401c67"
Jul 16 23:01:43.634762 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:01:43.634743    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-zv4xz_odh-ai-gateway-infra(e2f18289-668a-4893-9fc0-f22c3e170d46)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46"
Jul 16 23:01:44.665716 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:44.665678    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"]
Jul 16 23:01:44.808613 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:44.808587    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"
Jul 16 23:01:44.880828 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:44.880798    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2f18289-668a-4893-9fc0-f22c3e170d46-maas-api-service-ca\") pod \"e2f18289-668a-4893-9fc0-f22c3e170d46\" (UID: \"e2f18289-668a-4893-9fc0-f22c3e170d46\") "
Jul 16 23:01:44.881162 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:44.881141    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2f18289-668a-4893-9fc0-f22c3e170d46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2f18289-668a-4893-9fc0-f22c3e170d46" (UID: "e2f18289-668a-4893-9fc0-f22c3e170d46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 23:01:44.982452 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:44.982363    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2f18289-668a-4893-9fc0-f22c3e170d46-maas-api-service-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 23:01:45.641969 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:45.641847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz" event={"ID":"e2f18289-668a-4893-9fc0-f22c3e170d46","Type":"ContainerDied","Data":"3db70850a5916785a6b73654d1c827a9c5a190f9e618ab266dfb43df144899ab"}
Jul 16 23:01:45.641969 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:45.641886    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"
Jul 16 23:01:45.641969 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:45.641908    2558 scope.go:117] "RemoveContainer" containerID="3ef86f5ee753d79a7f2b42d4e689635eb434b058132713c147882e53df401c67"
Jul 16 23:01:45.668325 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:45.668294    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"]
Jul 16 23:01:45.672822 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:45.672799    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-zv4xz"]
Jul 16 23:01:47.634793 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:01:47.634759    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" path="/var/lib/kubelet/pods/e2f18289-668a-4893-9fc0-f22c3e170d46/volumes"
Jul 16 23:02:22.193249 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.193205    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"]
Jul 16 23:02:22.193748 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.193668    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:02:22.193748 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.193681    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:02:22.193748 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.193691    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:02:22.193748 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.193697    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:02:22.193897 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.193765    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:02:22.193897 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.193773    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:02:22.193897 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.193781    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:02:22.197035 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.197010    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"
Jul 16 23:02:22.200122 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.200098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dfwcd\""
Jul 16 23:02:22.206729 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.206708    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"]
Jul 16 23:02:22.251290 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.251257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b90c7-04ae-44e8-81fa-2aa2be125372-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-qwzpn\" (UID: \"1b9b90c7-04ae-44e8-81fa-2aa2be125372\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"
Jul 16 23:02:22.352017 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.351981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b90c7-04ae-44e8-81fa-2aa2be125372-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-qwzpn\" (UID: \"1b9b90c7-04ae-44e8-81fa-2aa2be125372\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"
Jul 16 23:02:22.352803 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.352785    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b90c7-04ae-44e8-81fa-2aa2be125372-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-qwzpn\" (UID: \"1b9b90c7-04ae-44e8-81fa-2aa2be125372\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"
Jul 16 23:02:22.509298 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.509173    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"
Jul 16 23:02:22.667316 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.667284    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"]
Jul 16 23:02:22.672584 ip-10-0-134-116 kubenswrapper[2558]: W0716 23:02:22.672558    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9b90c7_04ae_44e8_81fa_2aa2be125372.slice/crio-425af34d3640448f189ffdeeeb056c67786e4ee73bfd6c54571e726e290563c9 WatchSource:0}: Error finding container 425af34d3640448f189ffdeeeb056c67786e4ee73bfd6c54571e726e290563c9: Status 404 returned error can't find the container with id 425af34d3640448f189ffdeeeb056c67786e4ee73bfd6c54571e726e290563c9
Jul 16 23:02:22.844970 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:22.844881    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" event={"ID":"1b9b90c7-04ae-44e8-81fa-2aa2be125372","Type":"ContainerStarted","Data":"425af34d3640448f189ffdeeeb056c67786e4ee73bfd6c54571e726e290563c9"}
Jul 16 23:02:23.851946 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:23.851911    2558 generic.go:356] "Generic (PLEG): container finished" podID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerID="5b7a0c0eeacec84aade0dbcd2af8e173d204ba868a108da6a0ca53b8481bd6c8" exitCode=7
Jul 16 23:02:23.852339 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:23.851956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" event={"ID":"1b9b90c7-04ae-44e8-81fa-2aa2be125372","Type":"ContainerDied","Data":"5b7a0c0eeacec84aade0dbcd2af8e173d204ba868a108da6a0ca53b8481bd6c8"}
Jul 16 23:02:23.852339 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:23.852162    2558 scope.go:117] "RemoveContainer" containerID="5b7a0c0eeacec84aade0dbcd2af8e173d204ba868a108da6a0ca53b8481bd6c8"
Jul 16 23:02:24.859201 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:24.859110    2558 generic.go:356] "Generic (PLEG): container finished" podID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerID="a62e1042945abd4fefc668974a3b68c076ac3ac1a1630041c4779b8a8260a9b3" exitCode=7
Jul 16 23:02:24.859201 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:24.859152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" event={"ID":"1b9b90c7-04ae-44e8-81fa-2aa2be125372","Type":"ContainerDied","Data":"a62e1042945abd4fefc668974a3b68c076ac3ac1a1630041c4779b8a8260a9b3"}
Jul 16 23:02:24.859201 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:24.859200    2558 scope.go:117] "RemoveContainer" containerID="5b7a0c0eeacec84aade0dbcd2af8e173d204ba868a108da6a0ca53b8481bd6c8"
Jul 16 23:02:24.859847 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:24.859424    2558 scope.go:117] "RemoveContainer" containerID="a62e1042945abd4fefc668974a3b68c076ac3ac1a1630041c4779b8a8260a9b3"
Jul 16 23:02:24.859847 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:02:24.859706    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-qwzpn_odh-ai-gateway-infra(1b9b90c7-04ae-44e8-81fa-2aa2be125372)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372"
Jul 16 23:02:25.866315 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:25.866289    2558 scope.go:117] "RemoveContainer" containerID="a62e1042945abd4fefc668974a3b68c076ac3ac1a1630041c4779b8a8260a9b3"
Jul 16 23:02:25.866706 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:02:25.866499    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-qwzpn_odh-ai-gateway-infra(1b9b90c7-04ae-44e8-81fa-2aa2be125372)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372"
Jul 16 23:02:36.628629 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:36.628597    2558 scope.go:117] "RemoveContainer" containerID="a62e1042945abd4fefc668974a3b68c076ac3ac1a1630041c4779b8a8260a9b3"
Jul 16 23:02:36.932103 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:36.932013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" event={"ID":"1b9b90c7-04ae-44e8-81fa-2aa2be125372","Type":"ContainerStarted","Data":"2568c832f96b6e39fb0a35a042a43311547cf1f83fa4f6c8074b09c73f4993d7"}
Jul 16 23:02:37.939394 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:37.939361    2558 generic.go:356] "Generic (PLEG): container finished" podID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerID="2568c832f96b6e39fb0a35a042a43311547cf1f83fa4f6c8074b09c73f4993d7" exitCode=7
Jul 16 23:02:37.939783 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:37.939432    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" event={"ID":"1b9b90c7-04ae-44e8-81fa-2aa2be125372","Type":"ContainerDied","Data":"2568c832f96b6e39fb0a35a042a43311547cf1f83fa4f6c8074b09c73f4993d7"}
Jul 16 23:02:37.939783 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:37.939495    2558 scope.go:117] "RemoveContainer" containerID="a62e1042945abd4fefc668974a3b68c076ac3ac1a1630041c4779b8a8260a9b3"
Jul 16 23:02:37.939894 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:37.939822    2558 scope.go:117] "RemoveContainer" containerID="2568c832f96b6e39fb0a35a042a43311547cf1f83fa4f6c8074b09c73f4993d7"
Jul 16 23:02:37.940063 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:02:37.940043    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-qwzpn_odh-ai-gateway-infra(1b9b90c7-04ae-44e8-81fa-2aa2be125372)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372"
Jul 16 23:02:37.972540 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:37.972504    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"]
Jul 16 23:02:39.088472 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.088448    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"
Jul 16 23:02:39.222679 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.222588    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b90c7-04ae-44e8-81fa-2aa2be125372-maas-api-service-ca\") pod \"1b9b90c7-04ae-44e8-81fa-2aa2be125372\" (UID: \"1b9b90c7-04ae-44e8-81fa-2aa2be125372\") "
Jul 16 23:02:39.223014 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.222984    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9b90c7-04ae-44e8-81fa-2aa2be125372-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b9b90c7-04ae-44e8-81fa-2aa2be125372" (UID: "1b9b90c7-04ae-44e8-81fa-2aa2be125372"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 23:02:39.323638 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.323589    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b90c7-04ae-44e8-81fa-2aa2be125372-maas-api-service-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 23:02:39.953941 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.953851    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"
Jul 16 23:02:39.953941 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.953850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn" event={"ID":"1b9b90c7-04ae-44e8-81fa-2aa2be125372","Type":"ContainerDied","Data":"425af34d3640448f189ffdeeeb056c67786e4ee73bfd6c54571e726e290563c9"}
Jul 16 23:02:39.954181 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.953982    2558 scope.go:117] "RemoveContainer" containerID="2568c832f96b6e39fb0a35a042a43311547cf1f83fa4f6c8074b09c73f4993d7"
Jul 16 23:02:39.971581 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.971555    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"]
Jul 16 23:02:39.978205 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:39.978182    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-qwzpn"]
Jul 16 23:02:41.634694 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:02:41.634659    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" path="/var/lib/kubelet/pods/1b9b90c7-04ae-44e8-81fa-2aa2be125372/volumes"
Jul 16 23:03:39.645074 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:03:39.645044    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:03:39.648053 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:03:39.648022    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:03:39.649938 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:03:39.649911    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:03:39.652702 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:03:39.652679    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:04:02.295241 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295206    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"]
Jul 16 23:04:02.295680 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295642    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:04:02.295680 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295653    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:04:02.295680 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295662    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:04:02.295680 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295668    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:04:02.295680 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295677    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:04:02.295680 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295682    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f18289-668a-4893-9fc0-f22c3e170d46" containerName="revoke-keys"
Jul 16 23:04:02.295904 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295689    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:04:02.295904 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295695    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:04:02.295904 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295768    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:04:02.295904 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.295779    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:04:02.299104 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.299083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"
Jul 16 23:04:02.304463 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.304434    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dfwcd\""
Jul 16 23:04:02.314854 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.314830    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"]
Jul 16 23:04:02.424849 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.424821    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a0061a-83ca-43bc-af9a-a7b76d2dcb46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-27l24\" (UID: \"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"
Jul 16 23:04:02.525647 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.525616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a0061a-83ca-43bc-af9a-a7b76d2dcb46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-27l24\" (UID: \"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"
Jul 16 23:04:02.526266 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.526248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a0061a-83ca-43bc-af9a-a7b76d2dcb46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3933c193-27l24\" (UID: \"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"
Jul 16 23:04:02.609322 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.609212    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"
Jul 16 23:04:02.762078 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:02.762053    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"]
Jul 16 23:04:02.764305 ip-10-0-134-116 kubenswrapper[2558]: W0716 23:04:02.764271    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a0061a_83ca_43bc_af9a_a7b76d2dcb46.slice/crio-8d27d916afed426cd7c817cc4db4cd588f528acb643cda402c9c90de7815adeb WatchSource:0}: Error finding container 8d27d916afed426cd7c817cc4db4cd588f528acb643cda402c9c90de7815adeb: Status 404 returned error can't find the container with id 8d27d916afed426cd7c817cc4db4cd588f528acb643cda402c9c90de7815adeb
Jul 16 23:04:03.414310 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:03.414286    2558 generic.go:356] "Generic (PLEG): container finished" podID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerID="c8a5c61d47618435ed55fc2859c5ff01ead1171b3fbd495ba94c0ec81b8dd883" exitCode=7
Jul 16 23:04:03.414641 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:03.414334    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24" event={"ID":"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46","Type":"ContainerDied","Data":"c8a5c61d47618435ed55fc2859c5ff01ead1171b3fbd495ba94c0ec81b8dd883"}
Jul 16 23:04:03.414641 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:03.414405    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24" event={"ID":"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46","Type":"ContainerStarted","Data":"8d27d916afed426cd7c817cc4db4cd588f528acb643cda402c9c90de7815adeb"}
Jul 16 23:04:03.414641 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:03.414603    2558 scope.go:117] "RemoveContainer" containerID="c8a5c61d47618435ed55fc2859c5ff01ead1171b3fbd495ba94c0ec81b8dd883"
Jul 16 23:04:04.421870 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:04.421835    2558 generic.go:356] "Generic (PLEG): container finished" podID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerID="17749a0cc03e4aa940538f6b1a667497f5b0eac5be028680a9f5e5167505e4cf" exitCode=7
Jul 16 23:04:04.422309 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:04.421918    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24" event={"ID":"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46","Type":"ContainerDied","Data":"17749a0cc03e4aa940538f6b1a667497f5b0eac5be028680a9f5e5167505e4cf"}
Jul 16 23:04:04.422309 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:04.422022    2558 scope.go:117] "RemoveContainer" containerID="c8a5c61d47618435ed55fc2859c5ff01ead1171b3fbd495ba94c0ec81b8dd883"
Jul 16 23:04:04.422309 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:04.422089    2558 scope.go:117] "RemoveContainer" containerID="17749a0cc03e4aa940538f6b1a667497f5b0eac5be028680a9f5e5167505e4cf"
Jul 16 23:04:04.422472 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:04:04.422372    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-27l24_odh-ai-gateway-infra(c0a0061a-83ca-43bc-af9a-a7b76d2dcb46)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46"
Jul 16 23:04:05.428748 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:05.428724    2558 scope.go:117] "RemoveContainer" containerID="17749a0cc03e4aa940538f6b1a667497f5b0eac5be028680a9f5e5167505e4cf"
Jul 16 23:04:05.429131 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:04:05.428918    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-27l24_odh-ai-gateway-infra(c0a0061a-83ca-43bc-af9a-a7b76d2dcb46)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46"
Jul 16 23:04:17.628474 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:17.628444    2558 scope.go:117] "RemoveContainer" containerID="17749a0cc03e4aa940538f6b1a667497f5b0eac5be028680a9f5e5167505e4cf"
Jul 16 23:04:18.501791 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:18.501701    2558 generic.go:356] "Generic (PLEG): container finished" podID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerID="e30baeb0f6ea042119b4f6051e827841df75b446ad99136240dfd6d94733ec37" exitCode=7
Jul 16 23:04:18.501972 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:18.501778    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24" event={"ID":"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46","Type":"ContainerDied","Data":"e30baeb0f6ea042119b4f6051e827841df75b446ad99136240dfd6d94733ec37"}
Jul 16 23:04:18.501972 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:18.501854    2558 scope.go:117] "RemoveContainer" containerID="17749a0cc03e4aa940538f6b1a667497f5b0eac5be028680a9f5e5167505e4cf"
Jul 16 23:04:18.502265 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:18.502210    2558 scope.go:117] "RemoveContainer" containerID="e30baeb0f6ea042119b4f6051e827841df75b446ad99136240dfd6d94733ec37"
Jul 16 23:04:18.502523 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:04:18.502496    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3933c193-27l24_odh-ai-gateway-infra(c0a0061a-83ca-43bc-af9a-a7b76d2dcb46)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46"
Jul 16 23:04:19.539464 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:19.539433    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"]
Jul 16 23:04:19.679081 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:19.679050    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"
Jul 16 23:04:19.795142 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:19.795061    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a0061a-83ca-43bc-af9a-a7b76d2dcb46-maas-api-service-ca\") pod \"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46\" (UID: \"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46\") "
Jul 16 23:04:19.795452 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:19.795429    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a0061a-83ca-43bc-af9a-a7b76d2dcb46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" (UID: "c0a0061a-83ca-43bc-af9a-a7b76d2dcb46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 23:04:19.896431 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:19.896398    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a0061a-83ca-43bc-af9a-a7b76d2dcb46-maas-api-service-ca\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 23:04:20.516422 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:20.516380    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24" event={"ID":"c0a0061a-83ca-43bc-af9a-a7b76d2dcb46","Type":"ContainerDied","Data":"8d27d916afed426cd7c817cc4db4cd588f528acb643cda402c9c90de7815adeb"}
Jul 16 23:04:20.516609 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:20.516447    2558 scope.go:117] "RemoveContainer" containerID="e30baeb0f6ea042119b4f6051e827841df75b446ad99136240dfd6d94733ec37"
Jul 16 23:04:20.516609 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:20.516392    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"
Jul 16 23:04:20.541796 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:20.541767    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"]
Jul 16 23:04:20.547925 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:20.547898    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3933c193-27l24"]
Jul 16 23:04:21.635168 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:04:21.635132    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" path="/var/lib/kubelet/pods/c0a0061a-83ca-43bc-af9a-a7b76d2dcb46/volumes"
Jul 16 23:08:39.682126 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:08:39.682099    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:08:39.685222 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:08:39.685199    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:08:39.688695 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:08:39.688672    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:08:39.691497 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:08:39.691478    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:13:39.715030 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:13:39.715003    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:13:39.718041 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:13:39.718016    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:13:39.723309 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:13:39.723291    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:13:39.725949 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:13:39.725928    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:18:39.746830 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:18:39.746747    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:18:39.749513 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:18:39.749486    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:18:39.757023 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:18:39.757003    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:18:39.759611 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:18:39.759595    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:23:39.778748 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:23:39.778715    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:23:39.784601 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:23:39.784573    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:23:39.794123 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:23:39.794102    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:23:39.796792 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:23:39.796775    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:26:22.044369 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044331    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vk9h"]
Jul 16 23:26:22.044855 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044826    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:26:22.044855 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044853    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:26:22.045020 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044867    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:26:22.045020 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044876    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:26:22.045020 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044881    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:26:22.045020 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044887    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:26:22.045020 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044981    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:26:22.045020 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.044991    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9b90c7-04ae-44e8-81fa-2aa2be125372" containerName="revoke-keys"
Jul 16 23:26:22.045020 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.045000    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:26:22.048103 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.048084    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:22.055876 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.055849    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vk9h"]
Jul 16 23:26:22.086086 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.086046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2c45\" (UniqueName: \"kubernetes.io/projected/960e70aa-b3bc-45b4-9fd5-6addf485ae22-kube-api-access-k2c45\") pod \"kuadrant-operator-catalog-5vk9h\" (UID: \"960e70aa-b3bc-45b4-9fd5-6addf485ae22\") " pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:22.186957 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.186912    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c45\" (UniqueName: \"kubernetes.io/projected/960e70aa-b3bc-45b4-9fd5-6addf485ae22-kube-api-access-k2c45\") pod \"kuadrant-operator-catalog-5vk9h\" (UID: \"960e70aa-b3bc-45b4-9fd5-6addf485ae22\") " pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:22.195555 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.195526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2c45\" (UniqueName: \"kubernetes.io/projected/960e70aa-b3bc-45b4-9fd5-6addf485ae22-kube-api-access-k2c45\") pod \"kuadrant-operator-catalog-5vk9h\" (UID: \"960e70aa-b3bc-45b4-9fd5-6addf485ae22\") " pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:22.360330 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.360213    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:22.504817 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.504792    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vk9h"]
Jul 16 23:26:22.507015 ip-10-0-134-116 kubenswrapper[2558]: W0716 23:26:22.506986    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960e70aa_b3bc_45b4_9fd5_6addf485ae22.slice/crio-edcdef73ca765678ab73ade7a4bcd1ce4e7e5e744fdaeb34bb0497e481627d7d WatchSource:0}: Error finding container edcdef73ca765678ab73ade7a4bcd1ce4e7e5e744fdaeb34bb0497e481627d7d: Status 404 returned error can't find the container with id edcdef73ca765678ab73ade7a4bcd1ce4e7e5e744fdaeb34bb0497e481627d7d
Jul 16 23:26:22.508514 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.508493    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 23:26:22.573731 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:22.573696    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h" event={"ID":"960e70aa-b3bc-45b4-9fd5-6addf485ae22","Type":"ContainerStarted","Data":"edcdef73ca765678ab73ade7a4bcd1ce4e7e5e744fdaeb34bb0497e481627d7d"}
Jul 16 23:26:23.580699 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:23.580652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h" event={"ID":"960e70aa-b3bc-45b4-9fd5-6addf485ae22","Type":"ContainerStarted","Data":"236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279"}
Jul 16 23:26:23.597301 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:23.597250    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h" podStartSLOduration=1.100692097 podStartE2EDuration="1.597213667s" totalImagesPullingTime="496.52157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 23:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 23:26:23.596281419 +0000 UTC m=+3164.525291631" watchObservedRunningTime="2026-07-16 23:26:23.597213667 +0000 UTC m=+3164.526223879"
Jul 16 23:26:32.361386 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:32.361348    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:32.361811 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:32.361420    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:32.389604 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:32.389576    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:32.652780 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:32.652752    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:32.690599 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:32.690568    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vk9h"]
Jul 16 23:26:34.641146 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:34.641080    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h" podUID="960e70aa-b3bc-45b4-9fd5-6addf485ae22" containerName="registry-server" containerID="cri-o://236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279" gracePeriod=2
Jul 16 23:26:34.898169 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:34.898099    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:35.011920 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.011879    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2c45\" (UniqueName: \"kubernetes.io/projected/960e70aa-b3bc-45b4-9fd5-6addf485ae22-kube-api-access-k2c45\") pod \"960e70aa-b3bc-45b4-9fd5-6addf485ae22\" (UID: \"960e70aa-b3bc-45b4-9fd5-6addf485ae22\") "
Jul 16 23:26:35.014048 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.014020    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960e70aa-b3bc-45b4-9fd5-6addf485ae22-kube-api-access-k2c45" (OuterVolumeSpecName: "kube-api-access-k2c45") pod "960e70aa-b3bc-45b4-9fd5-6addf485ae22" (UID: "960e70aa-b3bc-45b4-9fd5-6addf485ae22"). InnerVolumeSpecName "kube-api-access-k2c45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:26:35.113556 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.113523    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2c45\" (UniqueName: \"kubernetes.io/projected/960e70aa-b3bc-45b4-9fd5-6addf485ae22-kube-api-access-k2c45\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 23:26:35.648492 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.648463    2558 generic.go:356] "Generic (PLEG): container finished" podID="960e70aa-b3bc-45b4-9fd5-6addf485ae22" containerID="236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279" exitCode=0
Jul 16 23:26:35.648883 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.648511    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h"
Jul 16 23:26:35.648883 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.648541    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h" event={"ID":"960e70aa-b3bc-45b4-9fd5-6addf485ae22","Type":"ContainerDied","Data":"236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279"}
Jul 16 23:26:35.648883 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.648594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vk9h" event={"ID":"960e70aa-b3bc-45b4-9fd5-6addf485ae22","Type":"ContainerDied","Data":"edcdef73ca765678ab73ade7a4bcd1ce4e7e5e744fdaeb34bb0497e481627d7d"}
Jul 16 23:26:35.648883 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.648619    2558 scope.go:117] "RemoveContainer" containerID="236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279"
Jul 16 23:26:35.657861 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.657838    2558 scope.go:117] "RemoveContainer" containerID="236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279"
Jul 16 23:26:35.658113 ip-10-0-134-116 kubenswrapper[2558]: E0716 23:26:35.658094    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279\": container with ID starting with 236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279 not found: ID does not exist" containerID="236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279"
Jul 16 23:26:35.658180 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.658124    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279"} err="failed to get container status \"236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279\": rpc error: code = NotFound desc = could not find container \"236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279\": container with ID starting with 236a3a1070a6d213a101450ce236a47d28efb63de4fc91bc36cd76106c229279 not found: ID does not exist"
Jul 16 23:26:35.676713 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.671401    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vk9h"]
Jul 16 23:26:35.676713 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:35.675751    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vk9h"]
Jul 16 23:26:37.634792 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:26:37.634755    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960e70aa-b3bc-45b4-9fd5-6addf485ae22" path="/var/lib/kubelet/pods/960e70aa-b3bc-45b4-9fd5-6addf485ae22/volumes"
Jul 16 23:28:39.816337 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:28:39.816310    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:28:39.819416 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:28:39.819387    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:28:39.829582 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:28:39.829559    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:28:39.832678 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:28:39.832658    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rs44_7d6e9cb5-814a-4503-935c-41a97397f8d6/ovn-acl-logging/0.log"
Jul 16 23:29:49.672858 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.672829    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7299-139721934989872"]
Jul 16 23:29:49.673365 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.673242    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960e70aa-b3bc-45b4-9fd5-6addf485ae22" containerName="registry-server"
Jul 16 23:29:49.673365 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.673258    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="960e70aa-b3bc-45b4-9fd5-6addf485ae22" containerName="registry-server"
Jul 16 23:29:49.673365 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.673351    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a0061a-83ca-43bc-af9a-a7b76d2dcb46" containerName="revoke-keys"
Jul 16 23:29:49.673365 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.673361    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="960e70aa-b3bc-45b4-9fd5-6addf485ae22" containerName="registry-server"
Jul 16 23:29:49.676446 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.676414    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7299-139721934989872"
Jul 16 23:29:49.683114 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.680148    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zn5bl\""
Jul 16 23:29:49.695187 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.695114    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7299-139721934989872"]
Jul 16 23:29:49.843548 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.843509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhkfg\" (UniqueName: \"kubernetes.io/projected/0d3afe71-4259-4910-98ab-c48905ea3f23-kube-api-access-mhkfg\") pod \"test-curl-7299-139721934989872\" (UID: \"0d3afe71-4259-4910-98ab-c48905ea3f23\") " pod="opendatahub/test-curl-7299-139721934989872"
Jul 16 23:29:49.945133 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.945041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhkfg\" (UniqueName: \"kubernetes.io/projected/0d3afe71-4259-4910-98ab-c48905ea3f23-kube-api-access-mhkfg\") pod \"test-curl-7299-139721934989872\" (UID: \"0d3afe71-4259-4910-98ab-c48905ea3f23\") " pod="opendatahub/test-curl-7299-139721934989872"
Jul 16 23:29:49.953630 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.953600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhkfg\" (UniqueName: \"kubernetes.io/projected/0d3afe71-4259-4910-98ab-c48905ea3f23-kube-api-access-mhkfg\") pod \"test-curl-7299-139721934989872\" (UID: \"0d3afe71-4259-4910-98ab-c48905ea3f23\") " pod="opendatahub/test-curl-7299-139721934989872"
Jul 16 23:29:49.999391 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:49.999356    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7299-139721934989872"
Jul 16 23:29:50.140850 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:50.140817    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7299-139721934989872"]
Jul 16 23:29:50.142282 ip-10-0-134-116 kubenswrapper[2558]: W0716 23:29:50.142254    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d3afe71_4259_4910_98ab_c48905ea3f23.slice/crio-e6992cbd675448ee8361bc909b804ec88fb15d7573eeddd2c3f0e653b304305d WatchSource:0}: Error finding container e6992cbd675448ee8361bc909b804ec88fb15d7573eeddd2c3f0e653b304305d: Status 404 returned error can't find the container with id e6992cbd675448ee8361bc909b804ec88fb15d7573eeddd2c3f0e653b304305d
Jul 16 23:29:50.727203 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:50.727163    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7299-139721934989872" event={"ID":"0d3afe71-4259-4910-98ab-c48905ea3f23","Type":"ContainerStarted","Data":"e6992cbd675448ee8361bc909b804ec88fb15d7573eeddd2c3f0e653b304305d"}
Jul 16 23:29:51.734358 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:51.734320    2558 generic.go:356] "Generic (PLEG): container finished" podID="0d3afe71-4259-4910-98ab-c48905ea3f23" containerID="5942abc8c8184c5a1f05074a7dda864f81408dc9c41c89b77580dbfec31de9ab" exitCode=0
Jul 16 23:29:51.734748 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:51.734406    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7299-139721934989872" event={"ID":"0d3afe71-4259-4910-98ab-c48905ea3f23","Type":"ContainerDied","Data":"5942abc8c8184c5a1f05074a7dda864f81408dc9c41c89b77580dbfec31de9ab"}
Jul 16 23:29:52.881508 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:52.881481    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7299-139721934989872"
Jul 16 23:29:52.915861 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:52.915835    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7299-139721934989872_0d3afe71-4259-4910-98ab-c48905ea3f23/test-curl-7299-139721934989872/0.log"
Jul 16 23:29:52.939499 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:52.939463    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7299-139721934989872"]
Jul 16 23:29:52.943294 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:52.943255    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7299-139721934989872"]
Jul 16 23:29:52.975130 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:52.975098    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhkfg\" (UniqueName: \"kubernetes.io/projected/0d3afe71-4259-4910-98ab-c48905ea3f23-kube-api-access-mhkfg\") pod \"0d3afe71-4259-4910-98ab-c48905ea3f23\" (UID: \"0d3afe71-4259-4910-98ab-c48905ea3f23\") "
Jul 16 23:29:52.977396 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:52.977364    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d3afe71-4259-4910-98ab-c48905ea3f23-kube-api-access-mhkfg" (OuterVolumeSpecName: "kube-api-access-mhkfg") pod "0d3afe71-4259-4910-98ab-c48905ea3f23" (UID: "0d3afe71-4259-4910-98ab-c48905ea3f23"). InnerVolumeSpecName "kube-api-access-mhkfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:29:53.076508 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:53.076429    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhkfg\" (UniqueName: \"kubernetes.io/projected/0d3afe71-4259-4910-98ab-c48905ea3f23-kube-api-access-mhkfg\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 23:29:53.636198 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:53.636162    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d3afe71-4259-4910-98ab-c48905ea3f23" path="/var/lib/kubelet/pods/0d3afe71-4259-4910-98ab-c48905ea3f23/volumes"
Jul 16 23:29:53.746305 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:53.746276    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7299-139721934989872"
Jul 16 23:29:53.746485 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:53.746311    2558 scope.go:117] "RemoveContainer" containerID="5942abc8c8184c5a1f05074a7dda864f81408dc9c41c89b77580dbfec31de9ab"
Jul 16 23:29:56.250837 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.250801    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7299-139721935029568"]
Jul 16 23:29:56.251269 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.251246    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d3afe71-4259-4910-98ab-c48905ea3f23" containerName="test-curl-7299-139721934989872"
Jul 16 23:29:56.251269 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.251263    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d3afe71-4259-4910-98ab-c48905ea3f23" containerName="test-curl-7299-139721934989872"
Jul 16 23:29:56.251378 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.251346    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d3afe71-4259-4910-98ab-c48905ea3f23" containerName="test-curl-7299-139721934989872"
Jul 16 23:29:56.255702 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.255680    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7299-139721935029568"
Jul 16 23:29:56.258398 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.258376    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zn5bl\""
Jul 16 23:29:56.260349 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.260328    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7299-139721935029568"]
Jul 16 23:29:56.308842 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.308809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxqjw\" (UniqueName: \"kubernetes.io/projected/f74eee42-7567-4ff4-9643-cacae07bbe60-kube-api-access-mxqjw\") pod \"test-curl-7299-139721935029568\" (UID: \"f74eee42-7567-4ff4-9643-cacae07bbe60\") " pod="opendatahub/test-curl-7299-139721935029568"
Jul 16 23:29:56.409502 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.409457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxqjw\" (UniqueName: \"kubernetes.io/projected/f74eee42-7567-4ff4-9643-cacae07bbe60-kube-api-access-mxqjw\") pod \"test-curl-7299-139721935029568\" (UID: \"f74eee42-7567-4ff4-9643-cacae07bbe60\") " pod="opendatahub/test-curl-7299-139721935029568"
Jul 16 23:29:56.419845 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.419805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxqjw\" (UniqueName: \"kubernetes.io/projected/f74eee42-7567-4ff4-9643-cacae07bbe60-kube-api-access-mxqjw\") pod \"test-curl-7299-139721935029568\" (UID: \"f74eee42-7567-4ff4-9643-cacae07bbe60\") " pod="opendatahub/test-curl-7299-139721935029568"
Jul 16 23:29:56.566226 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.566140    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7299-139721935029568"
Jul 16 23:29:56.705523 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.705501    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7299-139721935029568"]
Jul 16 23:29:56.708027 ip-10-0-134-116 kubenswrapper[2558]: W0716 23:29:56.707991    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf74eee42_7567_4ff4_9643_cacae07bbe60.slice/crio-baeb0df43e6c8bb2bdd34b77307a9fe312c39862adaff4406bb06a095c41fa56 WatchSource:0}: Error finding container baeb0df43e6c8bb2bdd34b77307a9fe312c39862adaff4406bb06a095c41fa56: Status 404 returned error can't find the container with id baeb0df43e6c8bb2bdd34b77307a9fe312c39862adaff4406bb06a095c41fa56
Jul 16 23:29:56.773431 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:56.773397    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7299-139721935029568" event={"ID":"f74eee42-7567-4ff4-9643-cacae07bbe60","Type":"ContainerStarted","Data":"baeb0df43e6c8bb2bdd34b77307a9fe312c39862adaff4406bb06a095c41fa56"}
Jul 16 23:29:57.781357 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:57.781218    2558 generic.go:356] "Generic (PLEG): container finished" podID="f74eee42-7567-4ff4-9643-cacae07bbe60" containerID="79d2248adf0234ea09865d58e16f68925abde2968f07f3ff4a7df00ac3d00d04" exitCode=0
Jul 16 23:29:57.781357 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:57.781310    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7299-139721935029568" event={"ID":"f74eee42-7567-4ff4-9643-cacae07bbe60","Type":"ContainerDied","Data":"79d2248adf0234ea09865d58e16f68925abde2968f07f3ff4a7df00ac3d00d04"}
Jul 16 23:29:58.928796 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:58.928773    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7299-139721935029568"
Jul 16 23:29:58.948388 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:58.948359    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7299-139721935029568_f74eee42-7567-4ff4-9643-cacae07bbe60/test-curl-7299-139721935029568/0.log"
Jul 16 23:29:58.983576 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:58.983544    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7299-139721935029568"]
Jul 16 23:29:58.989087 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:58.989063    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7299-139721935029568"]
Jul 16 23:29:59.033428 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:59.033397    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxqjw\" (UniqueName: \"kubernetes.io/projected/f74eee42-7567-4ff4-9643-cacae07bbe60-kube-api-access-mxqjw\") pod \"f74eee42-7567-4ff4-9643-cacae07bbe60\" (UID: \"f74eee42-7567-4ff4-9643-cacae07bbe60\") "
Jul 16 23:29:59.035619 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:59.035596    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f74eee42-7567-4ff4-9643-cacae07bbe60-kube-api-access-mxqjw" (OuterVolumeSpecName: "kube-api-access-mxqjw") pod "f74eee42-7567-4ff4-9643-cacae07bbe60" (UID: "f74eee42-7567-4ff4-9643-cacae07bbe60"). InnerVolumeSpecName "kube-api-access-mxqjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:29:59.134860 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:59.134818    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxqjw\" (UniqueName: \"kubernetes.io/projected/f74eee42-7567-4ff4-9643-cacae07bbe60-kube-api-access-mxqjw\") on node \"ip-10-0-134-116.ec2.internal\" DevicePath \"\""
Jul 16 23:29:59.635497 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:59.635466    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f74eee42-7567-4ff4-9643-cacae07bbe60" path="/var/lib/kubelet/pods/f74eee42-7567-4ff4-9643-cacae07bbe60/volumes"
Jul 16 23:29:59.792698 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:59.792666    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7299-139721935029568"
Jul 16 23:29:59.792876 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:29:59.792671    2558 scope.go:117] "RemoveContainer" containerID="79d2248adf0234ea09865d58e16f68925abde2968f07f3ff4a7df00ac3d00d04"
Jul 16 23:30:59.881584 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:30:59.881544    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9bf489db-8sjm8_d7e41239-1ddf-42fc-887d-ae11f186f1cf/authorino/0.log"
Jul 16 23:31:05.006977 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:05.006939    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7zgcl_c1ba19ce-7c38-403c-a5a3-d3def7490a08/manager/0.log"
Jul 16 23:31:05.128344 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:05.128314    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lsjk8_60ea0656-f57e-4287-9331-a0fad6faf45d/manager/0.log"
Jul 16 23:31:05.252111 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:05.252075    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5575c64b5c-jd6pp_fc17a7e0-44f1-4258-b8e6-6cb222f140dc/manager/0.log"
Jul 16 23:31:05.732138 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:05.732108    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb6b77ff4-572sq_62bb22b3-83fc-49ac-8cd2-44054ec16b21/copy-manifests/0.log"
Jul 16 23:31:05.739345 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:05.739308    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb6b77ff4-572sq_62bb22b3-83fc-49ac-8cd2-44054ec16b21/manager/0.log"
Jul 16 23:31:07.473684 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:07.473658    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zlqsw_23da33df-52f7-4a4d-a3bb-1547c0a1aa49/postgres/0.log"
Jul 16 23:31:08.712848 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:08.712821    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9bf489db-8sjm8_d7e41239-1ddf-42fc-887d-ae11f186f1cf/authorino/0.log"
Jul 16 23:31:08.821886 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:08.821851    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4jmmf_653f9670-3447-4628-906b-98fd30d82a5d/manager/0.log"
Jul 16 23:31:08.933413 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:08.933384    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pv4sk_18665db2-b421-47c1-855f-9ce19d359d49/manager/0.log"
Jul 16 23:31:09.036942 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:09.036867    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-khzcl_be3b5cd9-3d30-4aac-9818-630888aba1d6/kuadrant-console-plugin/0.log"
Jul 16 23:31:09.148997 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:09.148959    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5vxc5_8977d783-9cb1-4631-9199-57e2267adaea/registry-server/0.log"
Jul 16 23:31:09.263551 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:09.263520    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-d29kk_eab251d9-12b5-4a47-9f50-6ddc3cd39391/manager/0.log"
Jul 16 23:31:09.488355 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:09.488322    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-md42z_0d19fcef-84b1-4508-ad25-f9832918a7fa/manager/0.log"
Jul 16 23:31:10.148136 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:10.148106    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b54d476c5-jsj8z_d94bd184-539f-4394-a1c8-f66a0976a56f/kube-auth-proxy/0.log"
Jul 16 23:31:10.500943 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:10.500856    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rwkxd_e2d830b1-4e83-4b8e-96be-d697f999b2c2/payload-processing/0.log"
Jul 16 23:31:10.943592 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:10.943559    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-45k2n_6c4be0fa-b000-4d68-aa76-4be8b808652b/main/0.log"
Jul 16 23:31:11.163294 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:11.163260    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-j98t6_42a7cb9e-5633-4367-a5ce-8783bb04a001/main/0.log"
Jul 16 23:31:11.388270 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:11.388221    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-978pj_37626db3-ed04-4eeb-b9f8-a6ce059007ca/main/0.log"
Jul 16 23:31:19.543256 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:19.543211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m8n25_6a37d336-e886-47b6-a4c0-fe75aa8b94dd/global-pull-secret-syncer/0.log"
Jul 16 23:31:19.642573 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:19.642543    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8xkbd_4a9c38fd-6b6f-4339-88ce-8156cb5206a3/konnectivity-agent/0.log"
Jul 16 23:31:19.700054 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:19.700009    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-116.ec2.internal_c12da327df9dbbcb86dad1e1fb06c721/haproxy/0.log"
Jul 16 23:31:24.986641 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:24.986599    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9bf489db-8sjm8_d7e41239-1ddf-42fc-887d-ae11f186f1cf/authorino/0.log"
Jul 16 23:31:25.018434 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:25.018406    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4jmmf_653f9670-3447-4628-906b-98fd30d82a5d/manager/0.log"
Jul 16 23:31:25.040143 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:25.040120    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pv4sk_18665db2-b421-47c1-855f-9ce19d359d49/manager/0.log"
Jul 16 23:31:25.070121 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:25.070092    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-khzcl_be3b5cd9-3d30-4aac-9818-630888aba1d6/kuadrant-console-plugin/0.log"
Jul 16 23:31:25.130404 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:25.130372    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5vxc5_8977d783-9cb1-4631-9199-57e2267adaea/registry-server/0.log"
Jul 16 23:31:25.283739 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:25.283661    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-d29kk_eab251d9-12b5-4a47-9f50-6ddc3cd39391/manager/0.log"
Jul 16 23:31:25.455441 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:25.455411    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-md42z_0d19fcef-84b1-4508-ad25-f9832918a7fa/manager/0.log"
Jul 16 23:31:26.971541 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:26.971511    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9690a30c-d79f-4abf-816d-8ce549ad2ebe/alertmanager/0.log"
Jul 16 23:31:26.993570 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:26.993540    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9690a30c-d79f-4abf-816d-8ce549ad2ebe/config-reloader/0.log"
Jul 16 23:31:27.023516 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.023493    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9690a30c-d79f-4abf-816d-8ce549ad2ebe/kube-rbac-proxy-web/0.log"
Jul 16 23:31:27.045993 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.045972    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9690a30c-d79f-4abf-816d-8ce549ad2ebe/kube-rbac-proxy/0.log"
Jul 16 23:31:27.066089 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.066060    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9690a30c-d79f-4abf-816d-8ce549ad2ebe/kube-rbac-proxy-metric/0.log"
Jul 16 23:31:27.088397 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.088373    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9690a30c-d79f-4abf-816d-8ce549ad2ebe/prom-label-proxy/0.log"
Jul 16 23:31:27.108021 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.107994    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9690a30c-d79f-4abf-816d-8ce549ad2ebe/init-config-reloader/0.log"
Jul 16 23:31:27.173327 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.173293    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5z5vp_ba6b66be-1449-4915-862d-812ed7816050/kube-state-metrics/0.log"
Jul 16 23:31:27.187801 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.187777    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5z5vp_ba6b66be-1449-4915-862d-812ed7816050/kube-rbac-proxy-main/0.log"
Jul 16 23:31:27.208135 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.208110    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5z5vp_ba6b66be-1449-4915-862d-812ed7816050/kube-rbac-proxy-self/0.log"
Jul 16 23:31:27.238212 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.238154    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69cf5bc5fc-sf9t8_bd29db7b-17e9-4005-9af9-07d7a5449210/metrics-server/0.log"
Jul 16 23:31:27.289043 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.289017    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k29q_f95464aa-919b-47a1-a3f5-37a91faa1643/node-exporter/0.log"
Jul 16 23:31:27.305684 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.305658    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k29q_f95464aa-919b-47a1-a3f5-37a91faa1643/kube-rbac-proxy/0.log"
Jul 16 23:31:27.324201 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.324177    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k29q_f95464aa-919b-47a1-a3f5-37a91faa1643/init-textfile/0.log"
Jul 16 23:31:27.487767 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.487737    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rs6j2_eff28caa-2385-4d5f-baa2-590a0f6dcac2/kube-rbac-proxy-main/0.log"
Jul 16 23:31:27.513062 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.512984    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rs6j2_eff28caa-2385-4d5f-baa2-590a0f6dcac2/kube-rbac-proxy-self/0.log"
Jul 16 23:31:27.532809 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.532785    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rs6j2_eff28caa-2385-4d5f-baa2-590a0f6dcac2/openshift-state-metrics/0.log"
Jul 16 23:31:27.790577 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.790492    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75c7d4df74-stgsr_57ab8d37-4e9c-42d1-9144-e6c20702a9ff/telemeter-client/0.log"
Jul 16 23:31:27.810751 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.810714    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75c7d4df74-stgsr_57ab8d37-4e9c-42d1-9144-e6c20702a9ff/reload/0.log"
Jul 16 23:31:27.830795 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:27.830772    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75c7d4df74-stgsr_57ab8d37-4e9c-42d1-9144-e6c20702a9ff/kube-rbac-proxy/0.log"
Jul 16 23:31:28.742920 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.742890    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"]
Jul 16 23:31:28.743666 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.743633    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f74eee42-7567-4ff4-9643-cacae07bbe60" containerName="test-curl-7299-139721935029568"
Jul 16 23:31:28.743666 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.743657    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f74eee42-7567-4ff4-9643-cacae07bbe60" containerName="test-curl-7299-139721935029568"
Jul 16 23:31:28.743823 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.743767    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f74eee42-7567-4ff4-9643-cacae07bbe60" containerName="test-curl-7299-139721935029568"
Jul 16 23:31:28.746943 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.746928    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.749978 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.749957    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rvb4k\"/\"default-dockercfg-8wz9g\""
Jul 16 23:31:28.750383 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.750366    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rvb4k\"/\"openshift-service-ca.crt\""
Jul 16 23:31:28.751035 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.751016    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rvb4k\"/\"kube-root-ca.crt\""
Jul 16 23:31:28.755958 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.755932    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"]
Jul 16 23:31:28.830391 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.830357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v788\" (UniqueName: \"kubernetes.io/projected/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-kube-api-access-5v788\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.830391 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.830400    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-lib-modules\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.830653 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.830428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-proc\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.830653 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.830451    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-podres\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.830653 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.830506    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-sys\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931552 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v788\" (UniqueName: \"kubernetes.io/projected/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-kube-api-access-5v788\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931552 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931557    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-lib-modules\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931788 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-proc\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931788 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-podres\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931788 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931620    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-sys\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931788 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-proc\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931788 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-podres\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931788 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-sys\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.931788 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.931722    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-lib-modules\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:28.940869 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:28.940845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v788\" (UniqueName: \"kubernetes.io/projected/c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63-kube-api-access-5v788\") pod \"perf-node-gather-daemonset-9x4cq\" (UID: \"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63\") " pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:29.058377 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:29.058295    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:29.164091 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:29.163998    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-wkn9c_b1998c5f-2a47-4838-b991-bbf5bfc41a1f/networking-console-plugin/0.log"
Jul 16 23:31:29.193082 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:29.193056    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"]
Jul 16 23:31:29.195087 ip-10-0-134-116 kubenswrapper[2558]: W0716 23:31:29.195058    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc37c528f_6c44_4bf3_b50d_9dfbdcc5bb63.slice/crio-f04b360075dc6dc71ffaf9eb43aed47327a32cd2f4de6a85c21c88d1160cd149 WatchSource:0}: Error finding container f04b360075dc6dc71ffaf9eb43aed47327a32cd2f4de6a85c21c88d1160cd149: Status 404 returned error can't find the container with id f04b360075dc6dc71ffaf9eb43aed47327a32cd2f4de6a85c21c88d1160cd149
Jul 16 23:31:29.288221 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:29.288184    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq" event={"ID":"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63","Type":"ContainerStarted","Data":"f04b360075dc6dc71ffaf9eb43aed47327a32cd2f4de6a85c21c88d1160cd149"}
Jul 16 23:31:29.787056 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:29.787026    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/2.log"
Jul 16 23:31:29.794640 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:29.794615    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-cgjzx_1d7f8336-8974-4e7c-8f8f-8fb94bdc93a0/console-operator/3.log"
Jul 16 23:31:30.223333 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:30.223300    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-786c7c6899-88mgx_634cef60-1160-47b1-9098-d03f4028a505/console/0.log"
Jul 16 23:31:30.267053 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:30.266989    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-sfthj_f4e8e409-a6d0-4b25-8f23-6ac3da778f5d/download-server/0.log"
Jul 16 23:31:30.294961 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:30.294930    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq" event={"ID":"c37c528f-6c44-4bf3-b50d-9dfbdcc5bb63","Type":"ContainerStarted","Data":"26a2720dc4f8329426ad9287cc73394dc03c8939061187ac1f58f28317b81325"}
Jul 16 23:31:30.295137 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:30.295028    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:30.312739 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:30.312697    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq" podStartSLOduration=2.312682434 podStartE2EDuration="2.312682434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 23:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 23:31:30.311065971 +0000 UTC m=+3471.240076184" watchObservedRunningTime="2026-07-16 23:31:30.312682434 +0000 UTC m=+3471.241692645"
Jul 16 23:31:31.803293 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:31.803223    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7jh5n_5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0/dns/0.log"
Jul 16 23:31:31.824657 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:31.824617    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7jh5n_5e2937b1-f8b2-48c3-adbb-fc680c5a7fb0/kube-rbac-proxy/0.log"
Jul 16 23:31:31.995413 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:31.995379    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrw6w_b5da05d4-9309-40a2-a2ab-43fbb2c63859/dns-node-resolver/0.log"
Jul 16 23:31:32.539942 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:32.539909    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-577478c94f-k25qh_3ab20305-7311-444e-998e-6be83cb25f36/registry/0.log"
Jul 16 23:31:32.573739 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:32.573689    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j4qct_bc7b511c-af30-4554-9347-47544e8bd562/node-ca/0.log"
Jul 16 23:31:33.708207 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:33.708177    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b54d476c5-jsj8z_d94bd184-539f-4394-a1c8-f66a0976a56f/kube-auth-proxy/0.log"
Jul 16 23:31:33.834531 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:33.834499    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rwkxd_e2d830b1-4e83-4b8e-96be-d697f999b2c2/payload-processing/0.log"
Jul 16 23:31:34.530724 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:34.530703    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jkthp_6df31ee4-5386-4a49-b372-97a5955ce5d5/serve-healthcheck-canary/0.log"
Jul 16 23:31:34.992771 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:34.992738    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xwl7q_6ab1b805-ef62-4187-8767-432aaf483b24/insights-operator/0.log"
Jul 16 23:31:34.997078 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:34.997052    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xwl7q_6ab1b805-ef62-4187-8767-432aaf483b24/insights-operator/1.log"
Jul 16 23:31:35.035243 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:35.035215    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c2l2_160d33fa-8dbe-4360-a201-1adce47a7417/kube-rbac-proxy/0.log"
Jul 16 23:31:35.060184 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:35.060162    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c2l2_160d33fa-8dbe-4360-a201-1adce47a7417/exporter/0.log"
Jul 16 23:31:35.086606 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:35.086574    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c2l2_160d33fa-8dbe-4360-a201-1adce47a7417/extractor/0.log"
Jul 16 23:31:36.310707 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:36.310680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rvb4k/perf-node-gather-daemonset-9x4cq"
Jul 16 23:31:37.550004 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:37.549925    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7zgcl_c1ba19ce-7c38-403c-a5a3-d3def7490a08/manager/0.log"
Jul 16 23:31:37.788697 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:37.788669    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lsjk8_60ea0656-f57e-4287-9331-a0fad6faf45d/manager/0.log"
Jul 16 23:31:37.980967 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:37.980934    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5575c64b5c-jd6pp_fc17a7e0-44f1-4258-b8e6-6cb222f140dc/manager/0.log"
Jul 16 23:31:38.236293 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:38.236263    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb6b77ff4-572sq_62bb22b3-83fc-49ac-8cd2-44054ec16b21/manager/0.log"
Jul 16 23:31:38.261757 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:38.261729    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb6b77ff4-572sq_62bb22b3-83fc-49ac-8cd2-44054ec16b21/copy-manifests/0.log"
Jul 16 23:31:38.839466 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:38.839388    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b54d476c5-jsj8z_d94bd184-539f-4394-a1c8-f66a0976a56f/kube-auth-proxy/0.log"
Jul 16 23:31:38.954686 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:38.954660    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rwkxd_e2d830b1-4e83-4b8e-96be-d697f999b2c2/payload-processing/0.log"
Jul 16 23:31:39.626657 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:39.626625    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7tdgj_ddd2beab-b072-41ec-bd2f-cb3c5e25c61a/openshift-lws-operator/0.log"
Jul 16 23:31:40.281061 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:40.281033    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b54d476c5-jsj8z_d94bd184-539f-4394-a1c8-f66a0976a56f/kube-auth-proxy/0.log"
Jul 16 23:31:40.405882 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:40.405785    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rwkxd_e2d830b1-4e83-4b8e-96be-d697f999b2c2/payload-processing/0.log"
Jul 16 23:31:44.935255 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:44.935187    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-r8gbt_e744a60a-81e3-4c27-ad61-53e35a5e9767/kube-storage-version-migrator-operator/1.log"
Jul 16 23:31:44.936864 ip-10-0-134-116 kubenswrapper[2558]: I0716 23:31:44.936836    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-r8gbt_e744a60a-81e3-4c27-ad61-53e35a5e9767/kube-storage-version-migrator-operator/0.log"