May 25 01:00:04.715590 ip-10-0-133-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 25 01:00:04.715606 ip-10-0-133-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 25 01:00:04.715636 ip-10-0-133-121 systemd[1]: kubelet.service: Failed with result 'resources'.
May 25 01:00:04.717035 ip-10-0-133-121 systemd[1]: Failed to start Kubernetes Kubelet.
May 25 01:00:14.846334 ip-10-0-133-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 25 01:00:14.846351 ip-10-0-133-121 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5916dad7f59e4c1caa6229483cfc72a6 --
May 25 01:02:29.439569 ip-10-0-133-121 systemd[1]: Starting Kubernetes Kubelet...
May 25 01:02:29.950814 ip-10-0-133-121 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:29.950814 ip-10-0-133-121 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 01:02:29.950814 ip-10-0-133-121 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:29.950814 ip-10-0-133-121 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 01:02:29.950814 ip-10-0-133-121 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:29.952986 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.952737    2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 01:02:29.955997 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.955981    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:29.955997 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.955998    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956003    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956006    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956009    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956012    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956014    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956017    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956020    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956022    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956025    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956027    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956030    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956032    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956035    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956037    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956040    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956042    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956052    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956055    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956057    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:29.956056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956060    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956063    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956066    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956068    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956071    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956074    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956076    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956079    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956081    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956084    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956086    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956088    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956091    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956094    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956096    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956099    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956101    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956105    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956109    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956113    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:29.956548 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956116    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956118    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956121    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956124    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956126    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956130    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956134    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956137    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956140    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956142    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956145    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956148    2560 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956151    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956153    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956157    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956159    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956162    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956165    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956168    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:29.957081 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956171    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956173    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956176    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956179    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956183    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956186    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956188    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956191    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956194    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956197    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956199    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956202    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956205    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956207    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956210    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956213    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956215    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956218    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956235    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956239    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:29.957559 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956241    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956244    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956247    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956249    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956252    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956255    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956651    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956657    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956660    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956662    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956665    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956668    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956670    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956672    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956675    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956677    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956680    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956682    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956685    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:29.958041 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956688    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956690    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956693    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956695    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956697    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956700    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956702    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956706    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956708    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956711    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956713    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956715    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956718    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956721    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956723    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956725    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956728    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956730    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956733    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956735    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:29.958517 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956739    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956742    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956744    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956747    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956749    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956751    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956754    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956756    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956759    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956761    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956763    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956766    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956770    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956773    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956776    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956778    2560 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956781    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956785    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956788    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:29.959016 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956791    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956794    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956796    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956799    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956801    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956804    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956807    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956810    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956812    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956814    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956817    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956820    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956822    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956825    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956827    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956830    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956832    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956835    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956837    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956840    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:29.959574 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956842    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956844    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956846    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956849    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956851    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956853    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956856    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956858    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956861    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956863    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956866    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956868    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956870    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.956873    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956954    2560 flags.go:64] FLAG: --address="0.0.0.0"
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956962    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956968    2560 flags.go:64] FLAG: --anonymous-auth="true"
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956974    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956978    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956981    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956986    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 01:02:29.960056 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956990    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956993    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.956996    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957000    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957003    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957006    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957009    2560 flags.go:64] FLAG: --cgroup-root=""
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957012    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957014    2560 flags.go:64] FLAG: --client-ca-file=""
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957017    2560 flags.go:64] FLAG: --cloud-config=""
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957020    2560 flags.go:64] FLAG: --cloud-provider="external"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957022    2560 flags.go:64] FLAG: --cluster-dns="[]"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957027    2560 flags.go:64] FLAG: --cluster-domain=""
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957030    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957033    2560 flags.go:64] FLAG: --config-dir=""
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957036    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957039    2560 flags.go:64] FLAG: --container-log-max-files="5"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957043    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957045    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957049    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957052    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957054    2560 flags.go:64] FLAG: --contention-profiling="false"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957057    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957060    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957063    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 01:02:29.960663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957066    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957071    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957074    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957077    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957080    2560 flags.go:64] FLAG: --enable-load-reader="false"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957083    2560 flags.go:64] FLAG: --enable-server="true"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957086    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957090    2560 flags.go:64] FLAG: --event-burst="100"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957093    2560 flags.go:64] FLAG: --event-qps="50"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957096    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957099    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957102    2560 flags.go:64] FLAG: --eviction-hard=""
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957106    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957109    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957112    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957115    2560 flags.go:64] FLAG: --eviction-soft=""
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957118    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957120    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957123    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957126    2560 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957129    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957132    2560 flags.go:64] FLAG: --fail-swap-on="true"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957134    2560 flags.go:64] FLAG: --feature-gates=""
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957138    2560 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957141    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 01:02:29.961290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957144    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957147    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957150    2560 flags.go:64] FLAG: --healthz-port="10248"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957153    2560 flags.go:64] FLAG: --help="false"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957156    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-133-121.ec2.internal"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957159    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957162    2560 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957165    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957168    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957172    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957175    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957178    2560 flags.go:64] FLAG: --image-service-endpoint=""
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957181    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957184    2560 flags.go:64] FLAG: --kube-api-burst="100"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957187    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957190    2560 flags.go:64] FLAG: --kube-api-qps="50"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957193    2560 flags.go:64] FLAG: --kube-reserved=""
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957196    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957199    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957202    2560 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957205    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957207    2560 flags.go:64] FLAG: --lock-file=""
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957210    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957213    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 01:02:29.961940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957216    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957235    2560 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957238    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957241    2560 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957244    2560 flags.go:64] FLAG: --logging-format="text"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957247    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957250    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957253    2560 flags.go:64] FLAG: --manifest-url=""
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957255    2560 flags.go:64] FLAG: --manifest-url-header=""
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957260    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957263    2560 flags.go:64] FLAG: --max-open-files="1000000"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957267    2560 flags.go:64] FLAG: --max-pods="110"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957270    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957273    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957276    2560 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957279    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957282    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957285    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957289    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957295    2560 flags.go:64] FLAG: --node-status-max-images="50"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957298    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957302    2560 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957305    2560 flags.go:64] FLAG: --pod-cidr=""
May 25 01:02:29.962541 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957308    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957314    2560 flags.go:64] FLAG: --pod-manifest-path=""
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957317    2560 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957320    2560 flags.go:64] FLAG: --pods-per-core="0"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957324    2560 flags.go:64] FLAG: --port="10250"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957327    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957330    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a76d7276554e3462"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957333    2560 flags.go:64] FLAG: --qos-reserved=""
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957336    2560 flags.go:64] FLAG: --read-only-port="10255"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957339    2560 flags.go:64] FLAG: --register-node="true"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957342    2560 flags.go:64] FLAG: --register-schedulable="true"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957345    2560 flags.go:64] FLAG: --register-with-taints=""
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957348    2560 flags.go:64] FLAG: --registry-burst="10"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957351    2560 flags.go:64] FLAG: --registry-qps="5"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957354    2560 flags.go:64] FLAG: --reserved-cpus=""
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957356    2560 flags.go:64] FLAG: --reserved-memory=""
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957360    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957363    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957366    2560 flags.go:64] FLAG: --rotate-certificates="false"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957369    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957371    2560 flags.go:64] FLAG: --runonce="false"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957374    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957377    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957380    2560 flags.go:64] FLAG: --seccomp-default="false"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957383    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957385    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 01:02:29.963110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957388    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957391    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957395    2560 flags.go:64] FLAG: --storage-driver-password="root"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957397    2560 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957400    2560 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957406    2560 flags.go:64] FLAG: --storage-driver-user="root"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957409    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957412    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957415    2560 flags.go:64] FLAG: --system-cgroups=""
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957418    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957424    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957427    2560 flags.go:64] FLAG: --tls-cert-file=""
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957430    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957435    2560 flags.go:64] FLAG: --tls-min-version=""
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957438    2560 flags.go:64] FLAG: --tls-private-key-file=""
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957441    2560 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957443    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957446    2560 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957449    2560 flags.go:64] FLAG: --v="2"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957453    2560 flags.go:64] FLAG: --version="false"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957458    2560 flags.go:64] FLAG: --vmodule=""
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957462    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957465    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957557    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:29.963808 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957561    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957564    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957568    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957571    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957574    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957577    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957579    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957582    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957584    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957587    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957590    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957593    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957595    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957599    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957602    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957604    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957607    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957609    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957612    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:29.964404 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957615    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957617    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957621    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957624    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957627    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957630    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957633    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957636    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957638    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957641    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957644    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957646    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957649    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957652    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957654    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957657    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957660    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957662    2560 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957665    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:29.964891 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957669    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957672    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957674    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957677    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957679    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957681    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957684    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957688    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957690    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957692    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957695    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957697    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957700    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957703    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957705    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957707    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957710    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957712    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957715    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957717    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:29.965377 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957720    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957722    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957725    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957727    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957730    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957732    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957734    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957737    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957740    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957742    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957744    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957746    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957749    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957751    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957754    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957756    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957759    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957761    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957765    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957770    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:29.965861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957774    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957826    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957829    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957832    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957835    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957837    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.957840    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.957845    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.964936    2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.964953    2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965001    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965005    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965009    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965012    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965015    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:29.966366 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965017    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965021    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965023    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965026    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965029    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965031    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965034    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965036    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965039    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965042    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965044    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965046    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965049    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965051    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965054    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965056    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965059    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965062    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965064    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965067    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965070    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:29.966777 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965072    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965075    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965077    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965079    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965082    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965085    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965088    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965091    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965093    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965096    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965098    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965101    2560 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965104    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965106    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965108    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965111    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965114    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965117    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965121    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:29.967295 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965126    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965129    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965132    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965135    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965137    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965140    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965143    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965146    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965149    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965152    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965155    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965158    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965160    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965163    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965165    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965167    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965170    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965173    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965175    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965178    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:29.967754 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965180    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965182    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965185    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965187    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965190    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965192    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965195    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965197    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965200    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965202    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965205    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965208    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965212    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965215    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965218    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965237    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965241    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965243    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965246    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965249    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:29.968266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965252    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.965257    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965364    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965368    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965371    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965374    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965376    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965379    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965381    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965384    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965387    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965390    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965393    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965395    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965398    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965400    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:29.968755 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965403    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965405    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965408    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965411    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965413    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965415    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965418    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965420    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965422    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965425    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965427    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965430    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965432    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965434    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965437    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965439    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965442    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965445    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965447    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965450    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:29.969202 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965453    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965455    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965457    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965461    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965465    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965468    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965471    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965474    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965477    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965479    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965482    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965485    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965487    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965490    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965492    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965495    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965497    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965500    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965503    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:29.969698 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965505    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965508    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965511    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965513    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965516    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965518    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965520    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965523    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965525    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965528    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965530    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965533    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965535    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965538    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965541    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965543    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965545    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965548    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965550    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:29.970238 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965553    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965556    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965559    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965561    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965564    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965566    2560 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965569    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965571    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965574    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965576    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965578    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965580    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965583    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:29.965585    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.965590    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:29.970737 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.966485    2560 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 01:02:29.971188 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.968843    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 01:02:29.971188 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.969945    2560 server.go:1019] "Starting client certificate rotation"
May 25 01:02:29.971188 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.970064    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 01:02:29.971188 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:29.970956    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 01:02:30.000662 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.000627    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 01:02:30.003838 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.003780    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 01:02:30.019600 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.019575    2560 log.go:25] "Validated CRI v1 runtime API"
May 25 01:02:30.026234 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.026200    2560 log.go:25] "Validated CRI v1 image API"
May 25 01:02:30.030842 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.030824    2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 01:02:30.033743 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.033149    2560 fs.go:135] Filesystem UUIDs: map[46807df5-22d9-49c4-b25b-ea57b648cbb4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bc7a56bc-756c-43c9-9b0c-17e1b0c52415:/dev/nvme0n1p3]
May 25 01:02:30.033743 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.033739    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 01:02:30.033840 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.033742    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 01:02:30.038037 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.037931    2560 manager.go:217] Machine: {Timestamp:2026-05-25 01:02:30.037461439 +0000 UTC m=+0.465672305 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089491 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2499e4ec70010bdac45a7f49f0b526 SystemUUID:ec2499e4-ec70-010b-dac4-5a7f49f0b526 BootID:5916dad7-f59e-4c1c-aa62-29483cfc72a6 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:84:8c:d7:0f:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:84:8c:d7:0f:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:bc:af:4a:43:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 01:02:30.038037 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.038032    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 01:02:30.038155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.038144    2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 01:02:30.041246 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.041207    2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 01:02:30.041401 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.041249    2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 01:02:30.041444 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.041411    2560 topology_manager.go:138] "Creating topology manager with none policy"
May 25 01:02:30.041444 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.041420    2560 container_manager_linux.go:306] "Creating device plugin manager"
May 25 01:02:30.041444 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.041431    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 01:02:30.042285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.042274    2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 01:02:30.044608 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.044595    2560 state_mem.go:36] "Initialized new in-memory state store"
May 25 01:02:30.044722 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.044713    2560 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 01:02:30.047246 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.047218    2560 kubelet.go:491] "Attempting to sync node with API server"
May 25 01:02:30.047292 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.047253    2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 01:02:30.047323 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.047306    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 01:02:30.047350 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.047332    2560 kubelet.go:397] "Adding apiserver pod source"
May 25 01:02:30.047434 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.047425    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 01:02:30.048700 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.048688    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 01:02:30.048760 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.048706    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 01:02:30.052206 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.052188    2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 01:02:30.054504 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.054488    2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 01:02:30.055266 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055249    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-km6sl"
May 25 01:02:30.055431 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055420    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 01:02:30.055479 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055439    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 01:02:30.055479 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055445    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 01:02:30.055479 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055451    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 01:02:30.055479 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055460    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 01:02:30.055479 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055467    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 01:02:30.055479 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055472    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 01:02:30.055479 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055477    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 01:02:30.055670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055484    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 01:02:30.055670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055489    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 01:02:30.055670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055506    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 01:02:30.055899 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055890    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 01:02:30.055928 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055918    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 01:02:30.055928 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.055924    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 01:02:30.061318 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.060937    2560 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 01:02:30.061417 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.061350    2560 server.go:1295] "Started kubelet"
May 25 01:02:30.061783 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.061754    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 01:02:30.062006 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.061968    2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 01:02:30.062073 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.062035    2560 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 01:02:30.062087 ip-10-0-133-121 systemd[1]: Started Kubernetes Kubelet.
May 25 01:02:30.063450 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.063427    2560 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 01:02:30.063696 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.063670    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-km6sl"
May 25 01:02:30.063811 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.063717    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 01:02:30.063811 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.063792    2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 01:02:30.063918 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.063831    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 01:02:30.065761 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.065741    2560 server.go:317] "Adding debug handlers to kubelet server"
May 25 01:02:30.071304 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.069987    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-121.ec2.internal.18b2a94ccb7c9908  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-121.ec2.internal,UID:ip-10-0-133-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-121.ec2.internal,},FirstTimestamp:2026-05-25 01:02:30.06131636 +0000 UTC m=+0.489527229,LastTimestamp:2026-05-25 01:02:30.06131636 +0000 UTC m=+0.489527229,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-121.ec2.internal,}"
May 25 01:02:30.073159 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.073140    2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 01:02:30.077653 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.077627    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 01:02:30.078196 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.078184    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 01:02:30.078326 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.078310    2560 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 01:02:30.078397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.078345    2560 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 01:02:30.078667 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.078455    2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 01:02:30.078667 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.078542    2560 reconstruct.go:97] "Volume reconstruction finished"
May 25 01:02:30.078667 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.078550    2560 reconciler.go:26] "Reconciler: start to sync state"
May 25 01:02:30.079166 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.079147    2560 factory.go:55] Registering systemd factory
May 25 01:02:30.079321 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.079294    2560 factory.go:223] Registration of the systemd container factory successfully
May 25 01:02:30.079422 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.079215    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.079833 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.079817    2560 factory.go:153] Registering CRI-O factory
May 25 01:02:30.079833 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.079835    2560 factory.go:223] Registration of the crio container factory successfully
May 25 01:02:30.079966 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.079882    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 01:02:30.079966 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.079899    2560 factory.go:103] Registering Raw factory
May 25 01:02:30.079966 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.079912    2560 manager.go:1196] Started watching for new ooms in manager
May 25 01:02:30.080434 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.080361    2560 manager.go:319] Starting recovery of all containers
May 25 01:02:30.088003 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.087977    2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:30.088516 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.088500    2560 manager.go:324] Recovery completed
May 25 01:02:30.090424 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.090401    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-121.ec2.internal\" not found" node="ip-10-0-133-121.ec2.internal"
May 25 01:02:30.092495 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.092482    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:30.094741 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.094725    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:30.094816 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.094758    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:30.094816 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.094774    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:30.095260 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.095248    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 01:02:30.095334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.095260    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 01:02:30.095334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.095278    2560 state_mem.go:36] "Initialized new in-memory state store"
May 25 01:02:30.099126 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.099111    2560 policy_none.go:49] "None policy: Start"
May 25 01:02:30.099204 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.099131    2560 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 01:02:30.099204 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.099144    2560 state_mem.go:35] "Initializing new in-memory state store"
May 25 01:02:30.134515 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.134496    2560 manager.go:341] "Starting Device Plugin manager"
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.134557    2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.134571    2560 server.go:85] "Starting device plugin registration server"
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.134815    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.134830    2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.135401    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.135476    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.135484    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.137510    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 01:02:30.164890 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.137584    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.176343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.176306    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 01:02:30.177676 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.177661    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 01:02:30.177741 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.177691    2560 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 01:02:30.177741 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.177711    2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 01:02:30.177741 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.177718    2560 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 01:02:30.177854 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.177838    2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 01:02:30.180025 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.180007    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:30.235958 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.235872    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:30.236857 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.236842    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:30.236943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.236872    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:30.236943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.236883    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:30.236943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.236908    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-121.ec2.internal"
May 25 01:02:30.245190 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.245171    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-121.ec2.internal"
May 25 01:02:30.245267 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.245203    2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-121.ec2.internal\": node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.271429 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.271400    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.278820 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.278797    2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"]
May 25 01:02:30.278879 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.278869    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:30.280805 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.280788    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:30.280897 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.280818    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:30.280897 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.280829    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:30.282996 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.282984    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:30.283163 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.283147    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.283212 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.283180    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:30.283717 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.283702    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:30.283787 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.283701    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:30.283787 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.283755    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:30.283787 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.283766    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:30.283787 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.283732    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:30.283963 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.283810    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:30.285899 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.285884    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.285982 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.285913    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:30.286571 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.286558    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:30.286662 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.286585    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:30.286662 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.286599    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:30.301831 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.301808    2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-121.ec2.internal\" not found" node="ip-10-0-133-121.ec2.internal"
May 25 01:02:30.305218 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.305202    2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-121.ec2.internal\" not found" node="ip-10-0-133-121.ec2.internal"
May 25 01:02:30.371608 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.371583    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.379890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.379866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d986f338e87082082316af92d6d409a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"d986f338e87082082316af92d6d409a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.379974 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.379895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d986f338e87082082316af92d6d409a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"d986f338e87082082316af92d6d409a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.379974 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.379916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6115103e00adc9377ba1c7fc9b87c19-config\") pod \"kube-apiserver-proxy-ip-10-0-133-121.ec2.internal\" (UID: \"f6115103e00adc9377ba1c7fc9b87c19\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.472331 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.472302    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.480613 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.480586    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d986f338e87082082316af92d6d409a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"d986f338e87082082316af92d6d409a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.480718 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.480624    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d986f338e87082082316af92d6d409a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"d986f338e87082082316af92d6d409a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.480718 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.480648    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6115103e00adc9377ba1c7fc9b87c19-config\") pod \"kube-apiserver-proxy-ip-10-0-133-121.ec2.internal\" (UID: \"f6115103e00adc9377ba1c7fc9b87c19\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.480718 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.480703    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d986f338e87082082316af92d6d409a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"d986f338e87082082316af92d6d409a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.480825 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.480708    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6115103e00adc9377ba1c7fc9b87c19-config\") pod \"kube-apiserver-proxy-ip-10-0-133-121.ec2.internal\" (UID: \"f6115103e00adc9377ba1c7fc9b87c19\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.480825 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.480710    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d986f338e87082082316af92d6d409a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"d986f338e87082082316af92d6d409a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.573048 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.572971    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.604440 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.604410    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.607454 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.607210    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
May 25 01:02:30.674071 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.674031    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.774573 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.774539    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.875122 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.875035    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:30.969613 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.969563    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 01:02:30.970351 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.969769    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 01:02:30.970351 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:30.969786    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 01:02:30.975709 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:30.975689    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:31.066550 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.066350    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 00:57:30 +0000 UTC" deadline="2028-02-06 18:44:16.995016952 +0000 UTC"
May 25 01:02:31.066550 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.066541    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14945h41m45.928480905s"
May 25 01:02:31.076308 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:31.076282    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
May 25 01:02:31.078437 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.078419    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 01:02:31.091108 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.091088    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 01:02:31.112594 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.112571    2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:31.121132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.121111    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dwzxs"
May 25 01:02:31.130352 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.130334    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dwzxs"
May 25 01:02:31.138577 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:31.138553    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd986f338e87082082316af92d6d409a2.slice/crio-94fcc8d8efe8735bfcdf456dba04d030dad53e51e0e28a7f7073580cb559ab29 WatchSource:0}: Error finding container 94fcc8d8efe8735bfcdf456dba04d030dad53e51e0e28a7f7073580cb559ab29: Status 404 returned error can't find the container with id 94fcc8d8efe8735bfcdf456dba04d030dad53e51e0e28a7f7073580cb559ab29
May 25 01:02:31.138789 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:31.138769    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6115103e00adc9377ba1c7fc9b87c19.slice/crio-f46d93cb35703a0bb9fd86cb891500cebd98afe4d7ef6222bff0e16beae201da WatchSource:0}: Error finding container f46d93cb35703a0bb9fd86cb891500cebd98afe4d7ef6222bff0e16beae201da: Status 404 returned error can't find the container with id f46d93cb35703a0bb9fd86cb891500cebd98afe4d7ef6222bff0e16beae201da
May 25 01:02:31.143766 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.143751    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:02:31.178677 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.178643    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
May 25 01:02:31.180471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.180423    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal" event={"ID":"f6115103e00adc9377ba1c7fc9b87c19","Type":"ContainerStarted","Data":"f46d93cb35703a0bb9fd86cb891500cebd98afe4d7ef6222bff0e16beae201da"}
May 25 01:02:31.181422 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.181400    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal" event={"ID":"d986f338e87082082316af92d6d409a2","Type":"ContainerStarted","Data":"94fcc8d8efe8735bfcdf456dba04d030dad53e51e0e28a7f7073580cb559ab29"}
May 25 01:02:31.190075 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.190057    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 01:02:31.192311 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.192296    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
May 25 01:02:31.199974 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.199949    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 01:02:31.357003 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:31.356974    2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:32.012109 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.012077    2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:32.049447 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.049415    2560 apiserver.go:52] "Watching apiserver"
May 25 01:02:32.058325 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.058294    2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 01:02:32.059217 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.059172    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-555h7","openshift-ovn-kubernetes/ovnkube-node-rj8vk","kube-system/konnectivity-agent-gv5pb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd","openshift-cluster-node-tuning-operator/tuned-k2867","openshift-dns/node-resolver-h4b6q","openshift-image-registry/node-ca-hfxhs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-xqpcz","openshift-multus/network-metrics-daemon-zzn6w","kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal","openshift-multus/multus-5rg4l","openshift-network-diagnostics/network-check-target-54ns5"]
May 25 01:02:32.061743 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.061718    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.064208 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.063953    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.064478 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.064458    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 01:02:32.064546 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.064491    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 01:02:32.064546 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.064490    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 01:02:32.064546 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.064519    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g8bhk\""
May 25 01:02:32.067066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.066139    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:32.067066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.066417    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 01:02:32.067066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.066599    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 01:02:32.067066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.066628    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 01:02:32.067066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.066674    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rgczj\""
May 25 01:02:32.067066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.066789    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 01:02:32.067066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.066848    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 01:02:32.067066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.066936    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 01:02:32.068039 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.068020    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 01:02:32.068475 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.068456    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.068562 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.068533    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hq8pn\""
May 25 01:02:32.068601 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.068589    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 01:02:32.071132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.071113    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 01:02:32.071236 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.071116    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 01:02:32.071236 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.071161    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fq9zz\""
May 25 01:02:32.071345 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.071270    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 01:02:32.071756 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.071736    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.074213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.073950    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p9kr2\""
May 25 01:02:32.074213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.073982    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 01:02:32.074213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.074032    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 01:02:32.074213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.074207    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.076564 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.076549    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 01:02:32.076564 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.076558    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.076715 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.076562    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q58qf\""
May 25 01:02:32.077060 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.077043    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 01:02:32.079517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.078936    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 01:02:32.079517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.079325    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 01:02:32.079517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.079499    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t8xcl\""
May 25 01:02:32.080016 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.079995    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 01:02:32.081599 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.081582    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.083286 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.083266    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:32.083627 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.083591    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:32.084448 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.084431    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6wtc8\""
May 25 01:02:32.084818 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.084803    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 01:02:32.085061 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.085029    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 01:02:32.085207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.085191    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 01:02:32.085305 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.085288    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 01:02:32.085417 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.085399    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 01:02:32.086689 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.086666    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.088586 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-ovnkube-config\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.088714 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d09b4f-ddbf-4925-85a8-bc1245a28498-tmp-dir\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.088714 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-cnibin\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.088714 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91718d6a-07eb-4323-9fe6-2bf204f74f71-serviceca\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.088714 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088692    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-cni-bin\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.088932 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-ovnkube-script-lib\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.088932 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088756    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 01:02:32.088932 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088794    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wv4d5\""
May 25 01:02:32.088932 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-lib-modules\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.088932 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d7fd507-915d-4a3d-bc76-194cd9fc23de-host-slash\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.088932 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-kubelet\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.088932 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-log-socket\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.088932 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088929    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:32.089214 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.088990    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:32.089214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.088930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.089214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqvmk\" (UniqueName: \"kubernetes.io/projected/91718d6a-07eb-4323-9fe6-2bf204f74f71-kube-api-access-vqvmk\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.089214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-tuned\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.089214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.089214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-etc-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.089214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-ovn\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.089214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpjq\" (UniqueName: \"kubernetes.io/projected/60d09b4f-ddbf-4925-85a8-bc1245a28498-kube-api-access-xgpjq\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d7fd507-915d-4a3d-bc76-194cd9fc23de-iptables-alerter-script\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mp2q\" (UniqueName: \"kubernetes.io/projected/eb55b0df-405e-4c3b-8e91-198a33549969-kube-api-access-9mp2q\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ae3a468-ebf5-441a-a232-e654bcb9c52d-agent-certs\") pod \"konnectivity-agent-gv5pb\" (UID: \"8ae3a468-ebf5-441a-a232-e654bcb9c52d\") " pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a297fdb-ed9d-4dd5-963e-bd236316f375-tmp\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-os-release\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-device-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-run-netns\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcjdc\" (UniqueName: \"kubernetes.io/projected/5a8f190b-958a-439f-81c7-eb51e8e04200-kube-api-access-vcjdc\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysctl-d\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.089511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysctl-conf\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmrnt\" (UniqueName: \"kubernetes.io/projected/5d7fd507-915d-4a3d-bc76-194cd9fc23de-kube-api-access-bmrnt\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4xlr\" (UniqueName: \"kubernetes.io/projected/7db0113a-b72b-4615-8730-adcd86864765-kube-api-access-h4xlr\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60d09b4f-ddbf-4925-85a8-bc1245a28498-hosts-file\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-system-cni-dir\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-systemd\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-sys\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-registration-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-cni-netd\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-modprobe-d\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-var-lib-kubelet\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.089943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-socket-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.089968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-systemd\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-var-lib-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-host\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-node-log\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-run\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-slash\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-env-overrides\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g68g6\" (UniqueName: \"kubernetes.io/projected/0a297fdb-ed9d-4dd5-963e-bd236316f375-kube-api-access-g68g6\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ae3a468-ebf5-441a-a232-e654bcb9c52d-konnectivity-ca\") pod \"konnectivity-agent-gv5pb\" (UID: \"8ae3a468-ebf5-441a-a232-e654bcb9c52d\") " pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8f190b-958a-439f-81c7-eb51e8e04200-ovn-node-metrics-cert\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-kubernetes\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91718d6a-07eb-4323-9fe6-2bf204f74f71-host\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.090561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-systemd-units\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.091149 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysconfig\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.091149 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.091149 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.090454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-sys-fs\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.120529 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.120507    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:32.132148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.132107    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:31 +0000 UTC" deadline="2028-01-14 15:14:56.721714124 +0000 UTC"
May 25 01:02:32.132148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.132134    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14390h12m24.589583669s"
May 25 01:02:32.179604 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.179577    2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 01:02:32.190690 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190660    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91718d6a-07eb-4323-9fe6-2bf204f74f71-host\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.190690 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190690    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-systemd-units\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190706    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysconfig\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190721    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190738    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-sys-fs\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-cni-bin\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190772    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-ovnkube-config\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190774    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91718d6a-07eb-4323-9fe6-2bf204f74f71-host\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190783    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-systemd-units\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190796    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d09b4f-ddbf-4925-85a8-bc1245a28498-tmp-dir\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190796    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysconfig\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190835    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-sys-fs\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.190885 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190857    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-cnibin\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190928    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91718d6a-07eb-4323-9fe6-2bf204f74f71-serviceca\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190963    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-cni-bin\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.190932    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-cnibin\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191008    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-cni-bin\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191029    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-ovnkube-script-lib\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191055    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-lib-modules\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191084    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d7fd507-915d-4a3d-bc76-194cd9fc23de-host-slash\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-cnibin\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191140    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-kubelet\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191165    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-log-socket\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191181    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-socket-dir-parent\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-netns\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-kubelet\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-daemon-config\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.191471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191287    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvmk\" (UniqueName: \"kubernetes.io/projected/91718d6a-07eb-4323-9fe6-2bf204f74f71-kube-api-access-vqvmk\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191301    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-tuned\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191326    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91718d6a-07eb-4323-9fe6-2bf204f74f71-serviceca\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191409    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191429    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-ovnkube-config\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-conf-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191468    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-etc-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191467    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191490    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191509    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-ovn\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191546    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191579    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpjq\" (UniqueName: \"kubernetes.io/projected/60d09b4f-ddbf-4925-85a8-bc1245a28498-kube-api-access-xgpjq\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191609    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d7fd507-915d-4a3d-bc76-194cd9fc23de-iptables-alerter-script\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191607    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d7fd507-915d-4a3d-bc76-194cd9fc23de-host-slash\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191666    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-lib-modules\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191699    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mp2q\" (UniqueName: \"kubernetes.io/projected/eb55b0df-405e-4c3b-8e91-198a33549969-kube-api-access-9mp2q\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191704    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-kubelet\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.192291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191745    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ae3a468-ebf5-441a-a232-e654bcb9c52d-agent-certs\") pod \"konnectivity-agent-gv5pb\" (UID: \"8ae3a468-ebf5-441a-a232-e654bcb9c52d\") " pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191766    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d09b4f-ddbf-4925-85a8-bc1245a28498-tmp-dir\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191777    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a297fdb-ed9d-4dd5-963e-bd236316f375-tmp\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191750    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191812    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-os-release\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191844    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-device-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191868    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-hostroot\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191949    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-run-netns\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191984    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcjdc\" (UniqueName: \"kubernetes.io/projected/5a8f190b-958a-439f-81c7-eb51e8e04200-kube-api-access-vcjdc\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192009    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysctl-d\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192010    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-etc-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.191813    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-log-socket\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192059    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192068    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysctl-conf\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192095    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmrnt\" (UniqueName: \"kubernetes.io/projected/5d7fd507-915d-4a3d-bc76-194cd9fc23de-kube-api-access-bmrnt\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192116    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4xlr\" (UniqueName: \"kubernetes.io/projected/7db0113a-b72b-4615-8730-adcd86864765-kube-api-access-h4xlr\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.193183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192136    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-os-release\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-os-release\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192162    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysctl-d\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192197    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60d09b4f-ddbf-4925-85a8-bc1245a28498-hosts-file\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192205    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-device-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192245    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-system-cni-dir\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192263    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-ovn\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-cni-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-k8s-cni-cncf-io\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192308    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-run-netns\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-cni-multus\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192403    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d7fd507-915d-4a3d-bc76-194cd9fc23de-iptables-alerter-script\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192461    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-system-cni-dir\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192532    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60d09b4f-ddbf-4925-85a8-bc1245a28498-hosts-file\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192564    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-sysctl-conf\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192582    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-systemd\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192662    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.193936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192694    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-systemd\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192798    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcdhh\" (UniqueName: \"kubernetes.io/projected/c68b976f-c760-446d-a601-1d72941a0429-kube-api-access-mcdhh\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192851    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192868    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-sys\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192895    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-registration-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192951    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-registration-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.192968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-system-cni-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193007    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-sys\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-multus-certs\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mct48\" (UniqueName: \"kubernetes.io/projected/eef5509c-b268-45c9-a47b-7bfdfd3532e7-kube-api-access-mct48\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193135    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-cni-netd\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193165    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-modprobe-d\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193189    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-var-lib-kubelet\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193214    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-socket-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193277    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-systemd\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.194751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193275    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-ovnkube-script-lib\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193304    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-var-lib-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193328    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-host\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193359    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193386    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-socket-dir\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193385    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-node-log\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193411    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb55b0df-405e-4c3b-8e91-198a33549969-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193433    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-run\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193440    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-systemd\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eef5509c-b268-45c9-a47b-7bfdfd3532e7-cni-binary-copy\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193483    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-slash\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193508    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-env-overrides\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193539    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g68g6\" (UniqueName: \"kubernetes.io/projected/0a297fdb-ed9d-4dd5-963e-bd236316f375-kube-api-access-g68g6\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193544    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-modprobe-d\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193568    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-slash\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193584    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193610    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ae3a468-ebf5-441a-a232-e654bcb9c52d-konnectivity-ca\") pod \"konnectivity-agent-gv5pb\" (UID: \"8ae3a468-ebf5-441a-a232-e654bcb9c52d\") " pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:32.195490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193669    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-node-log\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193676    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-var-lib-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193700    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193726    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8f190b-958a-439f-81c7-eb51e8e04200-ovn-node-metrics-cert\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193739    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-run\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193776    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-kubernetes\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-etc-kubernetes\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193810    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-var-lib-kubelet\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193776    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-host-cni-netd\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193846    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-host\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193926    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7db0113a-b72b-4615-8730-adcd86864765-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193961    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a8f190b-958a-439f-81c7-eb51e8e04200-run-openvswitch\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193984    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a8f190b-958a-439f-81c7-eb51e8e04200-env-overrides\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.193972    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb55b0df-405e-4c3b-8e91-198a33549969-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.194042    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-kubernetes\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.194881    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ae3a468-ebf5-441a-a232-e654bcb9c52d-konnectivity-ca\") pod \"konnectivity-agent-gv5pb\" (UID: \"8ae3a468-ebf5-441a-a232-e654bcb9c52d\") " pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.195572    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a297fdb-ed9d-4dd5-963e-bd236316f375-tmp\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.196310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.195780    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ae3a468-ebf5-441a-a232-e654bcb9c52d-agent-certs\") pod \"konnectivity-agent-gv5pb\" (UID: \"8ae3a468-ebf5-441a-a232-e654bcb9c52d\") " pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:32.196871 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.196330    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a8f190b-958a-439f-81c7-eb51e8e04200-ovn-node-metrics-cert\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.196871 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.196369    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a297fdb-ed9d-4dd5-963e-bd236316f375-etc-tuned\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.201748 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.201728    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mp2q\" (UniqueName: \"kubernetes.io/projected/eb55b0df-405e-4c3b-8e91-198a33549969-kube-api-access-9mp2q\") pod \"multus-additional-cni-plugins-xqpcz\" (UID: \"eb55b0df-405e-4c3b-8e91-198a33549969\") " pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.201849 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.201772    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqvmk\" (UniqueName: \"kubernetes.io/projected/91718d6a-07eb-4323-9fe6-2bf204f74f71-kube-api-access-vqvmk\") pod \"node-ca-hfxhs\" (UID: \"91718d6a-07eb-4323-9fe6-2bf204f74f71\") " pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.202245 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.202182    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcjdc\" (UniqueName: \"kubernetes.io/projected/5a8f190b-958a-439f-81c7-eb51e8e04200-kube-api-access-vcjdc\") pod \"ovnkube-node-rj8vk\" (UID: \"5a8f190b-958a-439f-81c7-eb51e8e04200\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.202340 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.202262    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpjq\" (UniqueName: \"kubernetes.io/projected/60d09b4f-ddbf-4925-85a8-bc1245a28498-kube-api-access-xgpjq\") pod \"node-resolver-h4b6q\" (UID: \"60d09b4f-ddbf-4925-85a8-bc1245a28498\") " pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.202429 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.202409    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4xlr\" (UniqueName: \"kubernetes.io/projected/7db0113a-b72b-4615-8730-adcd86864765-kube-api-access-h4xlr\") pod \"aws-ebs-csi-driver-node-g6pdd\" (UID: \"7db0113a-b72b-4615-8730-adcd86864765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.203039 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.203011    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmrnt\" (UniqueName: \"kubernetes.io/projected/5d7fd507-915d-4a3d-bc76-194cd9fc23de-kube-api-access-bmrnt\") pod \"iptables-alerter-555h7\" (UID: \"5d7fd507-915d-4a3d-bc76-194cd9fc23de\") " pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.204054 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.204038    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g68g6\" (UniqueName: \"kubernetes.io/projected/0a297fdb-ed9d-4dd5-963e-bd236316f375-kube-api-access-g68g6\") pod \"tuned-k2867\" (UID: \"0a297fdb-ed9d-4dd5-963e-bd236316f375\") " pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.294849 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.294761    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcdhh\" (UniqueName: \"kubernetes.io/projected/c68b976f-c760-446d-a601-1d72941a0429-kube-api-access-mcdhh\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:32.294849 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.294804    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:32.294849 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.294837    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-system-cni-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.294860    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-multus-certs\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.294883    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mct48\" (UniqueName: \"kubernetes.io/projected/eef5509c-b268-45c9-a47b-7bfdfd3532e7-kube-api-access-mct48\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.294938    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eef5509c-b268-45c9-a47b-7bfdfd3532e7-cni-binary-copy\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.294973    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-etc-kubernetes\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295000    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-cni-bin\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295036    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-cnibin\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295060    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:32.295101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295096    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-socket-dir-parent\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295123    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-netns\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295150    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-kubelet\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295175    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-daemon-config\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295204    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-conf-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295261    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-hostroot\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.295269    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295293    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-os-release\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295346    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-cni-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295359    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-socket-dir-parent\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295385    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-k8s-cni-cncf-io\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295412    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-cni-multus\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295424    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-cnibin\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295485    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-cni-multus\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295551    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-conf-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295565    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-system-cni-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295595    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-hostroot\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295604    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-multus-certs\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295619    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-kubelet\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295647    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-var-lib-cni-bin\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295659    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-etc-kubernetes\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295671    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-cni-dir\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295660    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-k8s-cni-cncf-io\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.295695    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:32.795652291 +0000 UTC m=+3.223863147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295708    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-os-release\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.295946 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.295693    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef5509c-b268-45c9-a47b-7bfdfd3532e7-host-run-netns\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.296502 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.296404    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eef5509c-b268-45c9-a47b-7bfdfd3532e7-multus-daemon-config\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.296502 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.296450    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eef5509c-b268-45c9-a47b-7bfdfd3532e7-cni-binary-copy\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.301532 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.301509    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:32.301532 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.301533    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:32.301749 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.301548    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2rc9 for pod openshift-network-diagnostics/network-check-target-54ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:32.301749 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.301614    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9 podName:a5763d3e-5a22-48fe-b280-9f442934aa78 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:32.801595937 +0000 UTC m=+3.229806801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g2rc9" (UniqueName: "kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9") pod "network-check-target-54ns5" (UID: "a5763d3e-5a22-48fe-b280-9f442934aa78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:32.304141 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.304111    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcdhh\" (UniqueName: \"kubernetes.io/projected/c68b976f-c760-446d-a601-1d72941a0429-kube-api-access-mcdhh\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:32.304262 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.304164    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mct48\" (UniqueName: \"kubernetes.io/projected/eef5509c-b268-45c9-a47b-7bfdfd3532e7-kube-api-access-mct48\") pod \"multus-5rg4l\" (UID: \"eef5509c-b268-45c9-a47b-7bfdfd3532e7\") " pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.373701 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.373654    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hfxhs"
May 25 01:02:32.380555 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.380523    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:32.391205 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.391178    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:32.396918 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.396895    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd"
May 25 01:02:32.403046 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.403019    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k2867"
May 25 01:02:32.408799 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.408770    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4b6q"
May 25 01:02:32.416463 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.416436    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-555h7"
May 25 01:02:32.424154 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.424130    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqpcz"
May 25 01:02:32.430858 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.430829    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5rg4l"
May 25 01:02:32.742625 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:32.742593    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb55b0df_405e_4c3b_8e91_198a33549969.slice/crio-f4dd670356e43ec96a65f3738ff48258e7d1824951799cf893dab5bd1906e4e4 WatchSource:0}: Error finding container f4dd670356e43ec96a65f3738ff48258e7d1824951799cf893dab5bd1906e4e4: Status 404 returned error can't find the container with id f4dd670356e43ec96a65f3738ff48258e7d1824951799cf893dab5bd1906e4e4
May 25 01:02:32.743656 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:32.743634    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae3a468_ebf5_441a_a232_e654bcb9c52d.slice/crio-46a07df4656aacafb6866f1a12648b06f889410069926b141bf25c776867642e WatchSource:0}: Error finding container 46a07df4656aacafb6866f1a12648b06f889410069926b141bf25c776867642e: Status 404 returned error can't find the container with id 46a07df4656aacafb6866f1a12648b06f889410069926b141bf25c776867642e
May 25 01:02:32.744648 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:32.744623    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7fd507_915d_4a3d_bc76_194cd9fc23de.slice/crio-8f13d2c2618484ae4934676906d6265277cbbb56ddd1be74aecab765e3efcab8 WatchSource:0}: Error finding container 8f13d2c2618484ae4934676906d6265277cbbb56ddd1be74aecab765e3efcab8: Status 404 returned error can't find the container with id 8f13d2c2618484ae4934676906d6265277cbbb56ddd1be74aecab765e3efcab8
May 25 01:02:32.746443 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:32.745826    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a297fdb_ed9d_4dd5_963e_bd236316f375.slice/crio-0fd2abbe18e157cdb91aad9b3e9fd7c6ca808aafcb33cbcc63ab242b53f4847b WatchSource:0}: Error finding container 0fd2abbe18e157cdb91aad9b3e9fd7c6ca808aafcb33cbcc63ab242b53f4847b: Status 404 returned error can't find the container with id 0fd2abbe18e157cdb91aad9b3e9fd7c6ca808aafcb33cbcc63ab242b53f4847b
May 25 01:02:32.746713 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:32.746660    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef5509c_b268_45c9_a47b_7bfdfd3532e7.slice/crio-9450bfae703194f63c8f14bc396ec152595a8fc28111dddf63d6c4178acea442 WatchSource:0}: Error finding container 9450bfae703194f63c8f14bc396ec152595a8fc28111dddf63d6c4178acea442: Status 404 returned error can't find the container with id 9450bfae703194f63c8f14bc396ec152595a8fc28111dddf63d6c4178acea442
May 25 01:02:32.752125 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:32.752074    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db0113a_b72b_4615_8730_adcd86864765.slice/crio-d555162b66d41956414d1684c9fc7dddb4d92c74d5aeee5be2bd80c02f1a4088 WatchSource:0}: Error finding container d555162b66d41956414d1684c9fc7dddb4d92c74d5aeee5be2bd80c02f1a4088: Status 404 returned error can't find the container with id d555162b66d41956414d1684c9fc7dddb4d92c74d5aeee5be2bd80c02f1a4088
May 25 01:02:32.752960 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:32.752931    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d09b4f_ddbf_4925_85a8_bc1245a28498.slice/crio-89b519c24681ec480caacdc616f0b66aee8c309b77eeb510d85e8b301b727066 WatchSource:0}: Error finding container 89b519c24681ec480caacdc616f0b66aee8c309b77eeb510d85e8b301b727066: Status 404 returned error can't find the container with id 89b519c24681ec480caacdc616f0b66aee8c309b77eeb510d85e8b301b727066
May 25 01:02:32.753974 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:02:32.753953    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8f190b_958a_439f_81c7_eb51e8e04200.slice/crio-60871ac68b10e8b8e47c3476bef6e08b769ea042377a8c217796ab3f276b0912 WatchSource:0}: Error finding container 60871ac68b10e8b8e47c3476bef6e08b769ea042377a8c217796ab3f276b0912: Status 404 returned error can't find the container with id 60871ac68b10e8b8e47c3476bef6e08b769ea042377a8c217796ab3f276b0912
May 25 01:02:32.799341 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.799314    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:32.799475 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.799455    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:32.799530 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.799519    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:33.799504735 +0000 UTC m=+4.227715586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:32.900553 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:32.900500    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:32.900730 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.900656    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:32.900730 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.900680    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:32.900730 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.900693    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2rc9 for pod openshift-network-diagnostics/network-check-target-54ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:32.900895 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:32.900766    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9 podName:a5763d3e-5a22-48fe-b280-9f442934aa78 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:33.900749413 +0000 UTC m=+4.328960265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2rc9" (UniqueName: "kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9") pod "network-check-target-54ns5" (UID: "a5763d3e-5a22-48fe-b280-9f442934aa78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:33.133327 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.133277    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:31 +0000 UTC" deadline="2027-11-13 13:31:38.103372467 +0000 UTC"
May 25 01:02:33.133327 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.133318    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12900h29m4.970058563s"
May 25 01:02:33.193098 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.193053    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"60871ac68b10e8b8e47c3476bef6e08b769ea042377a8c217796ab3f276b0912"}
May 25 01:02:33.218924 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.218859    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4b6q" event={"ID":"60d09b4f-ddbf-4925-85a8-bc1245a28498","Type":"ContainerStarted","Data":"89b519c24681ec480caacdc616f0b66aee8c309b77eeb510d85e8b301b727066"}
May 25 01:02:33.223254 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.222553    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd" event={"ID":"7db0113a-b72b-4615-8730-adcd86864765","Type":"ContainerStarted","Data":"d555162b66d41956414d1684c9fc7dddb4d92c74d5aeee5be2bd80c02f1a4088"}
May 25 01:02:33.227472 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.227373    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hfxhs" event={"ID":"91718d6a-07eb-4323-9fe6-2bf204f74f71","Type":"ContainerStarted","Data":"d0d9e47582526c687f9354213356273b0a17d238d6747abe8559015c12e6e8a5"}
May 25 01:02:33.233268 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.233148    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-555h7" event={"ID":"5d7fd507-915d-4a3d-bc76-194cd9fc23de","Type":"ContainerStarted","Data":"8f13d2c2618484ae4934676906d6265277cbbb56ddd1be74aecab765e3efcab8"}
May 25 01:02:33.236592 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.236531    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gv5pb" event={"ID":"8ae3a468-ebf5-441a-a232-e654bcb9c52d","Type":"ContainerStarted","Data":"46a07df4656aacafb6866f1a12648b06f889410069926b141bf25c776867642e"}
May 25 01:02:33.264177 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.264122    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" event={"ID":"eb55b0df-405e-4c3b-8e91-198a33549969","Type":"ContainerStarted","Data":"f4dd670356e43ec96a65f3738ff48258e7d1824951799cf893dab5bd1906e4e4"}
May 25 01:02:33.268741 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.268668    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal" event={"ID":"f6115103e00adc9377ba1c7fc9b87c19","Type":"ContainerStarted","Data":"42d98638930458ac71253ca4b8af0f15ada87e6c630e7ee486cedbdd160cd1d0"}
May 25 01:02:33.272999 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.272970    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5rg4l" event={"ID":"eef5509c-b268-45c9-a47b-7bfdfd3532e7","Type":"ContainerStarted","Data":"9450bfae703194f63c8f14bc396ec152595a8fc28111dddf63d6c4178acea442"}
May 25 01:02:33.280497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.280465    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k2867" event={"ID":"0a297fdb-ed9d-4dd5-963e-bd236316f375","Type":"ContainerStarted","Data":"0fd2abbe18e157cdb91aad9b3e9fd7c6ca808aafcb33cbcc63ab242b53f4847b"}
May 25 01:02:33.284508 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.284479    2560 generic.go:358] "Generic (PLEG): container finished" podID="d986f338e87082082316af92d6d409a2" containerID="5598449eb8f7275705cf7e010080d68505635dcde50799aea8d01c04c17727ba" exitCode=0
May 25 01:02:33.284640 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.284521    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal" event={"ID":"d986f338e87082082316af92d6d409a2","Type":"ContainerDied","Data":"5598449eb8f7275705cf7e010080d68505635dcde50799aea8d01c04c17727ba"}
May 25 01:02:33.301076 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.300461    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal" podStartSLOduration=2.300442332 podStartE2EDuration="2.300442332s" podCreationTimestamp="2026-05-25 01:02:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:33.287774045 +0000 UTC m=+3.715984928" watchObservedRunningTime="2026-05-25 01:02:33.300442332 +0000 UTC m=+3.728653210"
May 25 01:02:33.811241 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.810635    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:33.811241 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:33.810767    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:33.811241 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:33.810845    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:35.810824106 +0000 UTC m=+6.239034963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:33.911571 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:33.911530    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:33.911737 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:33.911708    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:33.911737 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:33.911728    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:33.911854 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:33.911741    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2rc9 for pod openshift-network-diagnostics/network-check-target-54ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:33.911854 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:33.911798    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9 podName:a5763d3e-5a22-48fe-b280-9f442934aa78 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:35.911779212 +0000 UTC m=+6.339990083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2rc9" (UniqueName: "kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9") pod "network-check-target-54ns5" (UID: "a5763d3e-5a22-48fe-b280-9f442934aa78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:34.178930 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:34.178426    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:34.178930 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:34.178567    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:34.181890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:34.179548    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:34.181890 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:34.179650    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:34.302838 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:34.302807    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal" event={"ID":"d986f338e87082082316af92d6d409a2","Type":"ContainerStarted","Data":"2b6571420a5fbb7dda5713a026b24a03055153b8e4f05f40f9382c938691e95b"}
May 25 01:02:35.827611 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:35.827576    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:35.828062 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:35.827686    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:35.828062 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:35.827758    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:39.827743637 +0000 UTC m=+10.255954488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:35.928361 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:35.928322    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:35.928555 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:35.928504    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:35.928555 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:35.928522    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:35.928555 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:35.928536    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2rc9 for pod openshift-network-diagnostics/network-check-target-54ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:35.928730 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:35.928603    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9 podName:a5763d3e-5a22-48fe-b280-9f442934aa78 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:39.928578124 +0000 UTC m=+10.356788981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2rc9" (UniqueName: "kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9") pod "network-check-target-54ns5" (UID: "a5763d3e-5a22-48fe-b280-9f442934aa78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:36.180030 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:36.179389    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:36.180030 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:36.179440    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:36.180030 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:36.179549    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:36.180030 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:36.179981    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:38.179416 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:38.179384    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:38.179883 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:38.179526    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:38.179978 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:38.179961    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:38.180047 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:38.180032    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:39.865312 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:39.865271    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:39.865698 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:39.865433    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:39.865698 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:39.865497    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:47.86547743 +0000 UTC m=+18.293688288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:39.966476 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:39.966430    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:39.966721 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:39.966668    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:39.966721 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:39.966697    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:39.966721 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:39.966710    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2rc9 for pod openshift-network-diagnostics/network-check-target-54ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:39.966968 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:39.966776    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9 podName:a5763d3e-5a22-48fe-b280-9f442934aa78 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:47.966760403 +0000 UTC m=+18.394971255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2rc9" (UniqueName: "kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9") pod "network-check-target-54ns5" (UID: "a5763d3e-5a22-48fe-b280-9f442934aa78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:40.180466 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:40.179273    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:40.180466 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:40.179396    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:40.180466 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:40.179634    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:40.180466 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:40.179711    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:42.178722 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:42.178688    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:42.179161 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:42.178688    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:42.179161 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:42.178822    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:42.179161 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:42.178925    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:44.178664 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:44.178630    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:44.179116 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:44.178672    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:44.179116 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:44.178763    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:44.179116 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:44.178868    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:46.178298 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:46.178263    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:46.178731 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:46.178312    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:46.178731 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:46.178387    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:46.178731 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:46.178503    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:47.923022 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:47.922984    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:47.923536 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:47.923121    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:47.923536 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:47.923195    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:03.923173914 +0000 UTC m=+34.351384786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:48.024259 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:48.024198    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:48.024427 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:48.024373    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:48.024427 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:48.024393    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:48.024427 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:48.024403    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2rc9 for pod openshift-network-diagnostics/network-check-target-54ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:48.024557 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:48.024455    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9 podName:a5763d3e-5a22-48fe-b280-9f442934aa78 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:04.024440003 +0000 UTC m=+34.452650855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2rc9" (UniqueName: "kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9") pod "network-check-target-54ns5" (UID: "a5763d3e-5a22-48fe-b280-9f442934aa78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:48.178058 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:48.177984    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:48.178178 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:48.178121    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:48.178248 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:48.178180    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:48.178336 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:48.178309    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:50.180504 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:50.180475    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:50.180977 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:50.180475    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:50.180977 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:50.180588    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:50.180977 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:50.180651    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:52.179088 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.178902    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:52.179826 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.178941    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:52.179826 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:52.179167    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:52.179826 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:52.179263    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:52.316071 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.316007    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 01:02:52.338167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.337998    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd" event={"ID":"7db0113a-b72b-4615-8730-adcd86864765","Type":"ContainerStarted","Data":"0b004406c6b5d9f274dc85a477574df6c4345bf649604bf4dbfdf6a58dcf9a12"}
May 25 01:02:52.338396 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.338178    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd" event={"ID":"7db0113a-b72b-4615-8730-adcd86864765","Type":"ContainerStarted","Data":"35738fe48959cc15a3c39c71cec3fc88a2f56cf7c9dbe4ba8dbafdec683a5030"}
May 25 01:02:52.339273 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.339252    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hfxhs" event={"ID":"91718d6a-07eb-4323-9fe6-2bf204f74f71","Type":"ContainerStarted","Data":"6092e9017db907f35893000605574a70258230824824126a8f922f3ad2f2a70d"}
May 25 01:02:52.340488 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.340461    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gv5pb" event={"ID":"8ae3a468-ebf5-441a-a232-e654bcb9c52d","Type":"ContainerStarted","Data":"58775f8a474fc563a8ba123d52fc7d2285916661052df8df7938801eda5bc190"}
May 25 01:02:52.341732 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.341710    2560 generic.go:358] "Generic (PLEG): container finished" podID="eb55b0df-405e-4c3b-8e91-198a33549969" containerID="a5913ab22f59c24075b5ab0e6aff11d098c0df9c458cdc88276296b5e59df61a" exitCode=0
May 25 01:02:52.341824 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.341778    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" event={"ID":"eb55b0df-405e-4c3b-8e91-198a33549969","Type":"ContainerDied","Data":"a5913ab22f59c24075b5ab0e6aff11d098c0df9c458cdc88276296b5e59df61a"}
May 25 01:02:52.343153 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.343130    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5rg4l" event={"ID":"eef5509c-b268-45c9-a47b-7bfdfd3532e7","Type":"ContainerStarted","Data":"dead02c791a3974d9685e0df3624a392c5de10c6b2d657661c2aafb5a1e1a2c8"}
May 25 01:02:52.344393 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.344375    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k2867" event={"ID":"0a297fdb-ed9d-4dd5-963e-bd236316f375","Type":"ContainerStarted","Data":"ab2d6055c9ddf7feb65e07c363d981819a0109b3b4ae941e99d17b8ab7d3394e"}
May 25 01:02:52.346760 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.346744    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:02:52.347027 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.347012    2560 generic.go:358] "Generic (PLEG): container finished" podID="5a8f190b-958a-439f-81c7-eb51e8e04200" containerID="1ba28844fab129cde99103b3568320d285f4983f9b5907b5c37bd4208e8286cf" exitCode=1
May 25 01:02:52.347109 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.347062    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"b11dcd96cadd42039870ccf2211560949a7c8b007ad5e83b520b5526729ea03d"}
May 25 01:02:52.347109 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.347077    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"f737d95b8470b914c72cf6bcd900a6a19ef219a183bfd71a48b11774364888aa"}
May 25 01:02:52.347109 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.347086    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"93ca493434efa2a2785b2679791f00b414328b66486d9a25790640248288d752"}
May 25 01:02:52.347109 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.347094    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"43400f43b58a3d08f6fb2a4736abab875dbe463cd4f78545680c812b47100fc8"}
May 25 01:02:52.347109 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.347102    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerDied","Data":"1ba28844fab129cde99103b3568320d285f4983f9b5907b5c37bd4208e8286cf"}
May 25 01:02:52.347109 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.347111    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"eb9baadc7563d6aa12fee72ab2ff2c313ebdcdd944263f4e531cab8f9028d271"}
May 25 01:02:52.348571 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.348553    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4b6q" event={"ID":"60d09b4f-ddbf-4925-85a8-bc1245a28498","Type":"ContainerStarted","Data":"6f51ce7faf08f0388d67d513b4a0d8eea102fdf533ad407092d20949f313695f"}
May 25 01:02:52.354066 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.354033    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hfxhs" podStartSLOduration=3.914377623 podStartE2EDuration="22.3540238s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.751922575 +0000 UTC m=+3.180133426" lastFinishedPulling="2026-05-25 01:02:51.191568745 +0000 UTC m=+21.619779603" observedRunningTime="2026-05-25 01:02:52.353996307 +0000 UTC m=+22.782207193" watchObservedRunningTime="2026-05-25 01:02:52.3540238 +0000 UTC m=+22.782234673"
May 25 01:02:52.354135 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.354097    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal" podStartSLOduration=21.354092569 podStartE2EDuration="21.354092569s" podCreationTimestamp="2026-05-25 01:02:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:34.317212215 +0000 UTC m=+4.745423092" watchObservedRunningTime="2026-05-25 01:02:52.354092569 +0000 UTC m=+22.782303442"
May 25 01:02:52.396897 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.396856    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5rg4l" podStartSLOduration=3.830212321 podStartE2EDuration="22.396844647s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.749043845 +0000 UTC m=+3.177254702" lastFinishedPulling="2026-05-25 01:02:51.315676165 +0000 UTC m=+21.743887028" observedRunningTime="2026-05-25 01:02:52.396604627 +0000 UTC m=+22.824815501" watchObservedRunningTime="2026-05-25 01:02:52.396844647 +0000 UTC m=+22.825055520"
May 25 01:02:52.425775 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.425732    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gv5pb" podStartSLOduration=3.927588101 podStartE2EDuration="22.425721296s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.745715196 +0000 UTC m=+3.173926049" lastFinishedPulling="2026-05-25 01:02:51.24384839 +0000 UTC m=+21.672059244" observedRunningTime="2026-05-25 01:02:52.425714191 +0000 UTC m=+22.853925067" watchObservedRunningTime="2026-05-25 01:02:52.425721296 +0000 UTC m=+22.853932152"
May 25 01:02:52.425976 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.425951    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-h4b6q" podStartSLOduration=4.384230357 podStartE2EDuration="22.425943961s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.754557704 +0000 UTC m=+3.182768559" lastFinishedPulling="2026-05-25 01:02:50.796271308 +0000 UTC m=+21.224482163" observedRunningTime="2026-05-25 01:02:52.410724512 +0000 UTC m=+22.838935385" watchObservedRunningTime="2026-05-25 01:02:52.425943961 +0000 UTC m=+22.854154834"
May 25 01:02:52.441433 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:52.441399    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k2867" podStartSLOduration=3.919327165 podStartE2EDuration="22.441389483s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.748685279 +0000 UTC m=+3.176896135" lastFinishedPulling="2026-05-25 01:02:51.270747588 +0000 UTC m=+21.698958453" observedRunningTime="2026-05-25 01:02:52.441359603 +0000 UTC m=+22.869570487" watchObservedRunningTime="2026-05-25 01:02:52.441389483 +0000 UTC m=+22.869600367"
May 25 01:02:53.147675 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:53.147565    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T01:02:52.316025909Z","UUID":"ab721c3f-85b3-405c-bb13-5685215eea5f","Handler":null,"Name":"","Endpoint":""}
May 25 01:02:53.150879 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:53.150854    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 01:02:53.150879 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:53.150886    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 01:02:53.353191 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:53.353148    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd" event={"ID":"7db0113a-b72b-4615-8730-adcd86864765","Type":"ContainerStarted","Data":"db6dbd869ae4c2c7ae4efc824e9517e25dbead689e1c1eb56e27c21cdd7f8165"}
May 25 01:02:53.355536 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:53.355026    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-555h7" event={"ID":"5d7fd507-915d-4a3d-bc76-194cd9fc23de","Type":"ContainerStarted","Data":"7ee05b9b89f3acadf23df006b13a3ea133136c30f1be85505afa98e2830d11c0"}
May 25 01:02:53.371034 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:53.370990    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6pdd" podStartSLOduration=2.960622253 podStartE2EDuration="23.370973688s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.753841539 +0000 UTC m=+3.182052394" lastFinishedPulling="2026-05-25 01:02:53.164192962 +0000 UTC m=+23.592403829" observedRunningTime="2026-05-25 01:02:53.37059585 +0000 UTC m=+23.798806723" watchObservedRunningTime="2026-05-25 01:02:53.370973688 +0000 UTC m=+23.799184564"
May 25 01:02:53.386161 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:53.386123    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-555h7" podStartSLOduration=4.863431341 podStartE2EDuration="23.386111499s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.747809742 +0000 UTC m=+3.176020609" lastFinishedPulling="2026-05-25 01:02:51.270489911 +0000 UTC m=+21.698700767" observedRunningTime="2026-05-25 01:02:53.385745134 +0000 UTC m=+23.813956009" watchObservedRunningTime="2026-05-25 01:02:53.386111499 +0000 UTC m=+23.814322374"
May 25 01:02:54.178511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:54.178480    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:54.178670 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:54.178610    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:54.178670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:54.178650    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:54.178795 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:54.178740    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:54.360422 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:54.360390    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:02:54.360957 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:54.360932    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"fc595b0a66681577914fa85506b6eb046697929487b2b6b35bfab347c2ac6546"}
May 25 01:02:55.452444 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:55.452409    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:55.453108 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:55.453039    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:56.178413 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:56.178376    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:56.178580 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:56.178516    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:56.178580 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:56.178527    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:56.178670 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:56.178601    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:56.364189 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:56.364029    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:56.364634 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:56.364608    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gv5pb"
May 25 01:02:57.368844 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:57.368815    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:02:57.369385 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:57.369130    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"63815f3c5ed5fa7159d98dce49f2cb2fdac8aa0fc12c3327b162e1a342bb0680"}
May 25 01:02:57.369482 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:57.369467    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:57.369584 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:57.369492    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:57.369689 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:57.369666    2560 scope.go:117] "RemoveContainer" containerID="1ba28844fab129cde99103b3568320d285f4983f9b5907b5c37bd4208e8286cf"
May 25 01:02:57.370763 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:57.370739    2560 generic.go:358] "Generic (PLEG): container finished" podID="eb55b0df-405e-4c3b-8e91-198a33549969" containerID="182a575f763036675066987b845eba9d019673a6bc54e8dae1b2a96c502d3a85" exitCode=0
May 25 01:02:57.370857 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:57.370820    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" event={"ID":"eb55b0df-405e-4c3b-8e91-198a33549969","Type":"ContainerDied","Data":"182a575f763036675066987b845eba9d019673a6bc54e8dae1b2a96c502d3a85"}
May 25 01:02:57.386900 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:57.386883    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:58.178442 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.178411    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:58.178442 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.178432    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:58.178637 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:58.178526    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:58.178637 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:58.178584    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:58.369001 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.368822    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-54ns5"]
May 25 01:02:58.370635 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.370618    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zzn6w"]
May 25 01:02:58.378104 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.378081    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:02:58.378563 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.378521    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:02:58.378663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.378561    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" event={"ID":"5a8f190b-958a-439f-81c7-eb51e8e04200","Type":"ContainerStarted","Data":"d0d80b72c9791166e61d833d8adc0da45c2b4dbefebfe16cab4d405cd49f7bf3"}
May 25 01:02:58.378663 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:58.378645    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:02:58.378796 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.378779    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:02:58.378907 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.378888    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:58.379010 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:02:58.378898    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:02:58.399442 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.399420    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:02:58.405366 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:58.405319    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk" podStartSLOduration=9.868420072 podStartE2EDuration="28.405306659s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.756155851 +0000 UTC m=+3.184366703" lastFinishedPulling="2026-05-25 01:02:51.293042435 +0000 UTC m=+21.721253290" observedRunningTime="2026-05-25 01:02:58.403821145 +0000 UTC m=+28.832032021" watchObservedRunningTime="2026-05-25 01:02:58.405306659 +0000 UTC m=+28.833517533"
May 25 01:02:59.384207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:59.384174    2560 generic.go:358] "Generic (PLEG): container finished" podID="eb55b0df-405e-4c3b-8e91-198a33549969" containerID="11acae1f5b2c58009df6b02f338ad03e29202ba5e8d76d9efcfcac7836c52e5b" exitCode=0
May 25 01:02:59.384767 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:02:59.384264    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" event={"ID":"eb55b0df-405e-4c3b-8e91-198a33549969","Type":"ContainerDied","Data":"11acae1f5b2c58009df6b02f338ad03e29202ba5e8d76d9efcfcac7836c52e5b"}
May 25 01:03:00.178739 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:00.178712    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:03:00.178839 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:00.178818    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:03:00.178897 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:00.178843    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:03:00.178934 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:00.178918    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:03:01.389728 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:01.389692    2560 generic.go:358] "Generic (PLEG): container finished" podID="eb55b0df-405e-4c3b-8e91-198a33549969" containerID="8cf5e426d9add90f9c4b9c73f247ee0d6ec72eb2906ebf878d89f1a6acc78699" exitCode=0
May 25 01:03:01.390269 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:01.389735    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" event={"ID":"eb55b0df-405e-4c3b-8e91-198a33549969","Type":"ContainerDied","Data":"8cf5e426d9add90f9c4b9c73f247ee0d6ec72eb2906ebf878d89f1a6acc78699"}
May 25 01:03:02.178632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:02.178602    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:03:02.178632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:02.178588    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:03:02.178861 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:02.178734    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54ns5" podUID="a5763d3e-5a22-48fe-b280-9f442934aa78"
May 25 01:03:02.178918 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:02.178880    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:03:03.920542 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.920506    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeReady"
May 25 01:03:03.921033 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.920676    2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 01:03:03.941770 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.941740    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:03:03.941949 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:03.941908    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:03:03.942015 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:03.941979    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:35.941957144 +0000 UTC m=+66.370168012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:03:03.964268 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.964219    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-26w8p"]
May 25 01:03:03.984407 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.984377    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ncr46"]
May 25 01:03:03.984577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.984560    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26w8p"
May 25 01:03:03.987243 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.986985    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 01:03:03.987447 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.987005    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 01:03:03.987575 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:03.987034    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-clxvr\""
May 25 01:03:04.004466 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.004444    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26w8p"]
May 25 01:03:04.004466 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.004467    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ncr46"]
May 25 01:03:04.004624 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.004557    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:04.007064 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.007041    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 01:03:04.007064 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.007056    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 01:03:04.007354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.007048    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4fpd\""
May 25 01:03:04.007354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.007048    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 01:03:04.042628 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.042590    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:03:04.042789 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.042776    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:03:04.042846 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.042795    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:03:04.042846 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.042804    2560 projected.go:194] Error preparing data for projected volume kube-api-access-g2rc9 for pod openshift-network-diagnostics/network-check-target-54ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:03:04.042951 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.042869    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9 podName:a5763d3e-5a22-48fe-b280-9f442934aa78 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:36.042846911 +0000 UTC m=+66.471057763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2rc9" (UniqueName: "kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9") pod "network-check-target-54ns5" (UID: "a5763d3e-5a22-48fe-b280-9f442934aa78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:03:04.142975 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.142939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:04.143157 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.142982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.143157 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.143035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9mfw\" (UniqueName: \"kubernetes.io/projected/be1ea56e-4410-4a30-b795-29c06baaa915-kube-api-access-w9mfw\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.143157 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.143061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1ea56e-4410-4a30-b795-29c06baaa915-tmp-dir\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.143157 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.143089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn8p5\" (UniqueName: \"kubernetes.io/projected/d55dc3e2-2745-4fa4-9967-e88706dce19c-kube-api-access-kn8p5\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:04.143397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.143190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be1ea56e-4410-4a30-b795-29c06baaa915-config-volume\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.178536 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.178500    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:03:04.178707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.178557    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:03:04.181314 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.181290    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 01:03:04.181519 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.181290    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 01:03:04.181637 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.181618    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gc4b2\""
May 25 01:03:04.181735 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.181711    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 01:03:04.181802 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.181716    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8zp6\""
May 25 01:03:04.244152 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.244118    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:04.244357 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.244166    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.244357 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.244198    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9mfw\" (UniqueName: \"kubernetes.io/projected/be1ea56e-4410-4a30-b795-29c06baaa915-kube-api-access-w9mfw\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.244357 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.244239    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1ea56e-4410-4a30-b795-29c06baaa915-tmp-dir\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.244357 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.244273    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kn8p5\" (UniqueName: \"kubernetes.io/projected/d55dc3e2-2745-4fa4-9967-e88706dce19c-kube-api-access-kn8p5\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:04.244357 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.244288    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:04.244357 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.244348    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert podName:d55dc3e2-2745-4fa4-9967-e88706dce19c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:04.744329245 +0000 UTC m=+35.172540101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert") pod "ingress-canary-ncr46" (UID: "d55dc3e2-2745-4fa4-9967-e88706dce19c") : secret "canary-serving-cert" not found
May 25 01:03:04.244660 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.244365    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:04.244660 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.244437    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls podName:be1ea56e-4410-4a30-b795-29c06baaa915 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:04.744418346 +0000 UTC m=+35.172629218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls") pod "dns-default-26w8p" (UID: "be1ea56e-4410-4a30-b795-29c06baaa915") : secret "dns-default-metrics-tls" not found
May 25 01:03:04.244660 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.244469    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be1ea56e-4410-4a30-b795-29c06baaa915-config-volume\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.244854 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.244836    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1ea56e-4410-4a30-b795-29c06baaa915-tmp-dir\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.245148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.245128    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be1ea56e-4410-4a30-b795-29c06baaa915-config-volume\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.257603 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.257578    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn8p5\" (UniqueName: \"kubernetes.io/projected/d55dc3e2-2745-4fa4-9967-e88706dce19c-kube-api-access-kn8p5\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:04.257757 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.257635    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9mfw\" (UniqueName: \"kubernetes.io/projected/be1ea56e-4410-4a30-b795-29c06baaa915-kube-api-access-w9mfw\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.748546 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.748506    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:04.748772 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:04.748626    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:04.748772 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.748660    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:04.748772 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.748729    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:04.748772 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.748759    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls podName:be1ea56e-4410-4a30-b795-29c06baaa915 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:05.748729845 +0000 UTC m=+36.176940697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls") pod "dns-default-26w8p" (UID: "be1ea56e-4410-4a30-b795-29c06baaa915") : secret "dns-default-metrics-tls" not found
May 25 01:03:04.748914 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:04.748785    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert podName:d55dc3e2-2745-4fa4-9967-e88706dce19c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:05.748768983 +0000 UTC m=+36.176979842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert") pod "ingress-canary-ncr46" (UID: "d55dc3e2-2745-4fa4-9967-e88706dce19c") : secret "canary-serving-cert" not found
May 25 01:03:05.756985 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:05.756950    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:05.757447 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:05.757006    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:05.757447 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:05.757083    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:05.757447 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:05.757148    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:05.757447 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:05.757159    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert podName:d55dc3e2-2745-4fa4-9967-e88706dce19c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:07.757138147 +0000 UTC m=+38.185349022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert") pod "ingress-canary-ncr46" (UID: "d55dc3e2-2745-4fa4-9967-e88706dce19c") : secret "canary-serving-cert" not found
May 25 01:03:05.757447 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:05.757198    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls podName:be1ea56e-4410-4a30-b795-29c06baaa915 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:07.757181984 +0000 UTC m=+38.185392840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls") pod "dns-default-26w8p" (UID: "be1ea56e-4410-4a30-b795-29c06baaa915") : secret "dns-default-metrics-tls" not found
May 25 01:03:07.773074 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:07.773045    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:07.773417 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:07.773084    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:07.773417 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:07.773194    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:07.773417 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:07.773194    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:07.773417 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:07.773275    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert podName:d55dc3e2-2745-4fa4-9967-e88706dce19c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:11.773256078 +0000 UTC m=+42.201466931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert") pod "ingress-canary-ncr46" (UID: "d55dc3e2-2745-4fa4-9967-e88706dce19c") : secret "canary-serving-cert" not found
May 25 01:03:07.773417 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:07.773289    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls podName:be1ea56e-4410-4a30-b795-29c06baaa915 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:11.773283143 +0000 UTC m=+42.201493995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls") pod "dns-default-26w8p" (UID: "be1ea56e-4410-4a30-b795-29c06baaa915") : secret "dns-default-metrics-tls" not found
May 25 01:03:08.404309 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:08.404280    2560 generic.go:358] "Generic (PLEG): container finished" podID="eb55b0df-405e-4c3b-8e91-198a33549969" containerID="64a363d0f6f9588a5bed426e5cd94c3afaec4beeaf549b1c41cddb8c35c8fe7e" exitCode=0
May 25 01:03:08.404451 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:08.404325    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" event={"ID":"eb55b0df-405e-4c3b-8e91-198a33549969","Type":"ContainerDied","Data":"64a363d0f6f9588a5bed426e5cd94c3afaec4beeaf549b1c41cddb8c35c8fe7e"}
May 25 01:03:09.408748 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:09.408710    2560 generic.go:358] "Generic (PLEG): container finished" podID="eb55b0df-405e-4c3b-8e91-198a33549969" containerID="6f2070da78148be923c292e39ab7635e2eb04ee1a3a4eab40435ce8afe95e7f6" exitCode=0
May 25 01:03:09.409127 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:09.408770    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" event={"ID":"eb55b0df-405e-4c3b-8e91-198a33549969","Type":"ContainerDied","Data":"6f2070da78148be923c292e39ab7635e2eb04ee1a3a4eab40435ce8afe95e7f6"}
May 25 01:03:10.413160 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:10.413127    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" event={"ID":"eb55b0df-405e-4c3b-8e91-198a33549969","Type":"ContainerStarted","Data":"6555c28de9c5ccc89c44edee3cf22e411102713f02856f52fe7e9832fec57f73"}
May 25 01:03:10.436500 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:10.436449    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xqpcz" podStartSLOduration=5.677374537 podStartE2EDuration="40.436434893s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:02:32.745035141 +0000 UTC m=+3.173245994" lastFinishedPulling="2026-05-25 01:03:07.504095495 +0000 UTC m=+37.932306350" observedRunningTime="2026-05-25 01:03:10.436024171 +0000 UTC m=+40.864235067" watchObservedRunningTime="2026-05-25 01:03:10.436434893 +0000 UTC m=+40.864645767"
May 25 01:03:11.802325 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:11.802290    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:11.802708 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:11.802333    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:11.802708 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:11.802447    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:11.802708 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:11.802448    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:11.802708 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:11.802513    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls podName:be1ea56e-4410-4a30-b795-29c06baaa915 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:19.802494405 +0000 UTC m=+50.230705257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls") pod "dns-default-26w8p" (UID: "be1ea56e-4410-4a30-b795-29c06baaa915") : secret "dns-default-metrics-tls" not found
May 25 01:03:11.802708 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:11.802530    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert podName:d55dc3e2-2745-4fa4-9967-e88706dce19c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:19.802521914 +0000 UTC m=+50.230732766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert") pod "ingress-canary-ncr46" (UID: "d55dc3e2-2745-4fa4-9967-e88706dce19c") : secret "canary-serving-cert" not found
May 25 01:03:19.857394 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:19.857352    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:19.857394 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:19.857398    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:19.857830 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:19.857494    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:19.857830 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:19.857518    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:19.857830 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:19.857556    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert podName:d55dc3e2-2745-4fa4-9967-e88706dce19c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:35.857541693 +0000 UTC m=+66.285752545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert") pod "ingress-canary-ncr46" (UID: "d55dc3e2-2745-4fa4-9967-e88706dce19c") : secret "canary-serving-cert" not found
May 25 01:03:19.857830 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:19.857574    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls podName:be1ea56e-4410-4a30-b795-29c06baaa915 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:35.857562741 +0000 UTC m=+66.285773594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls") pod "dns-default-26w8p" (UID: "be1ea56e-4410-4a30-b795-29c06baaa915") : secret "dns-default-metrics-tls" not found
May 25 01:03:30.396763 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:30.396731    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8vk"
May 25 01:03:35.862275 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:35.862214    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:03:35.862275 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:35.862275    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:03:35.862814 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:35.862375    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:35.862814 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:35.862381    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:35.862814 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:35.862439    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls podName:be1ea56e-4410-4a30-b795-29c06baaa915 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:07.862424809 +0000 UTC m=+98.290635661 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls") pod "dns-default-26w8p" (UID: "be1ea56e-4410-4a30-b795-29c06baaa915") : secret "dns-default-metrics-tls" not found
May 25 01:03:35.862814 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:35.862463    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert podName:d55dc3e2-2745-4fa4-9967-e88706dce19c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:07.862445826 +0000 UTC m=+98.290656695 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert") pod "ingress-canary-ncr46" (UID: "d55dc3e2-2745-4fa4-9967-e88706dce19c") : secret "canary-serving-cert" not found
May 25 01:03:35.962965 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:35.962933    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:03:35.965905 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:35.965883    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 01:03:35.974171 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:35.974146    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 01:03:35.974281 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:03:35.974260    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:39.974218407 +0000 UTC m=+130.402429278 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : secret "metrics-daemon-secret" not found
May 25 01:03:36.063993 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:36.063954    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:03:36.067278 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:36.067255    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 01:03:36.077503 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:36.077479    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 01:03:36.088545 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:36.088510    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2rc9\" (UniqueName: \"kubernetes.io/projected/a5763d3e-5a22-48fe-b280-9f442934aa78-kube-api-access-g2rc9\") pod \"network-check-target-54ns5\" (UID: \"a5763d3e-5a22-48fe-b280-9f442934aa78\") " pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:03:36.299024 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:36.298945    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gc4b2\""
May 25 01:03:36.306385 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:36.306369    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:03:36.434444 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:36.434411    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-54ns5"]
May 25 01:03:36.438437 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:03:36.438406    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5763d3e_5a22_48fe_b280_9f442934aa78.slice/crio-7687c8a00d2225735406d948f3cf5275bfd70f568f68b7817af264edf3b8eb41 WatchSource:0}: Error finding container 7687c8a00d2225735406d948f3cf5275bfd70f568f68b7817af264edf3b8eb41: Status 404 returned error can't find the container with id 7687c8a00d2225735406d948f3cf5275bfd70f568f68b7817af264edf3b8eb41
May 25 01:03:36.463283 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:36.463257    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-54ns5" event={"ID":"a5763d3e-5a22-48fe-b280-9f442934aa78","Type":"ContainerStarted","Data":"7687c8a00d2225735406d948f3cf5275bfd70f568f68b7817af264edf3b8eb41"}
May 25 01:03:39.471424 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:39.471332    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-54ns5" event={"ID":"a5763d3e-5a22-48fe-b280-9f442934aa78","Type":"ContainerStarted","Data":"05dcab0949870a04141404c5a0adbf0f8239cecd29d8b7996580e36651b3aeda"}
May 25 01:03:39.471758 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:39.471467    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:03:39.492458 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:03:39.492417    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-54ns5" podStartSLOduration=66.757345285 podStartE2EDuration="1m9.492405462s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:03:36.440207364 +0000 UTC m=+66.868418217" lastFinishedPulling="2026-05-25 01:03:39.175267528 +0000 UTC m=+69.603478394" observedRunningTime="2026-05-25 01:03:39.49221649 +0000 UTC m=+69.920427364" watchObservedRunningTime="2026-05-25 01:03:39.492405462 +0000 UTC m=+69.920616335"
May 25 01:04:07.883495 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:07.883323    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:04:07.883495 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:07.883392    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:04:07.883495 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:07.883473    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:04:07.884025 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:07.883524    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:04:07.884025 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:07.883553    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert podName:d55dc3e2-2745-4fa4-9967-e88706dce19c nodeName:}" failed. No retries permitted until 2026-05-25 01:05:11.88353793 +0000 UTC m=+162.311748782 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert") pod "ingress-canary-ncr46" (UID: "d55dc3e2-2745-4fa4-9967-e88706dce19c") : secret "canary-serving-cert" not found
May 25 01:04:07.884025 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:07.883585    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls podName:be1ea56e-4410-4a30-b795-29c06baaa915 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:11.88357303 +0000 UTC m=+162.311783883 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls") pod "dns-default-26w8p" (UID: "be1ea56e-4410-4a30-b795-29c06baaa915") : secret "dns-default-metrics-tls" not found
May 25 01:04:10.476547 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:10.476518    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-54ns5"
May 25 01:04:15.696157 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.696125    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-rmjjk"]
May 25 01:04:15.700500 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.700481    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.702854 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.702834    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 25 01:04:15.703012 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.702981    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xhmtd\""
May 25 01:04:15.703900 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.703880    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 01:04:15.704047 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.703969    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 25 01:04:15.704248 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.704052    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 01:04:15.709753 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.709737    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 25 01:04:15.711643 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.711624    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-rmjjk"]
May 25 01:04:15.838808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.838770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/451af408-e043-461b-b8c1-040f69caa390-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.838808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.838811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2phg\" (UniqueName: \"kubernetes.io/projected/451af408-e043-461b-b8c1-040f69caa390-kube-api-access-s2phg\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.839020 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.838840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/451af408-e043-461b-b8c1-040f69caa390-snapshots\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.839020 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.838865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/451af408-e043-461b-b8c1-040f69caa390-serving-cert\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.839020 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.838925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/451af408-e043-461b-b8c1-040f69caa390-tmp\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.839020 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.838954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/451af408-e043-461b-b8c1-040f69caa390-service-ca-bundle\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940201 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940163    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/451af408-e043-461b-b8c1-040f69caa390-tmp\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940201 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940202    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/451af408-e043-461b-b8c1-040f69caa390-service-ca-bundle\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940379 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940243    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/451af408-e043-461b-b8c1-040f69caa390-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940379 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940266    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2phg\" (UniqueName: \"kubernetes.io/projected/451af408-e043-461b-b8c1-040f69caa390-kube-api-access-s2phg\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940379 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940288    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/451af408-e043-461b-b8c1-040f69caa390-snapshots\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940379 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940302    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/451af408-e043-461b-b8c1-040f69caa390-serving-cert\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940700 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940672    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/451af408-e043-461b-b8c1-040f69caa390-tmp\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940895 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940869    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/451af408-e043-461b-b8c1-040f69caa390-service-ca-bundle\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.940974 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.940896    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/451af408-e043-461b-b8c1-040f69caa390-snapshots\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.941096 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.941052    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/451af408-e043-461b-b8c1-040f69caa390-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.942895 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.942868    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/451af408-e043-461b-b8c1-040f69caa390-serving-cert\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:15.949373 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:15.949326    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2phg\" (UniqueName: \"kubernetes.io/projected/451af408-e043-461b-b8c1-040f69caa390-kube-api-access-s2phg\") pod \"insights-operator-78bdfb888c-rmjjk\" (UID: \"451af408-e043-461b-b8c1-040f69caa390\") " pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:16.009483 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:16.009460    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-rmjjk"
May 25 01:04:16.125408 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:16.125378    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-rmjjk"]
May 25 01:04:16.128830 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:04:16.128787    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451af408_e043_461b_b8c1_040f69caa390.slice/crio-5566ae9609e457e653bc84c182d040c6fb41ea15721f7e2a7f1a5f3a41a0e07a WatchSource:0}: Error finding container 5566ae9609e457e653bc84c182d040c6fb41ea15721f7e2a7f1a5f3a41a0e07a: Status 404 returned error can't find the container with id 5566ae9609e457e653bc84c182d040c6fb41ea15721f7e2a7f1a5f3a41a0e07a
May 25 01:04:16.540645 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:16.540609    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-rmjjk" event={"ID":"451af408-e043-461b-b8c1-040f69caa390","Type":"ContainerStarted","Data":"5566ae9609e457e653bc84c182d040c6fb41ea15721f7e2a7f1a5f3a41a0e07a"}
May 25 01:04:18.545795 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:18.545711    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-rmjjk" event={"ID":"451af408-e043-461b-b8c1-040f69caa390","Type":"ContainerStarted","Data":"f1a67d988022acfefcf88b290c18e50b0fc286d90e52c4a9f243e85f041086a0"}
May 25 01:04:18.562590 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:18.562545    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-rmjjk" podStartSLOduration=1.5809251340000001 podStartE2EDuration="3.562532514s" podCreationTimestamp="2026-05-25 01:04:15 +0000 UTC" firstStartedPulling="2026-05-25 01:04:16.130560977 +0000 UTC m=+106.558771828" lastFinishedPulling="2026-05-25 01:04:18.112168347 +0000 UTC m=+108.540379208" observedRunningTime="2026-05-25 01:04:18.562030856 +0000 UTC m=+108.990241730" watchObservedRunningTime="2026-05-25 01:04:18.562532514 +0000 UTC m=+108.990743384"
May 25 01:04:20.776933 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:20.776905    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4b6q_60d09b4f-ddbf-4925-85a8-bc1245a28498/dns-node-resolver/0.log"
May 25 01:04:21.686340 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.686309    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f"]
May 25 01:04:21.689137 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.689114    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"]
May 25 01:04:21.689285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.689266    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f"
May 25 01:04:21.691680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.691651    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kvh6f\""
May 25 01:04:21.691680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.691663    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 25 01:04:21.691821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.691653    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:21.692612 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.692592    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 25 01:04:21.694119 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.694101    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 25 01:04:21.694204 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.694191    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 25 01:04:21.694455 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.694425    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 25 01:04:21.694619 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.694597    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bhmx5\""
May 25 01:04:21.697605 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.697588    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f"]
May 25 01:04:21.701346 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.701325    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"]
May 25 01:04:21.777125 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.777097    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hfxhs_91718d6a-07eb-4323-9fe6-2bf204f74f71/node-ca/0.log"
May 25 01:04:21.782406 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.782382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct2bq\" (UniqueName: \"kubernetes.io/projected/24400e58-7459-418e-abcc-7c3098d1254d-kube-api-access-ct2bq\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:21.782510 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.782446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bmmr\" (UniqueName: \"kubernetes.io/projected/15a2999c-5bb3-40f9-a41c-322cc5b01c57-kube-api-access-5bmmr\") pod \"volume-data-source-validator-5cf8c89d64-rts2f\" (UID: \"15a2999c-5bb3-40f9-a41c-322cc5b01c57\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f"
May 25 01:04:21.782510 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.782472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:21.883167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.883125    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bmmr\" (UniqueName: \"kubernetes.io/projected/15a2999c-5bb3-40f9-a41c-322cc5b01c57-kube-api-access-5bmmr\") pod \"volume-data-source-validator-5cf8c89d64-rts2f\" (UID: \"15a2999c-5bb3-40f9-a41c-322cc5b01c57\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f"
May 25 01:04:21.883167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.883171    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:21.883371 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.883217    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct2bq\" (UniqueName: \"kubernetes.io/projected/24400e58-7459-418e-abcc-7c3098d1254d-kube-api-access-ct2bq\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:21.883371 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:21.883332    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 01:04:21.883438 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:21.883400    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls podName:24400e58-7459-418e-abcc-7c3098d1254d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:22.383381841 +0000 UTC m=+112.811592692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls") pod "cluster-samples-operator-697587599-k9znz" (UID: "24400e58-7459-418e-abcc-7c3098d1254d") : secret "samples-operator-tls" not found
May 25 01:04:21.894323 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.894292    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct2bq\" (UniqueName: \"kubernetes.io/projected/24400e58-7459-418e-abcc-7c3098d1254d-kube-api-access-ct2bq\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:21.894443 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.894331    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bmmr\" (UniqueName: \"kubernetes.io/projected/15a2999c-5bb3-40f9-a41c-322cc5b01c57-kube-api-access-5bmmr\") pod \"volume-data-source-validator-5cf8c89d64-rts2f\" (UID: \"15a2999c-5bb3-40f9-a41c-322cc5b01c57\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f"
May 25 01:04:21.999428 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:21.999355    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f"
May 25 01:04:22.118018 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.117990    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f"]
May 25 01:04:22.121033 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:04:22.121008    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a2999c_5bb3_40f9_a41c_322cc5b01c57.slice/crio-9496b69c16fecb5630d9a3ccb4c8ddc5aea5a40612a0fc5b45fd8031652befc7 WatchSource:0}: Error finding container 9496b69c16fecb5630d9a3ccb4c8ddc5aea5a40612a0fc5b45fd8031652befc7: Status 404 returned error can't find the container with id 9496b69c16fecb5630d9a3ccb4c8ddc5aea5a40612a0fc5b45fd8031652befc7
May 25 01:04:22.385517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.385473    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:22.385690 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:22.385632    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 01:04:22.385733 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:22.385695    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls podName:24400e58-7459-418e-abcc-7c3098d1254d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:23.385677639 +0000 UTC m=+113.813888510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls") pod "cluster-samples-operator-697587599-k9znz" (UID: "24400e58-7459-418e-abcc-7c3098d1254d") : secret "samples-operator-tls" not found
May 25 01:04:22.554250 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.554184    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f" event={"ID":"15a2999c-5bb3-40f9-a41c-322cc5b01c57","Type":"ContainerStarted","Data":"9496b69c16fecb5630d9a3ccb4c8ddc5aea5a40612a0fc5b45fd8031652befc7"}
May 25 01:04:22.685094 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.685017    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fsfz6"]
May 25 01:04:22.689041 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.689024    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.691556 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.691538    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 25 01:04:22.692513 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.692496    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 25 01:04:22.692628 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.692509    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 25 01:04:22.692628 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.692518    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 25 01:04:22.692628 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.692533    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7wgt8\""
May 25 01:04:22.696705 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.696688    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 25 01:04:22.701832 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.699170    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fsfz6"]
May 25 01:04:22.788689 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.788657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-serving-cert\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.789118 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.788700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-trusted-ca\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.789118 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.788725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8mf8\" (UniqueName: \"kubernetes.io/projected/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-kube-api-access-z8mf8\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.789118 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.788878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-config\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.890180 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.890134    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-config\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.890379 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.890240    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-serving-cert\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.890379 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.890283    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-trusted-ca\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.890379 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.890314    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8mf8\" (UniqueName: \"kubernetes.io/projected/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-kube-api-access-z8mf8\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.891049 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.891020    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-config\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.891170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.891153    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-trusted-ca\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.892848 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.892831    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-serving-cert\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.899731 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.899695    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8mf8\" (UniqueName: \"kubernetes.io/projected/6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4-kube-api-access-z8mf8\") pod \"console-operator-76dff48d59-fsfz6\" (UID: \"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4\") " pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:22.998801 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:22.998711    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:23.128841 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:23.128812    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fsfz6"]
May 25 01:04:23.131908 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:04:23.131881    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e426a9f_f72d_47b0_af0f_7c81dcbc2ef4.slice/crio-c5bcab9b5dda4c22f77d79e7a27628a6a2d9512e8348b8b46952958cda060300 WatchSource:0}: Error finding container c5bcab9b5dda4c22f77d79e7a27628a6a2d9512e8348b8b46952958cda060300: Status 404 returned error can't find the container with id c5bcab9b5dda4c22f77d79e7a27628a6a2d9512e8348b8b46952958cda060300
May 25 01:04:23.395103 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:23.395070    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:23.395322 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:23.395246    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 01:04:23.395322 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:23.395318    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls podName:24400e58-7459-418e-abcc-7c3098d1254d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:25.395299601 +0000 UTC m=+115.823510472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls") pod "cluster-samples-operator-697587599-k9znz" (UID: "24400e58-7459-418e-abcc-7c3098d1254d") : secret "samples-operator-tls" not found
May 25 01:04:23.556966 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:23.556931    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6" event={"ID":"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4","Type":"ContainerStarted","Data":"c5bcab9b5dda4c22f77d79e7a27628a6a2d9512e8348b8b46952958cda060300"}
May 25 01:04:24.560275 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.560217    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f" event={"ID":"15a2999c-5bb3-40f9-a41c-322cc5b01c57","Type":"ContainerStarted","Data":"cd8ff71f7ee20b273312b78fed38ca3d15a49e4a6f9318cba5245f7337ed9ff2"}
May 25 01:04:24.576980 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.576920    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-rts2f" podStartSLOduration=2.115003988 podStartE2EDuration="3.576904485s" podCreationTimestamp="2026-05-25 01:04:21 +0000 UTC" firstStartedPulling="2026-05-25 01:04:22.122814475 +0000 UTC m=+112.551025328" lastFinishedPulling="2026-05-25 01:04:23.584714972 +0000 UTC m=+114.012925825" observedRunningTime="2026-05-25 01:04:24.576611823 +0000 UTC m=+115.004822697" watchObservedRunningTime="2026-05-25 01:04:24.576904485 +0000 UTC m=+115.005115358"
May 25 01:04:24.873698 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.873664    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-589d8c58cc-zpb72"]
May 25 01:04:24.876438 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.876422    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:24.878944 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.878913    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 25 01:04:24.879167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.878925    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 25 01:04:24.879167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.878966    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 25 01:04:24.879167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.879019    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8cjkp\""
May 25 01:04:24.884728 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.884707    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 25 01:04:24.889923 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:24.889898    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-589d8c58cc-zpb72"]
May 25 01:04:25.006784 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.006755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pljsd\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-kube-api-access-pljsd\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.006784 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.006792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.007015 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.006837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-image-registry-private-configuration\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.007015 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.006870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-bound-sa-token\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.007015 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.006951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-trusted-ca\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.007015 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.006991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-installation-pull-secrets\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.007183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.007024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-certificates\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.007183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.007056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c767250-34bb-4c95-ae70-a75909b5dc39-ca-trust-extracted\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.108365 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108310    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.108549 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108397    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-image-registry-private-configuration\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.108549 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108439    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-bound-sa-token\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.108549 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108473    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-trusted-ca\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.108549 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:25.108473    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:04:25.108549 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:25.108498    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589d8c58cc-zpb72: secret "image-registry-tls" not found
May 25 01:04:25.108549 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108494    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-installation-pull-secrets\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.108549 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108528    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-certificates\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.108898 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:25.108564    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls podName:2c767250-34bb-4c95-ae70-a75909b5dc39 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:25.608541112 +0000 UTC m=+116.036751968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls") pod "image-registry-589d8c58cc-zpb72" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39") : secret "image-registry-tls" not found
May 25 01:04:25.108898 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108589    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c767250-34bb-4c95-ae70-a75909b5dc39-ca-trust-extracted\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.108898 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108637    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pljsd\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-kube-api-access-pljsd\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.109029 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.108976    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c767250-34bb-4c95-ae70-a75909b5dc39-ca-trust-extracted\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.109207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.109187    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-certificates\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.109511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.109495    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-trusted-ca\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.111483 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.111457    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-installation-pull-secrets\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.111589 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.111566    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-image-registry-private-configuration\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.117652 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.117626    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-bound-sa-token\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.118244 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.118207    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pljsd\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-kube-api-access-pljsd\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.410566 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.410534    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:25.410756 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:25.410707    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 01:04:25.410813 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:25.410791    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls podName:24400e58-7459-418e-abcc-7c3098d1254d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:29.41076958 +0000 UTC m=+119.838980452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls") pod "cluster-samples-operator-697587599-k9znz" (UID: "24400e58-7459-418e-abcc-7c3098d1254d") : secret "samples-operator-tls" not found
May 25 01:04:25.563655 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.563625    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/0.log"
May 25 01:04:25.564064 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.563664    2560 generic.go:358] "Generic (PLEG): container finished" podID="6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4" containerID="dd392ea41d536745e082d0633bdb0aa2bcf41c5a2375fce88f6624b602b387c0" exitCode=255
May 25 01:04:25.564064 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.563747    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6" event={"ID":"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4","Type":"ContainerDied","Data":"dd392ea41d536745e082d0633bdb0aa2bcf41c5a2375fce88f6624b602b387c0"}
May 25 01:04:25.564064 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.563928    2560 scope.go:117] "RemoveContainer" containerID="dd392ea41d536745e082d0633bdb0aa2bcf41c5a2375fce88f6624b602b387c0"
May 25 01:04:25.612671 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:25.612644    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:25.612829 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:25.612808    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:04:25.612907 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:25.612832    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589d8c58cc-zpb72: secret "image-registry-tls" not found
May 25 01:04:25.612907 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:25.612902    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls podName:2c767250-34bb-4c95-ae70-a75909b5dc39 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:26.612882896 +0000 UTC m=+117.041093751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls") pod "image-registry-589d8c58cc-zpb72" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39") : secret "image-registry-tls" not found
May 25 01:04:26.567754 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:26.567726    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:04:26.568164 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:26.568052    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/0.log"
May 25 01:04:26.568164 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:26.568081    2560 generic.go:358] "Generic (PLEG): container finished" podID="6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4" containerID="69afc7424670eef7d11de726092532d532e04c1978e98444f050c18e14747121" exitCode=255
May 25 01:04:26.568164 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:26.568109    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6" event={"ID":"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4","Type":"ContainerDied","Data":"69afc7424670eef7d11de726092532d532e04c1978e98444f050c18e14747121"}
May 25 01:04:26.568164 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:26.568134    2560 scope.go:117] "RemoveContainer" containerID="dd392ea41d536745e082d0633bdb0aa2bcf41c5a2375fce88f6624b602b387c0"
May 25 01:04:26.568466 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:26.568447    2560 scope.go:117] "RemoveContainer" containerID="69afc7424670eef7d11de726092532d532e04c1978e98444f050c18e14747121"
May 25 01:04:26.568643 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:26.568621    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fsfz6_openshift-console-operator(6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4)\"" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6" podUID="6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4"
May 25 01:04:26.621514 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:26.621481    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:26.621618 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:26.621575    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:04:26.621618 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:26.621586    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589d8c58cc-zpb72: secret "image-registry-tls" not found
May 25 01:04:26.621694 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:26.621626    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls podName:2c767250-34bb-4c95-ae70-a75909b5dc39 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:28.62161465 +0000 UTC m=+119.049825503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls") pod "image-registry-589d8c58cc-zpb72" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39") : secret "image-registry-tls" not found
May 25 01:04:27.571468 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:27.571442    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:04:27.571924 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:27.571832    2560 scope.go:117] "RemoveContainer" containerID="69afc7424670eef7d11de726092532d532e04c1978e98444f050c18e14747121"
May 25 01:04:27.572046 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:27.572026    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fsfz6_openshift-console-operator(6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4)\"" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6" podUID="6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4"
May 25 01:04:28.634242 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:28.634189    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:28.634614 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:28.634324    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:04:28.634614 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:28.634339    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589d8c58cc-zpb72: secret "image-registry-tls" not found
May 25 01:04:28.634614 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:28.634389    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls podName:2c767250-34bb-4c95-ae70-a75909b5dc39 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:32.634374784 +0000 UTC m=+123.062585636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls") pod "image-registry-589d8c58cc-zpb72" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39") : secret "image-registry-tls" not found
May 25 01:04:29.440452 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:29.440405    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:29.440640 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:29.440545    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 01:04:29.440640 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:29.440611    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls podName:24400e58-7459-418e-abcc-7c3098d1254d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:37.440594705 +0000 UTC m=+127.868805558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls") pod "cluster-samples-operator-697587599-k9znz" (UID: "24400e58-7459-418e-abcc-7c3098d1254d") : secret "samples-operator-tls" not found
May 25 01:04:31.973593 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:31.973552    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bjzmz"]
May 25 01:04:31.977908 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:31.977892    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:31.983183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:31.983161    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 25 01:04:31.984487 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:31.984471    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 25 01:04:31.984603 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:31.984476    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 25 01:04:31.984666 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:31.984640    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 25 01:04:31.984726 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:31.984711    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rjnpm\""
May 25 01:04:31.990209 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:31.990187    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bjzmz"]
May 25 01:04:32.061118 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.061082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpt9m\" (UniqueName: \"kubernetes.io/projected/e74e2e22-71df-448b-903d-3ee4f7c5077b-kube-api-access-rpt9m\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.061312 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.061131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e74e2e22-71df-448b-903d-3ee4f7c5077b-signing-cabundle\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.061312 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.061165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e74e2e22-71df-448b-903d-3ee4f7c5077b-signing-key\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.161929 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.161889    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpt9m\" (UniqueName: \"kubernetes.io/projected/e74e2e22-71df-448b-903d-3ee4f7c5077b-kube-api-access-rpt9m\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.162094 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.161941    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e74e2e22-71df-448b-903d-3ee4f7c5077b-signing-cabundle\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.162094 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.161978    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e74e2e22-71df-448b-903d-3ee4f7c5077b-signing-key\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.162597 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.162577    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e74e2e22-71df-448b-903d-3ee4f7c5077b-signing-cabundle\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.164657 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.164625    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e74e2e22-71df-448b-903d-3ee4f7c5077b-signing-key\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.181240 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.181208    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpt9m\" (UniqueName: \"kubernetes.io/projected/e74e2e22-71df-448b-903d-3ee4f7c5077b-kube-api-access-rpt9m\") pod \"service-ca-67d667c7d-bjzmz\" (UID: \"e74e2e22-71df-448b-903d-3ee4f7c5077b\") " pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.286571 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.286465    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bjzmz"
May 25 01:04:32.409441 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.409413    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bjzmz"]
May 25 01:04:32.412561 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:04:32.412529    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74e2e22_71df_448b_903d_3ee4f7c5077b.slice/crio-d882e92698d84661e085b2b3b101798de9ac3ac9f28a949b33efbe47a12b6828 WatchSource:0}: Error finding container d882e92698d84661e085b2b3b101798de9ac3ac9f28a949b33efbe47a12b6828: Status 404 returned error can't find the container with id d882e92698d84661e085b2b3b101798de9ac3ac9f28a949b33efbe47a12b6828
May 25 01:04:32.437901 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.437877    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-grsvl"]
May 25 01:04:32.442323 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.442306    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.444815 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.444792    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 01:04:32.444815 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.444810    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ljdcr\""
May 25 01:04:32.444940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.444907    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 01:04:32.452640 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.452619    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-grsvl"]
May 25 01:04:32.565414 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.565319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.565414 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.565365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2882aa8-e6e1-4bcf-98d0-15f86c779317-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.565612 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.565435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2882aa8-e6e1-4bcf-98d0-15f86c779317-crio-socket\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.565612 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.565481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rlpv\" (UniqueName: \"kubernetes.io/projected/d2882aa8-e6e1-4bcf-98d0-15f86c779317-kube-api-access-7rlpv\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.565612 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.565563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2882aa8-e6e1-4bcf-98d0-15f86c779317-data-volume\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.580626 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.580595    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bjzmz" event={"ID":"e74e2e22-71df-448b-903d-3ee4f7c5077b","Type":"ContainerStarted","Data":"d882e92698d84661e085b2b3b101798de9ac3ac9f28a949b33efbe47a12b6828"}
May 25 01:04:32.666176 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666148    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.666354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666184    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2882aa8-e6e1-4bcf-98d0-15f86c779317-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.666354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666244    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2882aa8-e6e1-4bcf-98d0-15f86c779317-crio-socket\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.666354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666268    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rlpv\" (UniqueName: \"kubernetes.io/projected/d2882aa8-e6e1-4bcf-98d0-15f86c779317-kube-api-access-7rlpv\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.666354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666302    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:32.666354 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:32.666331    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:32.666354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666343    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2882aa8-e6e1-4bcf-98d0-15f86c779317-crio-socket\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.666710 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666383    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2882aa8-e6e1-4bcf-98d0-15f86c779317-data-volume\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.666710 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:32.666396    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls podName:d2882aa8-e6e1-4bcf-98d0-15f86c779317 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:33.166376854 +0000 UTC m=+123.594587706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grsvl" (UID: "d2882aa8-e6e1-4bcf-98d0-15f86c779317") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:32.666710 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:32.666434    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:04:32.666710 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:32.666448    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589d8c58cc-zpb72: secret "image-registry-tls" not found
May 25 01:04:32.666710 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:32.666491    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls podName:2c767250-34bb-4c95-ae70-a75909b5dc39 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:40.666475766 +0000 UTC m=+131.094686621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls") pod "image-registry-589d8c58cc-zpb72" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39") : secret "image-registry-tls" not found
May 25 01:04:32.666710 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666679    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2882aa8-e6e1-4bcf-98d0-15f86c779317-data-volume\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.666907 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.666772    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2882aa8-e6e1-4bcf-98d0-15f86c779317-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.691536 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.691513    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rlpv\" (UniqueName: \"kubernetes.io/projected/d2882aa8-e6e1-4bcf-98d0-15f86c779317-kube-api-access-7rlpv\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:32.999411 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.999366    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:32.999411 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.999403    2560 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:32.999888 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:32.999776    2560 scope.go:117] "RemoveContainer" containerID="69afc7424670eef7d11de726092532d532e04c1978e98444f050c18e14747121"
May 25 01:04:33.000013 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:32.999982    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fsfz6_openshift-console-operator(6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4)\"" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6" podUID="6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4"
May 25 01:04:33.171722 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:33.171683    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:33.171875 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:33.171847    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:33.171935 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:33.171928    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls podName:d2882aa8-e6e1-4bcf-98d0-15f86c779317 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:34.171904043 +0000 UTC m=+124.600114919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grsvl" (UID: "d2882aa8-e6e1-4bcf-98d0-15f86c779317") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:34.181334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:34.181301    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:34.181728 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:34.181463    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:34.181728 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:34.181522    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls podName:d2882aa8-e6e1-4bcf-98d0-15f86c779317 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:36.181507131 +0000 UTC m=+126.609717982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grsvl" (UID: "d2882aa8-e6e1-4bcf-98d0-15f86c779317") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:34.586497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:34.586457    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bjzmz" event={"ID":"e74e2e22-71df-448b-903d-3ee4f7c5077b","Type":"ContainerStarted","Data":"b75f682437725b8a88f7fc6844a848d7ef5161959123a8edbbdab69e038e8400"}
May 25 01:04:34.605417 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:34.605376    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-bjzmz" podStartSLOduration=2.007488214 podStartE2EDuration="3.605365452s" podCreationTimestamp="2026-05-25 01:04:31 +0000 UTC" firstStartedPulling="2026-05-25 01:04:32.414384138 +0000 UTC m=+122.842595006" lastFinishedPulling="2026-05-25 01:04:34.012261393 +0000 UTC m=+124.440472244" observedRunningTime="2026-05-25 01:04:34.604357155 +0000 UTC m=+125.032568040" watchObservedRunningTime="2026-05-25 01:04:34.605365452 +0000 UTC m=+125.033576326"
May 25 01:04:36.198621 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:36.198590    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:36.199048 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:36.198698    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:36.199048 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:36.198754    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls podName:d2882aa8-e6e1-4bcf-98d0-15f86c779317 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:40.198736271 +0000 UTC m=+130.626947143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grsvl" (UID: "d2882aa8-e6e1-4bcf-98d0-15f86c779317") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:37.510800 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:37.510745    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:37.513518 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:37.513482    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24400e58-7459-418e-abcc-7c3098d1254d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-k9znz\" (UID: \"24400e58-7459-418e-abcc-7c3098d1254d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:37.608203 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:37.608169    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bhmx5\""
May 25 01:04:37.615495 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:37.615456    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"
May 25 01:04:37.747172 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:37.747130    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz"]
May 25 01:04:38.597548 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:38.597512    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz" event={"ID":"24400e58-7459-418e-abcc-7c3098d1254d","Type":"ContainerStarted","Data":"7b298e34ac34408337f10b34edd0e60598ded50a99af9182c8aaf35032659592"}
May 25 01:04:40.034931 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.034897    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:04:40.035348 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:40.035060    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 01:04:40.035348 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:40.035117    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs podName:c68b976f-c760-446d-a601-1d72941a0429 nodeName:}" failed. No retries permitted until 2026-05-25 01:06:42.035097827 +0000 UTC m=+252.463308683 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs") pod "network-metrics-daemon-zzn6w" (UID: "c68b976f-c760-446d-a601-1d72941a0429") : secret "metrics-daemon-secret" not found
May 25 01:04:40.236739 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.236644    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:40.236902 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:40.236785    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:40.236902 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:40.236860    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls podName:d2882aa8-e6e1-4bcf-98d0-15f86c779317 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:48.236844147 +0000 UTC m=+138.665054999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grsvl" (UID: "d2882aa8-e6e1-4bcf-98d0-15f86c779317") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:40.604434 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.604402    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz" event={"ID":"24400e58-7459-418e-abcc-7c3098d1254d","Type":"ContainerStarted","Data":"46574676b4c9ae1015aa9b0a4b3ee83d6e3936cfe07d0e711fbe35d531bbb3f9"}
May 25 01:04:40.604434 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.604441    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz" event={"ID":"24400e58-7459-418e-abcc-7c3098d1254d","Type":"ContainerStarted","Data":"77231e09252b7541fcb78548329ff17d095ca58590342d4fb1efd3b0db8cdb4a"}
May 25 01:04:40.621475 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.621424    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-k9znz" podStartSLOduration=17.49873892 podStartE2EDuration="19.621410725s" podCreationTimestamp="2026-05-25 01:04:21 +0000 UTC" firstStartedPulling="2026-05-25 01:04:37.7917615 +0000 UTC m=+128.219972352" lastFinishedPulling="2026-05-25 01:04:39.914433296 +0000 UTC m=+130.342644157" observedRunningTime="2026-05-25 01:04:40.620259328 +0000 UTC m=+131.048470196" watchObservedRunningTime="2026-05-25 01:04:40.621410725 +0000 UTC m=+131.049621600"
May 25 01:04:40.740128 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.740094    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:40.742626 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.742605    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"image-registry-589d8c58cc-zpb72\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") " pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:40.789210 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.789179    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8cjkp\""
May 25 01:04:40.797346 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.797325    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:40.927534 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:40.927502    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-589d8c58cc-zpb72"]
May 25 01:04:40.930463 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:04:40.930426    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c767250_34bb_4c95_ae70_a75909b5dc39.slice/crio-47c6856c243c0dfdae112dcbafd7fa27c3283cdc035c00b013bcd0b0e1dd1bd3 WatchSource:0}: Error finding container 47c6856c243c0dfdae112dcbafd7fa27c3283cdc035c00b013bcd0b0e1dd1bd3: Status 404 returned error can't find the container with id 47c6856c243c0dfdae112dcbafd7fa27c3283cdc035c00b013bcd0b0e1dd1bd3
May 25 01:04:41.608307 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:41.608268    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72" event={"ID":"2c767250-34bb-4c95-ae70-a75909b5dc39","Type":"ContainerStarted","Data":"190a6646f35589b5388c783b095548d562cbfce9418d3f4aeab9693080551057"}
May 25 01:04:41.608307 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:41.608309    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72" event={"ID":"2c767250-34bb-4c95-ae70-a75909b5dc39","Type":"ContainerStarted","Data":"47c6856c243c0dfdae112dcbafd7fa27c3283cdc035c00b013bcd0b0e1dd1bd3"}
May 25 01:04:41.627897 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:41.627855    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72" podStartSLOduration=17.627840268 podStartE2EDuration="17.627840268s" podCreationTimestamp="2026-05-25 01:04:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:04:41.62743488 +0000 UTC m=+132.055645753" watchObservedRunningTime="2026-05-25 01:04:41.627840268 +0000 UTC m=+132.056051142"
May 25 01:04:42.610928 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:42.610890    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:04:46.179347 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:46.179311    2560 scope.go:117] "RemoveContainer" containerID="69afc7424670eef7d11de726092532d532e04c1978e98444f050c18e14747121"
May 25 01:04:46.622299 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:46.622272    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:04:46.622488 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:46.622350    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6" event={"ID":"6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4","Type":"ContainerStarted","Data":"56c6bc06573b77d2105f4a6240fb77fc0690b2d9280da72dd495d6b4d39146ca"}
May 25 01:04:46.622633 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:46.622609    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:46.640213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:46.640167    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6" podStartSLOduration=22.860499022 podStartE2EDuration="24.640154413s" podCreationTimestamp="2026-05-25 01:04:22 +0000 UTC" firstStartedPulling="2026-05-25 01:04:23.133893542 +0000 UTC m=+113.562104395" lastFinishedPulling="2026-05-25 01:04:24.913548934 +0000 UTC m=+115.341759786" observedRunningTime="2026-05-25 01:04:46.638681718 +0000 UTC m=+137.066892592" watchObservedRunningTime="2026-05-25 01:04:46.640154413 +0000 UTC m=+137.068365319"
May 25 01:04:46.742335 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:46.742299    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-fsfz6"
May 25 01:04:48.300659 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:48.300611    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:48.303000 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:48.302971    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2882aa8-e6e1-4bcf-98d0-15f86c779317-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grsvl\" (UID: \"d2882aa8-e6e1-4bcf-98d0-15f86c779317\") " pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:48.351322 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:48.351291    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-grsvl"
May 25 01:04:48.480404 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:48.480370    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-grsvl"]
May 25 01:04:48.483608 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:04:48.483578    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2882aa8_e6e1_4bcf_98d0_15f86c779317.slice/crio-ba73addfb928d513fb8f710035a729bec65174b3d83da65aacd2d1380f3641a4 WatchSource:0}: Error finding container ba73addfb928d513fb8f710035a729bec65174b3d83da65aacd2d1380f3641a4: Status 404 returned error can't find the container with id ba73addfb928d513fb8f710035a729bec65174b3d83da65aacd2d1380f3641a4
May 25 01:04:48.627896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:48.627862    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-grsvl" event={"ID":"d2882aa8-e6e1-4bcf-98d0-15f86c779317","Type":"ContainerStarted","Data":"6e6d9913606ed6d4538cdb00d8e589a56cecf632d3f565e31d6ecec19d89766d"}
May 25 01:04:48.627896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:48.627898    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-grsvl" event={"ID":"d2882aa8-e6e1-4bcf-98d0-15f86c779317","Type":"ContainerStarted","Data":"ba73addfb928d513fb8f710035a729bec65174b3d83da65aacd2d1380f3641a4"}
May 25 01:04:49.631760 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:49.631725    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-grsvl" event={"ID":"d2882aa8-e6e1-4bcf-98d0-15f86c779317","Type":"ContainerStarted","Data":"5943a0f9b193c432b85b46b8b23059bab6b1e7f5342f3368850e3f919a4c3ea3"}
May 25 01:04:51.637760 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:51.637726    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-grsvl" event={"ID":"d2882aa8-e6e1-4bcf-98d0-15f86c779317","Type":"ContainerStarted","Data":"7de3d160e2364a11a4aa0c763107df2e3b5007dba85e9d4c89431038c4bc2468"}
May 25 01:04:51.667334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:51.667290    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-grsvl" podStartSLOduration=17.228032985 podStartE2EDuration="19.66727544s" podCreationTimestamp="2026-05-25 01:04:32 +0000 UTC" firstStartedPulling="2026-05-25 01:04:48.54229513 +0000 UTC m=+138.970505981" lastFinishedPulling="2026-05-25 01:04:50.98153757 +0000 UTC m=+141.409748436" observedRunningTime="2026-05-25 01:04:51.666044386 +0000 UTC m=+142.094255259" watchObservedRunningTime="2026-05-25 01:04:51.66727544 +0000 UTC m=+142.095486314"
May 25 01:04:52.558856 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.558822    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-589d8c58cc-zpb72"]
May 25 01:04:52.608555 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.608523    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cfb75474f-tc47l"]
May 25 01:04:52.612515 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.612495    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.625680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.625652    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cfb75474f-tc47l"]
May 25 01:04:52.635646 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.635623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc00fe49-bca4-47cc-8522-37ea360511e3-ca-trust-extracted\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.635771 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.635659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc00fe49-bca4-47cc-8522-37ea360511e3-registry-certificates\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.635771 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.635679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqtkl\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-kube-api-access-nqtkl\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.635838 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.635795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc00fe49-bca4-47cc-8522-37ea360511e3-installation-pull-secrets\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.635872 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.635839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc00fe49-bca4-47cc-8522-37ea360511e3-image-registry-private-configuration\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.635902 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.635882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-registry-tls\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.635930 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.635900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc00fe49-bca4-47cc-8522-37ea360511e3-trusted-ca\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.635930 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.635921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-bound-sa-token\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.736409 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.736380    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc00fe49-bca4-47cc-8522-37ea360511e3-installation-pull-secrets\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.736851 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.736419    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc00fe49-bca4-47cc-8522-37ea360511e3-image-registry-private-configuration\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.736851 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.736465    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-registry-tls\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.736851 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.736487    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc00fe49-bca4-47cc-8522-37ea360511e3-trusted-ca\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.736851 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.736511    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-bound-sa-token\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.736851 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.736561    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc00fe49-bca4-47cc-8522-37ea360511e3-ca-trust-extracted\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.736851 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.736599    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc00fe49-bca4-47cc-8522-37ea360511e3-registry-certificates\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.736851 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.736627    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqtkl\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-kube-api-access-nqtkl\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.737694 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.737668    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc00fe49-bca4-47cc-8522-37ea360511e3-registry-certificates\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.737819 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.737672    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc00fe49-bca4-47cc-8522-37ea360511e3-ca-trust-extracted\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.738208 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.738180    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc00fe49-bca4-47cc-8522-37ea360511e3-trusted-ca\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.739284 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.739261    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc00fe49-bca4-47cc-8522-37ea360511e3-image-registry-private-configuration\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.739373 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.739305    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-registry-tls\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.739424 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.739388    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc00fe49-bca4-47cc-8522-37ea360511e3-installation-pull-secrets\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.746743 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.746724    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-bound-sa-token\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.750680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.750652    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqtkl\" (UniqueName: \"kubernetes.io/projected/dc00fe49-bca4-47cc-8522-37ea360511e3-kube-api-access-nqtkl\") pod \"image-registry-cfb75474f-tc47l\" (UID: \"dc00fe49-bca4-47cc-8522-37ea360511e3\") " pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:52.921244 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:52.921200    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:53.049049 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:53.049017    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cfb75474f-tc47l"]
May 25 01:04:53.052375 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:04:53.052345    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc00fe49_bca4_47cc_8522_37ea360511e3.slice/crio-832f2f31687f218105c8308ea8c6a19b54e6f06978d1e5a05f792ab5c0e5cda8 WatchSource:0}: Error finding container 832f2f31687f218105c8308ea8c6a19b54e6f06978d1e5a05f792ab5c0e5cda8: Status 404 returned error can't find the container with id 832f2f31687f218105c8308ea8c6a19b54e6f06978d1e5a05f792ab5c0e5cda8
May 25 01:04:53.643491 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:53.643458    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfb75474f-tc47l" event={"ID":"dc00fe49-bca4-47cc-8522-37ea360511e3","Type":"ContainerStarted","Data":"fa709fb6e0218c42a21b4b5a88565b3640a1f847c5f18209999492f17d3af1d7"}
May 25 01:04:53.643491 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:53.643496    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfb75474f-tc47l" event={"ID":"dc00fe49-bca4-47cc-8522-37ea360511e3","Type":"ContainerStarted","Data":"832f2f31687f218105c8308ea8c6a19b54e6f06978d1e5a05f792ab5c0e5cda8"}
May 25 01:04:53.643708 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:53.643573    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:04:53.665265 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:53.665190    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cfb75474f-tc47l" podStartSLOduration=1.665173952 podStartE2EDuration="1.665173952s" podCreationTimestamp="2026-05-25 01:04:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:04:53.664449761 +0000 UTC m=+144.092660632" watchObservedRunningTime="2026-05-25 01:04:53.665173952 +0000 UTC m=+144.093384825"
May 25 01:04:56.834472 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.834443    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5777dcdd54-4crxh"]
May 25 01:04:56.839122 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.839102    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.841871 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.841834    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 25 01:04:56.841989 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.841954    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 25 01:04:56.841989 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.841964    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 25 01:04:56.843059 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.843045    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 25 01:04:56.843136 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.843067    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 25 01:04:56.843136 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.843079    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 25 01:04:56.843136 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.843102    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 25 01:04:56.843313 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.843154    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kv79q\""
May 25 01:04:56.846623 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.846589    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5777dcdd54-4crxh"]
May 25 01:04:56.870476 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.870447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-oauth-config\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.870476 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.870481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhf5p\" (UniqueName: \"kubernetes.io/projected/8415f925-95d0-4be4-8bfb-1f1784dbbe02-kube-api-access-hhf5p\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.870674 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.870549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-oauth-serving-cert\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.870674 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.870582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-serving-cert\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.870674 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.870603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-config\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.870674 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.870631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-service-ca\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.971338 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.971304    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-oauth-serving-cert\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.971486 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.971347    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-serving-cert\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.971486 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.971369    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-config\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.971486 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.971412    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-service-ca\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.971612 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.971486    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-oauth-config\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.971612 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.971503    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhf5p\" (UniqueName: \"kubernetes.io/projected/8415f925-95d0-4be4-8bfb-1f1784dbbe02-kube-api-access-hhf5p\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.971979 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.971958    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-config\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.972071 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.972022    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-oauth-serving-cert\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.972126 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.972104    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-service-ca\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.973910 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.973889    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-oauth-config\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.974028 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.973966    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-serving-cert\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:56.979697 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:56.979675    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhf5p\" (UniqueName: \"kubernetes.io/projected/8415f925-95d0-4be4-8bfb-1f1784dbbe02-kube-api-access-hhf5p\") pod \"console-5777dcdd54-4crxh\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") " pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:57.148337 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:57.148273    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:04:57.274776 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:57.274746    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5777dcdd54-4crxh"]
May 25 01:04:57.278435 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:04:57.278412    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8415f925_95d0_4be4_8bfb_1f1784dbbe02.slice/crio-873b67c1e036fe96a176bfb115d4403efdde2acd8359486d4b6bea307b3042fc WatchSource:0}: Error finding container 873b67c1e036fe96a176bfb115d4403efdde2acd8359486d4b6bea307b3042fc: Status 404 returned error can't find the container with id 873b67c1e036fe96a176bfb115d4403efdde2acd8359486d4b6bea307b3042fc
May 25 01:04:57.653861 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:57.653820    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5777dcdd54-4crxh" event={"ID":"8415f925-95d0-4be4-8bfb-1f1784dbbe02","Type":"ContainerStarted","Data":"873b67c1e036fe96a176bfb115d4403efdde2acd8359486d4b6bea307b3042fc"}
May 25 01:04:59.837587 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.836137    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"]
May 25 01:04:59.844181 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.844146    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.846067 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.846043    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-787h5"]
May 25 01:04:59.847444 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.847423    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 25 01:04:59.848434 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.848413    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 01:04:59.849170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.848631    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 25 01:04:59.849170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.848874    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 01:04:59.849170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.849043    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cn2qk\""
May 25 01:04:59.849170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.849158    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 01:04:59.849815 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.849796    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.851987 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.851970    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 01:04:59.852273 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.852255    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 01:04:59.852679 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.852655    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 01:04:59.853005 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.852987    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9mgnh\""
May 25 01:04:59.856562 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.856490    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"]
May 25 01:04:59.860466 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.860439    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"]
May 25 01:04:59.860628 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.860611    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.863135 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.863119    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m4486\""
May 25 01:04:59.863680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.863401    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 25 01:04:59.863680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.863177    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 25 01:04:59.863680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.863134    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 25 01:04:59.869916 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.869891    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"]
May 25 01:04:59.894587 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.894715 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.894715 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wk57\" (UniqueName: \"kubernetes.io/projected/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-api-access-5wk57\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.894715 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.894874 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-root\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.894874 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.894874 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.894874 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a57711ad-f4a9-4d82-810c-8288d5a2beee-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.894874 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-tls\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.894874 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.895155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd0f0d7-c332-4918-bac1-f0afa00b2689-metrics-client-ca\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.895155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.894960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wpp\" (UniqueName: \"kubernetes.io/projected/ccd0f0d7-c332-4918-bac1-f0afa00b2689-kube-api-access-d6wpp\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.895155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.895017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-sys\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.895155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.895046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-accelerators-collector-config\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.895155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.895078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.895155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.895136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-textfile\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.895498 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.895167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.895498 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.895200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-wtmp\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.895498 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.895241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvlds\" (UniqueName: \"kubernetes.io/projected/a57711ad-f4a9-4d82-810c-8288d5a2beee-kube-api-access-dvlds\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.996331 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996285    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-tls\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996521 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996356    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.996521 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996381    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd0f0d7-c332-4918-bac1-f0afa00b2689-metrics-client-ca\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996521 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996404    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wpp\" (UniqueName: \"kubernetes.io/projected/ccd0f0d7-c332-4918-bac1-f0afa00b2689-kube-api-access-d6wpp\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996521 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996442    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-sys\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996521 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996463    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-accelerators-collector-config\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996521 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996484    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.996521 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996504    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-textfile\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996521 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996520    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996541    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-wtmp\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996559    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvlds\" (UniqueName: \"kubernetes.io/projected/a57711ad-f4a9-4d82-810c-8288d5a2beee-kube-api-access-dvlds\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996591    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996609    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996631    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wk57\" (UniqueName: \"kubernetes.io/projected/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-api-access-5wk57\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996647    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996693    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-root\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996718    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996747    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996775    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a57711ad-f4a9-4d82-810c-8288d5a2beee-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:04:59.996821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996778    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.997213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996905    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-wtmp\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.997213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.996954    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-sys\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.997213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.997007    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccd0f0d7-c332-4918-bac1-f0afa00b2689-root\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.997389 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.997368    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd0f0d7-c332-4918-bac1-f0afa00b2689-metrics-client-ca\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.997446 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:59.996461    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 25 01:04:59.997498 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:59.997468    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-tls podName:ccd0f0d7-c332-4918-bac1-f0afa00b2689 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:00.497447838 +0000 UTC m=+150.925658710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-tls") pod "node-exporter-787h5" (UID: "ccd0f0d7-c332-4918-bac1-f0afa00b2689") : secret "node-exporter-tls" not found
May 25 01:04:59.997564 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.997496    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-accelerators-collector-config\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.997666 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:59.997080    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 25 01:04:59.997732 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:59.997701    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-tls podName:a57711ad-f4a9-4d82-810c-8288d5a2beee nodeName:}" failed. No retries permitted until 2026-05-25 01:05:00.497686604 +0000 UTC m=+150.925897480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-d2wvk" (UID: "a57711ad-f4a9-4d82-810c-8288d5a2beee") : secret "openshift-state-metrics-tls" not found
May 25 01:04:59.997732 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:59.997169    2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 25 01:04:59.997845 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:04:59.997745    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-tls podName:cf761b57-8d4a-4cb0-a96d-c14b95d29ec0 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:00.497735902 +0000 UTC m=+150.925946757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-2vsnp" (UID: "cf761b57-8d4a-4cb0-a96d-c14b95d29ec0") : secret "kube-state-metrics-tls" not found
May 25 01:04:59.997845 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.997774    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.997998 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.997975    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:04:59.998074 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.998017    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-textfile\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:04:59.998429 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.998356    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a57711ad-f4a9-4d82-810c-8288d5a2beee-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:05:00.000037 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:04:59.999996    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:05:00.000636 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.000570    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:05:00.000818 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.000767    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:05:00.016874 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.016848    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wk57\" (UniqueName: \"kubernetes.io/projected/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-api-access-5wk57\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:05:00.017696 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.017674    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wpp\" (UniqueName: \"kubernetes.io/projected/ccd0f0d7-c332-4918-bac1-f0afa00b2689-kube-api-access-d6wpp\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:05:00.017882 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.017839    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvlds\" (UniqueName: \"kubernetes.io/projected/a57711ad-f4a9-4d82-810c-8288d5a2beee-kube-api-access-dvlds\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:05:00.501718 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.501683    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:05:00.501919 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.501744    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:05:00.501919 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.501774    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-tls\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:05:00.504370 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.504336    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a57711ad-f4a9-4d82-810c-8288d5a2beee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-d2wvk\" (UID: \"a57711ad-f4a9-4d82-810c-8288d5a2beee\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:05:00.504488 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.504369    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccd0f0d7-c332-4918-bac1-f0afa00b2689-node-exporter-tls\") pod \"node-exporter-787h5\" (UID: \"ccd0f0d7-c332-4918-bac1-f0afa00b2689\") " pod="openshift-monitoring/node-exporter-787h5"
May 25 01:05:00.504488 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.504385    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf761b57-8d4a-4cb0-a96d-c14b95d29ec0-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-2vsnp\" (UID: \"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:05:00.663302 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.663264    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5777dcdd54-4crxh" event={"ID":"8415f925-95d0-4be4-8bfb-1f1784dbbe02","Type":"ContainerStarted","Data":"543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246"}
May 25 01:05:00.683616 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.683564    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5777dcdd54-4crxh" podStartSLOduration=1.687463307 podStartE2EDuration="4.683551427s" podCreationTimestamp="2026-05-25 01:04:56 +0000 UTC" firstStartedPulling="2026-05-25 01:04:57.280282445 +0000 UTC m=+147.708493297" lastFinishedPulling="2026-05-25 01:05:00.276370561 +0000 UTC m=+150.704581417" observedRunningTime="2026-05-25 01:05:00.682898067 +0000 UTC m=+151.111108941" watchObservedRunningTime="2026-05-25 01:05:00.683551427 +0000 UTC m=+151.111762301"
May 25 01:05:00.760960 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.760924    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"
May 25 01:05:00.773709 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.773685    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-787h5"
May 25 01:05:00.781401 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.781373    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"
May 25 01:05:00.781937 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:05:00.781862    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd0f0d7_c332_4918_bac1_f0afa00b2689.slice/crio-a5810378b904aaa3a05dbb73febf9066bd996e1b3b9d119e4ae12cca8829a1a6 WatchSource:0}: Error finding container a5810378b904aaa3a05dbb73febf9066bd996e1b3b9d119e4ae12cca8829a1a6: Status 404 returned error can't find the container with id a5810378b904aaa3a05dbb73febf9066bd996e1b3b9d119e4ae12cca8829a1a6
May 25 01:05:00.920055 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.919999    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk"]
May 25 01:05:00.923098 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:05:00.923058    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57711ad_f4a9_4d82_810c_8288d5a2beee.slice/crio-54a9fd1d6097a6b52bcb2110e460940c5aa21d06cadf321fb4c23ef8aa4a4fc8 WatchSource:0}: Error finding container 54a9fd1d6097a6b52bcb2110e460940c5aa21d06cadf321fb4c23ef8aa4a4fc8: Status 404 returned error can't find the container with id 54a9fd1d6097a6b52bcb2110e460940c5aa21d06cadf321fb4c23ef8aa4a4fc8
May 25 01:05:00.937615 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:00.937580    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp"]
May 25 01:05:00.940896 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:05:00.940867    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf761b57_8d4a_4cb0_a96d_c14b95d29ec0.slice/crio-d027dcee9370568ecb4db6d9f787a860c9d37b411fe8555de7327bbceb99dc5d WatchSource:0}: Error finding container d027dcee9370568ecb4db6d9f787a860c9d37b411fe8555de7327bbceb99dc5d: Status 404 returned error can't find the container with id d027dcee9370568ecb4db6d9f787a860c9d37b411fe8555de7327bbceb99dc5d
May 25 01:05:01.667213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:01.667174    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp" event={"ID":"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0","Type":"ContainerStarted","Data":"d027dcee9370568ecb4db6d9f787a860c9d37b411fe8555de7327bbceb99dc5d"}
May 25 01:05:01.668351 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:01.668324    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-787h5" event={"ID":"ccd0f0d7-c332-4918-bac1-f0afa00b2689","Type":"ContainerStarted","Data":"a5810378b904aaa3a05dbb73febf9066bd996e1b3b9d119e4ae12cca8829a1a6"}
May 25 01:05:01.670630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:01.670595    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk" event={"ID":"a57711ad-f4a9-4d82-810c-8288d5a2beee","Type":"ContainerStarted","Data":"e01000a7d8555b2eac43eb1956e1fcf99ce99b07751a29925ff0a9dc5583148b"}
May 25 01:05:01.670736 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:01.670632    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk" event={"ID":"a57711ad-f4a9-4d82-810c-8288d5a2beee","Type":"ContainerStarted","Data":"8e6e8a503c6e980edeb2cfe6639c50d572af37befd5e53893270c5e16cfc2cef"}
May 25 01:05:01.670736 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:01.670647    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk" event={"ID":"a57711ad-f4a9-4d82-810c-8288d5a2beee","Type":"ContainerStarted","Data":"54a9fd1d6097a6b52bcb2110e460940c5aa21d06cadf321fb4c23ef8aa4a4fc8"}
May 25 01:05:02.564076 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:02.564051    2560 patch_prober.go:28] interesting pod/image-registry-589d8c58cc-zpb72 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 25 01:05:02.564384 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:02.564095    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72" podUID="2c767250-34bb-4c95-ae70-a75909b5dc39" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 01:05:02.676658 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:02.676629    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp" event={"ID":"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0","Type":"ContainerStarted","Data":"5369a5782321a601012bce1f066e7d2c064efdd4c4283a20caa54c27d66f8c9b"}
May 25 01:05:02.676760 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:02.676673    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp" event={"ID":"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0","Type":"ContainerStarted","Data":"7f616ebd8cc45aa7b017926af2bb593152e347699e632fd140a67155f6e56220"}
May 25 01:05:02.678495 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:02.678470    2560 generic.go:358] "Generic (PLEG): container finished" podID="ccd0f0d7-c332-4918-bac1-f0afa00b2689" containerID="55edb10c22ca1906110475f45ea548da326eec2570cb01780129eb25e2d54062" exitCode=0
May 25 01:05:02.678908 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:02.678709    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-787h5" event={"ID":"ccd0f0d7-c332-4918-bac1-f0afa00b2689","Type":"ContainerDied","Data":"55edb10c22ca1906110475f45ea548da326eec2570cb01780129eb25e2d54062"}
May 25 01:05:02.683518 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:02.683492    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk" event={"ID":"a57711ad-f4a9-4d82-810c-8288d5a2beee","Type":"ContainerStarted","Data":"32d61b581186153462a3a9cdfb88c1ba70d60ebbaf154be39f5413725ae7ac6b"}
May 25 01:05:02.729458 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:02.729348    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-d2wvk" podStartSLOduration=2.2729321479999998 podStartE2EDuration="3.729329298s" podCreationTimestamp="2026-05-25 01:04:59 +0000 UTC" firstStartedPulling="2026-05-25 01:05:01.069837516 +0000 UTC m=+151.498048375" lastFinishedPulling="2026-05-25 01:05:02.526234659 +0000 UTC m=+152.954445525" observedRunningTime="2026-05-25 01:05:02.727553523 +0000 UTC m=+153.155764398" watchObservedRunningTime="2026-05-25 01:05:02.729329298 +0000 UTC m=+153.157540174"
May 25 01:05:03.688058 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:03.688018    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp" event={"ID":"cf761b57-8d4a-4cb0-a96d-c14b95d29ec0","Type":"ContainerStarted","Data":"59fa3dd08be0b7dcd946a214f516f74e7b0969654f06863d9f0d694a2511fa92"}
May 25 01:05:03.689888 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:03.689860    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-787h5" event={"ID":"ccd0f0d7-c332-4918-bac1-f0afa00b2689","Type":"ContainerStarted","Data":"f509587ef7ce2311165a64955289f78fc7d55d6ac8d80f524e06a409efd64947"}
May 25 01:05:03.690017 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:03.689894    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-787h5" event={"ID":"ccd0f0d7-c332-4918-bac1-f0afa00b2689","Type":"ContainerStarted","Data":"f1f1138e71c6bf7c3af23b7644efed8f16e5111698c60735536231e37af4860d"}
May 25 01:05:03.711354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:03.711304    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-2vsnp" podStartSLOduration=3.12941667 podStartE2EDuration="4.711290438s" podCreationTimestamp="2026-05-25 01:04:59 +0000 UTC" firstStartedPulling="2026-05-25 01:05:00.942702186 +0000 UTC m=+151.370913044" lastFinishedPulling="2026-05-25 01:05:02.524575956 +0000 UTC m=+152.952786812" observedRunningTime="2026-05-25 01:05:03.710305512 +0000 UTC m=+154.138516386" watchObservedRunningTime="2026-05-25 01:05:03.711290438 +0000 UTC m=+154.139501346"
May 25 01:05:03.731464 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:03.731376    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-787h5" podStartSLOduration=3.686283774 podStartE2EDuration="4.731358304s" podCreationTimestamp="2026-05-25 01:04:59 +0000 UTC" firstStartedPulling="2026-05-25 01:05:00.785467239 +0000 UTC m=+151.213678092" lastFinishedPulling="2026-05-25 01:05:01.830541766 +0000 UTC m=+152.258752622" observedRunningTime="2026-05-25 01:05:03.730940858 +0000 UTC m=+154.159151732" watchObservedRunningTime="2026-05-25 01:05:03.731358304 +0000 UTC m=+154.159569178"
May 25 01:05:04.350539 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.350500    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"]
May 25 01:05:04.353821 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.353803    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.357368 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.357341    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4puuad41i6kmc\""
May 25 01:05:04.357368 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.357358    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 25 01:05:04.357568 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.357372    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 25 01:05:04.357568 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.357444    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kks5n\""
May 25 01:05:04.357568 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.357349    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 25 01:05:04.357568 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.357343    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 25 01:05:04.364490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.364470    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"]
May 25 01:05:04.437289 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.437258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4fac08c0-389c-4dec-9f11-f230523c2c6f-metrics-server-audit-profiles\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.437289 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.437305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fac08c0-389c-4dec-9f11-f230523c2c6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.437517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.437324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4fac08c0-389c-4dec-9f11-f230523c2c6f-audit-log\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.437517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.437414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-client-ca-bundle\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.437517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.437455    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2v72\" (UniqueName: \"kubernetes.io/projected/4fac08c0-389c-4dec-9f11-f230523c2c6f-kube-api-access-g2v72\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.437517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.437507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-secret-metrics-server-tls\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.437647 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.437550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-secret-metrics-server-client-certs\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.538523 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.538488    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4fac08c0-389c-4dec-9f11-f230523c2c6f-metrics-server-audit-profiles\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.538523 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.538531    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fac08c0-389c-4dec-9f11-f230523c2c6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.538762 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.538549    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4fac08c0-389c-4dec-9f11-f230523c2c6f-audit-log\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.538762 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.538589    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-client-ca-bundle\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.538762 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.538625    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2v72\" (UniqueName: \"kubernetes.io/projected/4fac08c0-389c-4dec-9f11-f230523c2c6f-kube-api-access-g2v72\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.538762 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.538671    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-secret-metrics-server-tls\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.538762 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.538708    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-secret-metrics-server-client-certs\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.539074 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.539054    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4fac08c0-389c-4dec-9f11-f230523c2c6f-audit-log\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.539340 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.539321    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fac08c0-389c-4dec-9f11-f230523c2c6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.539836 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.539809    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4fac08c0-389c-4dec-9f11-f230523c2c6f-metrics-server-audit-profiles\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.541299 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.541276    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-secret-metrics-server-tls\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.541472 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.541454    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-client-ca-bundle\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.541528 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.541456    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4fac08c0-389c-4dec-9f11-f230523c2c6f-secret-metrics-server-client-certs\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.550455 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.550433    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2v72\" (UniqueName: \"kubernetes.io/projected/4fac08c0-389c-4dec-9f11-f230523c2c6f-kube-api-access-g2v72\") pod \"metrics-server-5ddf994cbc-zfhcr\" (UID: \"4fac08c0-389c-4dec-9f11-f230523c2c6f\") " pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.643951 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.642015    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"]
May 25 01:05:04.647308 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.647282    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:04.650239 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.650204    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-78xl2\""
May 25 01:05:04.650375 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.650354    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 25 01:05:04.655787 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.655767    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"]
May 25 01:05:04.662944 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.662926    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:04.740380 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.740349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wdgdb\" (UID: \"98b4d31a-6c9e-4cb1-953f-3b25779af278\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:04.791067 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.791038    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"]
May 25 01:05:04.796457 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:05:04.796424    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fac08c0_389c_4dec_9f11_f230523c2c6f.slice/crio-8002c27e141093233b2555f88fd4b494e29f9ccfbb69ec14d7c92e389fa011c1 WatchSource:0}: Error finding container 8002c27e141093233b2555f88fd4b494e29f9ccfbb69ec14d7c92e389fa011c1: Status 404 returned error can't find the container with id 8002c27e141093233b2555f88fd4b494e29f9ccfbb69ec14d7c92e389fa011c1
May 25 01:05:04.841137 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:04.841100    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wdgdb\" (UID: \"98b4d31a-6c9e-4cb1-953f-3b25779af278\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:04.841281 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:05:04.841214    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 25 01:05:04.841281 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:05:04.841280    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert podName:98b4d31a-6c9e-4cb1-953f-3b25779af278 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:05.341267151 +0000 UTC m=+155.769478002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-wdgdb" (UID: "98b4d31a-6c9e-4cb1-953f-3b25779af278") : secret "monitoring-plugin-cert" not found
May 25 01:05:05.346485 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:05.346449    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wdgdb\" (UID: \"98b4d31a-6c9e-4cb1-953f-3b25779af278\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:05.346689 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:05:05.346616    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 25 01:05:05.346749 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:05:05.346691    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert podName:98b4d31a-6c9e-4cb1-953f-3b25779af278 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:06.34667231 +0000 UTC m=+156.774883165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-wdgdb" (UID: "98b4d31a-6c9e-4cb1-953f-3b25779af278") : secret "monitoring-plugin-cert" not found
May 25 01:05:05.697645 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:05.697541    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr" event={"ID":"4fac08c0-389c-4dec-9f11-f230523c2c6f","Type":"ContainerStarted","Data":"8002c27e141093233b2555f88fd4b494e29f9ccfbb69ec14d7c92e389fa011c1"}
May 25 01:05:06.355598 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:06.355563    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wdgdb\" (UID: \"98b4d31a-6c9e-4cb1-953f-3b25779af278\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:06.358430 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:06.358406    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98b4d31a-6c9e-4cb1-953f-3b25779af278-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wdgdb\" (UID: \"98b4d31a-6c9e-4cb1-953f-3b25779af278\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:06.457879 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:06.457843    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:06.595318 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:06.595279    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"]
May 25 01:05:06.598361 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:05:06.598336    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b4d31a_6c9e_4cb1_953f_3b25779af278.slice/crio-8751e3632730cd319f0550708e1d800bebdf8f7baa471ab2c183d17fe6c5b70c WatchSource:0}: Error finding container 8751e3632730cd319f0550708e1d800bebdf8f7baa471ab2c183d17fe6c5b70c: Status 404 returned error can't find the container with id 8751e3632730cd319f0550708e1d800bebdf8f7baa471ab2c183d17fe6c5b70c
May 25 01:05:06.701408 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:06.701342    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr" event={"ID":"4fac08c0-389c-4dec-9f11-f230523c2c6f","Type":"ContainerStarted","Data":"121050ea55fbc553d0f17c54b74cf188210f64bbf2655a05a22fcd6ba5629ce3"}
May 25 01:05:06.702400 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:06.702370    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb" event={"ID":"98b4d31a-6c9e-4cb1-953f-3b25779af278","Type":"ContainerStarted","Data":"8751e3632730cd319f0550708e1d800bebdf8f7baa471ab2c183d17fe6c5b70c"}
May 25 01:05:06.720116 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:06.720078    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr" podStartSLOduration=1.040356655 podStartE2EDuration="2.720065114s" podCreationTimestamp="2026-05-25 01:05:04 +0000 UTC" firstStartedPulling="2026-05-25 01:05:04.798789428 +0000 UTC m=+155.227000282" lastFinishedPulling="2026-05-25 01:05:06.478497886 +0000 UTC m=+156.906708741" observedRunningTime="2026-05-25 01:05:06.719174173 +0000 UTC m=+157.147385045" watchObservedRunningTime="2026-05-25 01:05:06.720065114 +0000 UTC m=+157.148275990"
May 25 01:05:06.995331 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:05:06.995215    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-26w8p" podUID="be1ea56e-4410-4a30-b795-29c06baaa915"
May 25 01:05:07.014510 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:05:07.014468    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ncr46" podUID="d55dc3e2-2745-4fa4-9967-e88706dce19c"
May 25 01:05:07.148507 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:07.148466    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:05:07.148507 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:07.148514    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:05:07.149400 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:07.149376    2560 patch_prober.go:28] interesting pod/console-5777dcdd54-4crxh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body=
May 25 01:05:07.149518 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:07.149414    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5777dcdd54-4crxh" podUID="8415f925-95d0-4be4-8bfb-1f1784dbbe02" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused"
May 25 01:05:07.190461 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:05:07.190423    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zzn6w" podUID="c68b976f-c760-446d-a601-1d72941a0429"
May 25 01:05:07.705049 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:07.705011    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26w8p"
May 25 01:05:08.425565 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.425521    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bd7cb45d7-m47wz"]
May 25 01:05:08.430553 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.430532    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.438469 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.438446    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bd7cb45d7-m47wz"]
May 25 01:05:08.438792 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.438769    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 25 01:05:08.476152 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.476119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppl88\" (UniqueName: \"kubernetes.io/projected/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-kube-api-access-ppl88\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.476282 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.476167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-trusted-ca-bundle\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.476282 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.476202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-config\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.476354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.476312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-oauth-serving-cert\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.476397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.476385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-oauth-config\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.476443 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.476413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-service-ca\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.476485 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.476447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-serving-cert\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.577473 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.577434    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-oauth-serving-cert\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.577668 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.577528    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-oauth-config\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.577668 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.577560    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-service-ca\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.577668 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.577608    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-serving-cert\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.577831 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.577659    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppl88\" (UniqueName: \"kubernetes.io/projected/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-kube-api-access-ppl88\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.577831 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.577768    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-trusted-ca-bundle\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.577831 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.577808    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-config\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.578210 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.578180    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-oauth-serving-cert\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.578532 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.578456    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-service-ca\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.578670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.578648    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-trusted-ca-bundle\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.578670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.578660    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-config\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.580160 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.580134    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-oauth-config\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.580284 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.580209    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-serving-cert\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.585836 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.585818    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppl88\" (UniqueName: \"kubernetes.io/projected/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-kube-api-access-ppl88\") pod \"console-6bd7cb45d7-m47wz\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") " pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.709195 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.709096    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb" event={"ID":"98b4d31a-6c9e-4cb1-953f-3b25779af278","Type":"ContainerStarted","Data":"386cc60858eed0209d93b8f84a7f5681808951bdbc4e6f675bef06329b481c32"}
May 25 01:05:08.709700 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.709298    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:08.713842 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.713820    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb"
May 25 01:05:08.725666 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.725622    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wdgdb" podStartSLOduration=2.935246268 podStartE2EDuration="4.725610372s" podCreationTimestamp="2026-05-25 01:05:04 +0000 UTC" firstStartedPulling="2026-05-25 01:05:06.600152092 +0000 UTC m=+157.028362944" lastFinishedPulling="2026-05-25 01:05:08.390516179 +0000 UTC m=+158.818727048" observedRunningTime="2026-05-25 01:05:08.724596025 +0000 UTC m=+159.152806898" watchObservedRunningTime="2026-05-25 01:05:08.725610372 +0000 UTC m=+159.153821281"
May 25 01:05:08.751544 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.751515    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:08.898205 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:08.898180    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bd7cb45d7-m47wz"]
May 25 01:05:08.900542 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:05:08.900515    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c668cc0_55a7_4a7a_b5c3_64bfab47c84d.slice/crio-78329ac03c007893d691fd8aeb780ef0fe1588bfc0a8cfd9ddc198052e02d928 WatchSource:0}: Error finding container 78329ac03c007893d691fd8aeb780ef0fe1588bfc0a8cfd9ddc198052e02d928: Status 404 returned error can't find the container with id 78329ac03c007893d691fd8aeb780ef0fe1588bfc0a8cfd9ddc198052e02d928
May 25 01:05:09.713207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:09.713164    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd7cb45d7-m47wz" event={"ID":"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d","Type":"ContainerStarted","Data":"3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d"}
May 25 01:05:09.713207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:09.713206    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd7cb45d7-m47wz" event={"ID":"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d","Type":"ContainerStarted","Data":"78329ac03c007893d691fd8aeb780ef0fe1588bfc0a8cfd9ddc198052e02d928"}
May 25 01:05:09.734051 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:09.733999    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6bd7cb45d7-m47wz" podStartSLOduration=1.733971981 podStartE2EDuration="1.733971981s" podCreationTimestamp="2026-05-25 01:05:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:05:09.732867785 +0000 UTC m=+160.161078649" watchObservedRunningTime="2026-05-25 01:05:09.733971981 +0000 UTC m=+160.162182854"
May 25 01:05:11.908837 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:11.908799    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:05:11.909412 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:11.908853    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:05:11.911327 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:11.911304    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1ea56e-4410-4a30-b795-29c06baaa915-metrics-tls\") pod \"dns-default-26w8p\" (UID: \"be1ea56e-4410-4a30-b795-29c06baaa915\") " pod="openshift-dns/dns-default-26w8p"
May 25 01:05:11.911480 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:11.911462    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55dc3e2-2745-4fa4-9967-e88706dce19c-cert\") pod \"ingress-canary-ncr46\" (UID: \"d55dc3e2-2745-4fa4-9967-e88706dce19c\") " pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:05:12.208840 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:12.208755    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-clxvr\""
May 25 01:05:12.217111 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:12.217079    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26w8p"
May 25 01:05:12.342676 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:12.342648    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26w8p"]
May 25 01:05:12.346066 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:05:12.346040    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1ea56e_4410_4a30_b795_29c06baaa915.slice/crio-c1714d11b1d95d5b8d702de73ff041cd2604bd23e9c5f16be3878553ced651d2 WatchSource:0}: Error finding container c1714d11b1d95d5b8d702de73ff041cd2604bd23e9c5f16be3878553ced651d2: Status 404 returned error can't find the container with id c1714d11b1d95d5b8d702de73ff041cd2604bd23e9c5f16be3878553ced651d2
May 25 01:05:12.563782 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:12.563704    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:05:12.723875 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:12.723835    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26w8p" event={"ID":"be1ea56e-4410-4a30-b795-29c06baaa915","Type":"ContainerStarted","Data":"c1714d11b1d95d5b8d702de73ff041cd2604bd23e9c5f16be3878553ced651d2"}
May 25 01:05:12.925425 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:12.925388    2560 patch_prober.go:28] interesting pod/image-registry-cfb75474f-tc47l container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 25 01:05:12.925855 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:12.925447    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cfb75474f-tc47l" podUID="dc00fe49-bca4-47cc-8522-37ea360511e3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 01:05:13.730167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:13.730131    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26w8p" event={"ID":"be1ea56e-4410-4a30-b795-29c06baaa915","Type":"ContainerStarted","Data":"10f8dd9659ca9c5a08341c6d6f4c07bc0425c4431715b85aec1fa4ca33298cbf"}
May 25 01:05:14.650547 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:14.650518    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cfb75474f-tc47l"
May 25 01:05:14.734667 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:14.734629    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26w8p" event={"ID":"be1ea56e-4410-4a30-b795-29c06baaa915","Type":"ContainerStarted","Data":"746026f65400cac69c09c019b03b3a33786d449171892f259dc7ecd2bfd7a39c"}
May 25 01:05:14.734827 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:14.734716    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-26w8p"
May 25 01:05:14.758453 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:14.758407    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-26w8p" podStartSLOduration=130.508098528 podStartE2EDuration="2m11.758390211s" podCreationTimestamp="2026-05-25 01:03:03 +0000 UTC" firstStartedPulling="2026-05-25 01:05:12.35029861 +0000 UTC m=+162.778509465" lastFinishedPulling="2026-05-25 01:05:13.600590282 +0000 UTC m=+164.028801148" observedRunningTime="2026-05-25 01:05:14.757654536 +0000 UTC m=+165.185865411" watchObservedRunningTime="2026-05-25 01:05:14.758390211 +0000 UTC m=+165.186601085"
May 25 01:05:17.152871 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.152833    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:05:17.156899 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.156869    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:05:17.578090 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.577981    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72" podUID="2c767250-34bb-4c95-ae70-a75909b5dc39" containerName="registry" containerID="cri-o://190a6646f35589b5388c783b095548d562cbfce9418d3f4aeab9693080551057" gracePeriod=30
May 25 01:05:17.745676 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.745637    2560 generic.go:358] "Generic (PLEG): container finished" podID="2c767250-34bb-4c95-ae70-a75909b5dc39" containerID="190a6646f35589b5388c783b095548d562cbfce9418d3f4aeab9693080551057" exitCode=0
May 25 01:05:17.745819 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.745708    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72" event={"ID":"2c767250-34bb-4c95-ae70-a75909b5dc39","Type":"ContainerDied","Data":"190a6646f35589b5388c783b095548d562cbfce9418d3f4aeab9693080551057"}
May 25 01:05:17.825693 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.825668    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:05:17.964390 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964353    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-installation-pull-secrets\") pod \"2c767250-34bb-4c95-ae70-a75909b5dc39\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") "
May 25 01:05:17.964585 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964405    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-bound-sa-token\") pod \"2c767250-34bb-4c95-ae70-a75909b5dc39\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") "
May 25 01:05:17.964585 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964449    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-image-registry-private-configuration\") pod \"2c767250-34bb-4c95-ae70-a75909b5dc39\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") "
May 25 01:05:17.964585 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964473    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") pod \"2c767250-34bb-4c95-ae70-a75909b5dc39\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") "
May 25 01:05:17.964585 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964505    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-certificates\") pod \"2c767250-34bb-4c95-ae70-a75909b5dc39\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") "
May 25 01:05:17.964585 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964523    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c767250-34bb-4c95-ae70-a75909b5dc39-ca-trust-extracted\") pod \"2c767250-34bb-4c95-ae70-a75909b5dc39\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") "
May 25 01:05:17.964585 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964553    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-trusted-ca\") pod \"2c767250-34bb-4c95-ae70-a75909b5dc39\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") "
May 25 01:05:17.964893 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964599    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pljsd\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-kube-api-access-pljsd\") pod \"2c767250-34bb-4c95-ae70-a75909b5dc39\" (UID: \"2c767250-34bb-4c95-ae70-a75909b5dc39\") "
May 25 01:05:17.965128 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.964975    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c767250-34bb-4c95-ae70-a75909b5dc39" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:05:17.965128 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.965069    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-certificates\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:17.965610 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.965588    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c767250-34bb-4c95-ae70-a75909b5dc39" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:05:17.967105 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.967080    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c767250-34bb-4c95-ae70-a75909b5dc39" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:05:17.967211 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.967103    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2c767250-34bb-4c95-ae70-a75909b5dc39" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:05:17.967286 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.967215    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c767250-34bb-4c95-ae70-a75909b5dc39" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:05:17.967286 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.967210    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c767250-34bb-4c95-ae70-a75909b5dc39" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:05:17.967465 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.967444    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-kube-api-access-pljsd" (OuterVolumeSpecName: "kube-api-access-pljsd") pod "2c767250-34bb-4c95-ae70-a75909b5dc39" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39"). InnerVolumeSpecName "kube-api-access-pljsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:05:17.973577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:17.973554    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c767250-34bb-4c95-ae70-a75909b5dc39-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c767250-34bb-4c95-ae70-a75909b5dc39" (UID: "2c767250-34bb-4c95-ae70-a75909b5dc39"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:05:18.066318 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.066264    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-installation-pull-secrets\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:18.066318 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.066312    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-bound-sa-token\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:18.066318 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.066323    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c767250-34bb-4c95-ae70-a75909b5dc39-image-registry-private-configuration\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:18.066318 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.066333    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-registry-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:18.066592 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.066344    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c767250-34bb-4c95-ae70-a75909b5dc39-ca-trust-extracted\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:18.066592 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.066352    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c767250-34bb-4c95-ae70-a75909b5dc39-trusted-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:18.066592 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.066361    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pljsd\" (UniqueName: \"kubernetes.io/projected/2c767250-34bb-4c95-ae70-a75909b5dc39-kube-api-access-pljsd\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:18.749502 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.749424    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72"
May 25 01:05:18.749502 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.749433    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-589d8c58cc-zpb72" event={"ID":"2c767250-34bb-4c95-ae70-a75909b5dc39","Type":"ContainerDied","Data":"47c6856c243c0dfdae112dcbafd7fa27c3283cdc035c00b013bcd0b0e1dd1bd3"}
May 25 01:05:18.749502 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.749478    2560 scope.go:117] "RemoveContainer" containerID="190a6646f35589b5388c783b095548d562cbfce9418d3f4aeab9693080551057"
May 25 01:05:18.751707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.751683    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:18.751801 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.751735    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:18.756723 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.756703    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:18.767159 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.767121    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-589d8c58cc-zpb72"]
May 25 01:05:18.773990 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:18.773964    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-589d8c58cc-zpb72"]
May 25 01:05:19.757664 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:19.757637    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:05:19.807158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:19.807125    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5777dcdd54-4crxh"]
May 25 01:05:20.181685 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:20.181651    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c767250-34bb-4c95-ae70-a75909b5dc39" path="/var/lib/kubelet/pods/2c767250-34bb-4c95-ae70-a75909b5dc39/volumes"
May 25 01:05:22.183438 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:22.183401    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:05:22.183903 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:22.183412    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:05:22.186407 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:22.186391    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4fpd\""
May 25 01:05:22.194547 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:22.194530    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ncr46"
May 25 01:05:22.322386 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:22.320607    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ncr46"]
May 25 01:05:22.325533 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:05:22.325500    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55dc3e2_2745_4fa4_9967_e88706dce19c.slice/crio-37380ab9f56936815f94eab716db6a9cc5c0872c9ab0219b2b7d69f0bfb3f9b8 WatchSource:0}: Error finding container 37380ab9f56936815f94eab716db6a9cc5c0872c9ab0219b2b7d69f0bfb3f9b8: Status 404 returned error can't find the container with id 37380ab9f56936815f94eab716db6a9cc5c0872c9ab0219b2b7d69f0bfb3f9b8
May 25 01:05:22.763572 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:22.763524    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ncr46" event={"ID":"d55dc3e2-2745-4fa4-9967-e88706dce19c","Type":"ContainerStarted","Data":"37380ab9f56936815f94eab716db6a9cc5c0872c9ab0219b2b7d69f0bfb3f9b8"}
May 25 01:05:24.664044 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:24.664010    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:24.664044 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:24.664052    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:24.739589 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:24.739560    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-26w8p"
May 25 01:05:24.772043 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:24.772012    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ncr46" event={"ID":"d55dc3e2-2745-4fa4-9967-e88706dce19c","Type":"ContainerStarted","Data":"cfaabb7cf6ee4147f09411f06e0347f280717bcdcdc823701407f9eedb295889"}
May 25 01:05:24.789313 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:24.789253    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ncr46" podStartSLOduration=140.265012161 podStartE2EDuration="2m21.789206234s" podCreationTimestamp="2026-05-25 01:03:03 +0000 UTC" firstStartedPulling="2026-05-25 01:05:22.327508448 +0000 UTC m=+172.755719301" lastFinishedPulling="2026-05-25 01:05:23.851702515 +0000 UTC m=+174.279913374" observedRunningTime="2026-05-25 01:05:24.787481818 +0000 UTC m=+175.215692692" watchObservedRunningTime="2026-05-25 01:05:24.789206234 +0000 UTC m=+175.217417110"
May 25 01:05:33.798850 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:33.798752    2560 generic.go:358] "Generic (PLEG): container finished" podID="451af408-e043-461b-b8c1-040f69caa390" containerID="f1a67d988022acfefcf88b290c18e50b0fc286d90e52c4a9f243e85f041086a0" exitCode=0
May 25 01:05:33.798850 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:33.798824    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-rmjjk" event={"ID":"451af408-e043-461b-b8c1-040f69caa390","Type":"ContainerDied","Data":"f1a67d988022acfefcf88b290c18e50b0fc286d90e52c4a9f243e85f041086a0"}
May 25 01:05:33.799299 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:33.799211    2560 scope.go:117] "RemoveContainer" containerID="f1a67d988022acfefcf88b290c18e50b0fc286d90e52c4a9f243e85f041086a0"
May 25 01:05:34.637816 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:34.637784    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ncr46_d55dc3e2-2745-4fa4-9967-e88706dce19c/serve-healthcheck-canary/0.log"
May 25 01:05:34.803603 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:34.803566    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-rmjjk" event={"ID":"451af408-e043-461b-b8c1-040f69caa390","Type":"ContainerStarted","Data":"166892cb91a19d442f5ecab6f806a952a5d67cdef8714cd973082c1e3f913b4e"}
May 25 01:05:44.669413 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:44.669383    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:44.674427 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:44.674402    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5ddf994cbc-zfhcr"
May 25 01:05:44.828301 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:44.828262    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5777dcdd54-4crxh" podUID="8415f925-95d0-4be4-8bfb-1f1784dbbe02" containerName="console" containerID="cri-o://543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246" gracePeriod=15
May 25 01:05:45.082145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.082124    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5777dcdd54-4crxh_8415f925-95d0-4be4-8bfb-1f1784dbbe02/console/0.log"
May 25 01:05:45.082296 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.082191    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:05:45.099987 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.099851    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-service-ca\") pod \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") "
May 25 01:05:45.099987 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.099894    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-oauth-serving-cert\") pod \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") "
May 25 01:05:45.099987 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.099928    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-oauth-config\") pod \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") "
May 25 01:05:45.099987 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.099989    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhf5p\" (UniqueName: \"kubernetes.io/projected/8415f925-95d0-4be4-8bfb-1f1784dbbe02-kube-api-access-hhf5p\") pod \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") "
May 25 01:05:45.100341 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.100028    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-config\") pod \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") "
May 25 01:05:45.100341 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.100052    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-serving-cert\") pod \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\" (UID: \"8415f925-95d0-4be4-8bfb-1f1784dbbe02\") "
May 25 01:05:45.100341 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.100298    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-service-ca" (OuterVolumeSpecName: "service-ca") pod "8415f925-95d0-4be4-8bfb-1f1784dbbe02" (UID: "8415f925-95d0-4be4-8bfb-1f1784dbbe02"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:05:45.100626 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.100600    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8415f925-95d0-4be4-8bfb-1f1784dbbe02" (UID: "8415f925-95d0-4be4-8bfb-1f1784dbbe02"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:05:45.100824 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.100805    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-config" (OuterVolumeSpecName: "console-config") pod "8415f925-95d0-4be4-8bfb-1f1784dbbe02" (UID: "8415f925-95d0-4be4-8bfb-1f1784dbbe02"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:05:45.103691 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.103626    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8415f925-95d0-4be4-8bfb-1f1784dbbe02" (UID: "8415f925-95d0-4be4-8bfb-1f1784dbbe02"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:05:45.103863 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.103784    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8415f925-95d0-4be4-8bfb-1f1784dbbe02-kube-api-access-hhf5p" (OuterVolumeSpecName: "kube-api-access-hhf5p") pod "8415f925-95d0-4be4-8bfb-1f1784dbbe02" (UID: "8415f925-95d0-4be4-8bfb-1f1784dbbe02"). InnerVolumeSpecName "kube-api-access-hhf5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:05:45.103929 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.103869    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8415f925-95d0-4be4-8bfb-1f1784dbbe02" (UID: "8415f925-95d0-4be4-8bfb-1f1784dbbe02"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:05:45.201291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.201197    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhf5p\" (UniqueName: \"kubernetes.io/projected/8415f925-95d0-4be4-8bfb-1f1784dbbe02-kube-api-access-hhf5p\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:45.201291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.201245    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:45.201291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.201256    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-serving-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:45.201291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.201265    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:45.201291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.201274    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8415f925-95d0-4be4-8bfb-1f1784dbbe02-oauth-serving-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:45.201291 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.201283    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8415f925-95d0-4be4-8bfb-1f1784dbbe02-console-oauth-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:05:45.836043 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.836018    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5777dcdd54-4crxh_8415f925-95d0-4be4-8bfb-1f1784dbbe02/console/0.log"
May 25 01:05:45.836531 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.836062    2560 generic.go:358] "Generic (PLEG): container finished" podID="8415f925-95d0-4be4-8bfb-1f1784dbbe02" containerID="543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246" exitCode=2
May 25 01:05:45.836531 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.836137    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5777dcdd54-4crxh"
May 25 01:05:45.836531 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.836152    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5777dcdd54-4crxh" event={"ID":"8415f925-95d0-4be4-8bfb-1f1784dbbe02","Type":"ContainerDied","Data":"543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246"}
May 25 01:05:45.836531 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.836192    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5777dcdd54-4crxh" event={"ID":"8415f925-95d0-4be4-8bfb-1f1784dbbe02","Type":"ContainerDied","Data":"873b67c1e036fe96a176bfb115d4403efdde2acd8359486d4b6bea307b3042fc"}
May 25 01:05:45.836531 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.836212    2560 scope.go:117] "RemoveContainer" containerID="543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246"
May 25 01:05:45.846371 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.846348    2560 scope.go:117] "RemoveContainer" containerID="543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246"
May 25 01:05:45.846658 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:05:45.846631    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246\": container with ID starting with 543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246 not found: ID does not exist" containerID="543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246"
May 25 01:05:45.846741 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.846665    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246"} err="failed to get container status \"543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246\": rpc error: code = NotFound desc = could not find container \"543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246\": container with ID starting with 543ecc65139f94f2fb1c7252051bd00b9b5b3e2979967a8b95de5cd10df47246 not found: ID does not exist"
May 25 01:05:45.862721 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.862691    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5777dcdd54-4crxh"]
May 25 01:05:45.866734 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:45.866709    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5777dcdd54-4crxh"]
May 25 01:05:46.182416 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:05:46.182340    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8415f925-95d0-4be4-8bfb-1f1784dbbe02" path="/var/lib/kubelet/pods/8415f925-95d0-4be4-8bfb-1f1784dbbe02/volumes"
May 25 01:06:24.245637 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.245604    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"]
May 25 01:06:24.246207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.246034    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c767250-34bb-4c95-ae70-a75909b5dc39" containerName="registry"
May 25 01:06:24.246207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.246056    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c767250-34bb-4c95-ae70-a75909b5dc39" containerName="registry"
May 25 01:06:24.246207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.246067    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8415f925-95d0-4be4-8bfb-1f1784dbbe02" containerName="console"
May 25 01:06:24.246207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.246076    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8415f925-95d0-4be4-8bfb-1f1784dbbe02" containerName="console"
May 25 01:06:24.246207 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.246206    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="8415f925-95d0-4be4-8bfb-1f1784dbbe02" containerName="console"
May 25 01:06:24.246584 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.246238    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c767250-34bb-4c95-ae70-a75909b5dc39" containerName="registry"
May 25 01:06:24.249580 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.249559    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.252161 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.252142    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-s6nm9\""
May 25 01:06:24.252869 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.252842    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 25 01:06:24.253574 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.253554    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 25 01:06:24.253953 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.253932    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 25 01:06:24.253953 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.253932    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 25 01:06:24.254952 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.254917    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 25 01:06:24.260604 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.260585    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 25 01:06:24.264282 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.264258    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"]
May 25 01:06:24.433335 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.433295    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-metrics-client-ca\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.433335 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.433338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.433542 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.433360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-federate-client-tls\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.433542 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.433383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-telemeter-client-tls\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.433542 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.433403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvq99\" (UniqueName: \"kubernetes.io/projected/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-kube-api-access-pvq99\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.433542 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.433441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-serving-certs-ca-bundle\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.433542 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.433513    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.433703 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.433565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-secret-telemeter-client\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.534070 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.533991    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-telemeter-client-tls\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.534070 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.534025    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvq99\" (UniqueName: \"kubernetes.io/projected/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-kube-api-access-pvq99\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.534070 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.534065    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-serving-certs-ca-bundle\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.534382 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.534105    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.534382 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.534129    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-secret-telemeter-client\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.534382 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.534152    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-metrics-client-ca\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.534382 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.534196    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.534382 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.534254    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-federate-client-tls\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.535200 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.535173    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-metrics-client-ca\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.535366 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.535307    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-serving-certs-ca-bundle\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.535469 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.535442    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.536911 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.536887    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.537011 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.536997    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-federate-client-tls\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.537011 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.537001    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-secret-telemeter-client\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.537142 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.537125    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-telemeter-client-tls\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.547843 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.547822    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvq99\" (UniqueName: \"kubernetes.io/projected/d8a483d6-1cfa-4f5c-8b10-7f9b05819acc-kube-api-access-pvq99\") pod \"telemeter-client-9b8b97fb-nxjvf\" (UID: \"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc\") " pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.559589 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.559566    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"
May 25 01:06:24.693717 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.693682    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9b8b97fb-nxjvf"]
May 25 01:06:24.696867 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:06:24.696839    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a483d6_1cfa_4f5c_8b10_7f9b05819acc.slice/crio-e220f1fc80eeeec919f40be5fc8022097ddd07337b092f21dc0a350f039edf00 WatchSource:0}: Error finding container e220f1fc80eeeec919f40be5fc8022097ddd07337b092f21dc0a350f039edf00: Status 404 returned error can't find the container with id e220f1fc80eeeec919f40be5fc8022097ddd07337b092f21dc0a350f039edf00
May 25 01:06:24.944132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:24.944090    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf" event={"ID":"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc","Type":"ContainerStarted","Data":"e220f1fc80eeeec919f40be5fc8022097ddd07337b092f21dc0a350f039edf00"}
May 25 01:06:26.951372 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:26.951330    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf" event={"ID":"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc","Type":"ContainerStarted","Data":"2d39c913e5c8d686c06d45400e05e30964a32b791ec4dd6b19e7875ada971868"}
May 25 01:06:27.955960 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:27.955865    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf" event={"ID":"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc","Type":"ContainerStarted","Data":"c3ba0d3060c5a0bdc4ae2416017d12aa47fa0e29e707ce97bc99246553cdc95e"}
May 25 01:06:27.955960 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:27.955914    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf" event={"ID":"d8a483d6-1cfa-4f5c-8b10-7f9b05819acc","Type":"ContainerStarted","Data":"7e3b1032b4d90f651e5c094ce44e1b9d8dc42f64d9c4cadcd160014b4ac31e4a"}
May 25 01:06:27.983717 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:27.983666    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9b8b97fb-nxjvf" podStartSLOduration=1.10075716 podStartE2EDuration="3.983651915s" podCreationTimestamp="2026-05-25 01:06:24 +0000 UTC" firstStartedPulling="2026-05-25 01:06:24.698739667 +0000 UTC m=+235.126950520" lastFinishedPulling="2026-05-25 01:06:27.58163442 +0000 UTC m=+238.009845275" observedRunningTime="2026-05-25 01:06:27.982442442 +0000 UTC m=+238.410653317" watchObservedRunningTime="2026-05-25 01:06:27.983651915 +0000 UTC m=+238.411862789"
May 25 01:06:28.648037 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.647994    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c457f67dc-b9qw7"]
May 25 01:06:28.651425 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.651395    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.661846 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.661821    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c457f67dc-b9qw7"]
May 25 01:06:28.771110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.771074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-trusted-ca-bundle\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.771110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.771113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgk4x\" (UniqueName: \"kubernetes.io/projected/9370cd56-f9cc-4563-8bb9-187dc9793c95-kube-api-access-vgk4x\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.771334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.771164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-config\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.771334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.771247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-oauth-config\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.771334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.771298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-serving-cert\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.771334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.771319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-service-ca\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.771456 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.771355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-oauth-serving-cert\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.872795 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.872760    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-oauth-serving-cert\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.872795 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.872805    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-trusted-ca-bundle\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.873042 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.872824    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgk4x\" (UniqueName: \"kubernetes.io/projected/9370cd56-f9cc-4563-8bb9-187dc9793c95-kube-api-access-vgk4x\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.873042 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.873014    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-config\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.873122 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.873073    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-oauth-config\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.873164 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.873138    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-serving-cert\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.873214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.873167    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-service-ca\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.873570 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.873533    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-oauth-serving-cert\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.873747 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.873716    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-config\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.874035 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.873716    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-trusted-ca-bundle\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.874035 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.873830    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-service-ca\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.875705 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.875680    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-serving-cert\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.875857 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.875835    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-oauth-config\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.881466 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.881443    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgk4x\" (UniqueName: \"kubernetes.io/projected/9370cd56-f9cc-4563-8bb9-187dc9793c95-kube-api-access-vgk4x\") pod \"console-5c457f67dc-b9qw7\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") " pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:28.961632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:28.961544    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:29.089452 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:29.089367    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c457f67dc-b9qw7"]
May 25 01:06:29.092001 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:06:29.091973    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9370cd56_f9cc_4563_8bb9_187dc9793c95.slice/crio-9b58fd41f488ddb43de177dc89fde42752c241efa4a30b1208884b38f9082ad9 WatchSource:0}: Error finding container 9b58fd41f488ddb43de177dc89fde42752c241efa4a30b1208884b38f9082ad9: Status 404 returned error can't find the container with id 9b58fd41f488ddb43de177dc89fde42752c241efa4a30b1208884b38f9082ad9
May 25 01:06:29.963080 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:29.963044    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c457f67dc-b9qw7" event={"ID":"9370cd56-f9cc-4563-8bb9-187dc9793c95","Type":"ContainerStarted","Data":"434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423"}
May 25 01:06:29.963080 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:29.963083    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c457f67dc-b9qw7" event={"ID":"9370cd56-f9cc-4563-8bb9-187dc9793c95","Type":"ContainerStarted","Data":"9b58fd41f488ddb43de177dc89fde42752c241efa4a30b1208884b38f9082ad9"}
May 25 01:06:29.984420 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:29.984376    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c457f67dc-b9qw7" podStartSLOduration=1.984361715 podStartE2EDuration="1.984361715s" podCreationTimestamp="2026-05-25 01:06:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:06:29.982693168 +0000 UTC m=+240.410904042" watchObservedRunningTime="2026-05-25 01:06:29.984361715 +0000 UTC m=+240.412572588"
May 25 01:06:38.961725 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:38.961690    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:38.961725 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:38.961733    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:38.966366 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:38.966343    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:38.990454 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:38.990427    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:06:39.042365 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:39.042324    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bd7cb45d7-m47wz"]
May 25 01:06:42.079447 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:42.079399    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:06:42.081803 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:42.081777    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c68b976f-c760-446d-a601-1d72941a0429-metrics-certs\") pod \"network-metrics-daemon-zzn6w\" (UID: \"c68b976f-c760-446d-a601-1d72941a0429\") " pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:06:42.287588 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:42.287556    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8zp6\""
May 25 01:06:42.295716 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:42.295691    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzn6w"
May 25 01:06:42.420010 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:42.419976    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zzn6w"]
May 25 01:06:42.423266 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:06:42.423213    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68b976f_c760_446d_a601_1d72941a0429.slice/crio-f95a2cdf31ed246b5f60d3d44e40c2d6bc1e92a8f48b1d8eadbe48e4ff783871 WatchSource:0}: Error finding container f95a2cdf31ed246b5f60d3d44e40c2d6bc1e92a8f48b1d8eadbe48e4ff783871: Status 404 returned error can't find the container with id f95a2cdf31ed246b5f60d3d44e40c2d6bc1e92a8f48b1d8eadbe48e4ff783871
May 25 01:06:42.999201 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:42.999153    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzn6w" event={"ID":"c68b976f-c760-446d-a601-1d72941a0429","Type":"ContainerStarted","Data":"f95a2cdf31ed246b5f60d3d44e40c2d6bc1e92a8f48b1d8eadbe48e4ff783871"}
May 25 01:06:44.004046 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:44.004014    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzn6w" event={"ID":"c68b976f-c760-446d-a601-1d72941a0429","Type":"ContainerStarted","Data":"5d67e8d3cba3f0f0dd121afb38832418a4cf29ff22748aa8064847f112affe20"}
May 25 01:06:44.004046 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:44.004047    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzn6w" event={"ID":"c68b976f-c760-446d-a601-1d72941a0429","Type":"ContainerStarted","Data":"97e17542eaa475134c85034f229a1723ea90101eace0d0ed04586dae2c2445cb"}
May 25 01:06:44.021194 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:06:44.021149    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zzn6w" podStartSLOduration=252.999064577 podStartE2EDuration="4m14.021135342s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:06:42.425380944 +0000 UTC m=+252.853591811" lastFinishedPulling="2026-05-25 01:06:43.447451724 +0000 UTC m=+253.875662576" observedRunningTime="2026-05-25 01:06:44.020072906 +0000 UTC m=+254.448283792" watchObservedRunningTime="2026-05-25 01:06:44.021135342 +0000 UTC m=+254.449346216"
May 25 01:07:04.069437 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.069329    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6bd7cb45d7-m47wz" podUID="8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" containerName="console" containerID="cri-o://3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d" gracePeriod=15
May 25 01:07:04.320722 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.320661    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bd7cb45d7-m47wz_8c668cc0-55a7-4a7a-b5c3-64bfab47c84d/console/0.log"
May 25 01:07:04.320845 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.320728    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:07:04.468967 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.468926    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-serving-cert\") pod \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") "
May 25 01:07:04.469145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.468981    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-config\") pod \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") "
May 25 01:07:04.469145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469014    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-oauth-serving-cert\") pod \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") "
May 25 01:07:04.469145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469045    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-trusted-ca-bundle\") pod \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") "
May 25 01:07:04.469145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469077    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-oauth-config\") pod \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") "
May 25 01:07:04.469145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469099    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-service-ca\") pod \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") "
May 25 01:07:04.469145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469132    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppl88\" (UniqueName: \"kubernetes.io/projected/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-kube-api-access-ppl88\") pod \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\" (UID: \"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d\") "
May 25 01:07:04.469552 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469524    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-config" (OuterVolumeSpecName: "console-config") pod "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" (UID: "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:07:04.469552 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469534    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" (UID: "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:07:04.469646 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469541    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" (UID: "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:07:04.469646 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.469552    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" (UID: "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:07:04.471489 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.471455    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" (UID: "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:07:04.471489 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.471474    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-kube-api-access-ppl88" (OuterVolumeSpecName: "kube-api-access-ppl88") pod "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" (UID: "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d"). InnerVolumeSpecName "kube-api-access-ppl88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:07:04.471489 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.471475    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" (UID: "8c668cc0-55a7-4a7a-b5c3-64bfab47c84d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:07:04.570497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.570463    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-serving-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:07:04.570497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.570494    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:07:04.570497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.570504    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-oauth-serving-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:07:04.570497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.570513    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-trusted-ca-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:07:04.570782 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.570526    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-console-oauth-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:07:04.570782 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.570539    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:07:04.570782 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:04.570548    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppl88\" (UniqueName: \"kubernetes.io/projected/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d-kube-api-access-ppl88\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:07:05.064670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.064637    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bd7cb45d7-m47wz_8c668cc0-55a7-4a7a-b5c3-64bfab47c84d/console/0.log"
May 25 01:07:05.064859 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.064685    2560 generic.go:358] "Generic (PLEG): container finished" podID="8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" containerID="3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d" exitCode=2
May 25 01:07:05.064859 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.064747    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd7cb45d7-m47wz"
May 25 01:07:05.064859 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.064773    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd7cb45d7-m47wz" event={"ID":"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d","Type":"ContainerDied","Data":"3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d"}
May 25 01:07:05.064859 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.064817    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd7cb45d7-m47wz" event={"ID":"8c668cc0-55a7-4a7a-b5c3-64bfab47c84d","Type":"ContainerDied","Data":"78329ac03c007893d691fd8aeb780ef0fe1588bfc0a8cfd9ddc198052e02d928"}
May 25 01:07:05.064859 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.064833    2560 scope.go:117] "RemoveContainer" containerID="3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d"
May 25 01:07:05.073474 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.073340    2560 scope.go:117] "RemoveContainer" containerID="3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d"
May 25 01:07:05.073673 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:07:05.073642    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d\": container with ID starting with 3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d not found: ID does not exist" containerID="3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d"
May 25 01:07:05.073709 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.073664    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d"} err="failed to get container status \"3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d\": rpc error: code = NotFound desc = could not find container \"3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d\": container with ID starting with 3485b3ed8311b9b0853604f250176a9d882985da556d4f5d0428d33dd01d4a1d not found: ID does not exist"
May 25 01:07:05.086695 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.086659    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bd7cb45d7-m47wz"]
May 25 01:07:05.092805 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:05.092765    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bd7cb45d7-m47wz"]
May 25 01:07:06.182506 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:06.182473    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" path="/var/lib/kubelet/pods/8c668cc0-55a7-4a7a-b5c3-64bfab47c84d/volumes"
May 25 01:07:30.085735 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:30.085704    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:07:30.088902 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:30.088879    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:07:30.090359 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:30.090340    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:07:30.093692 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:30.093671    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:07:30.096359 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:30.096331    2560 kubelet.go:1628] "Image garbage collection succeeded"
May 25 01:07:38.508204 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.508169    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-858f87c8c9-jpp5p"]
May 25 01:07:38.510759 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.508628    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" containerName="console"
May 25 01:07:38.510759 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.508646    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" containerName="console"
May 25 01:07:38.510759 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.508714    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c668cc0-55a7-4a7a-b5c3-64bfab47c84d" containerName="console"
May 25 01:07:38.511674 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.511654    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.538063 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.538024    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858f87c8c9-jpp5p"]
May 25 01:07:38.554745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.554712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-oauth-serving-cert\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.554745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.554747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-oauth-config\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.554935 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.554834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-service-ca\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.554935 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.554886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-trusted-ca-bundle\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.554935 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.554907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-serving-cert\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.554935 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.554924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-console-config\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.555069 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.554939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbfs7\" (UniqueName: \"kubernetes.io/projected/d923c92a-be3a-4220-ac2f-b0f19151957d-kube-api-access-lbfs7\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.655952 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.655918    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-service-ca\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.655952 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.655970    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-trusted-ca-bundle\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.656267 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.655991    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-serving-cert\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.656267 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.656068    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-console-config\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.656267 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.656113    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbfs7\" (UniqueName: \"kubernetes.io/projected/d923c92a-be3a-4220-ac2f-b0f19151957d-kube-api-access-lbfs7\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.656267 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.656165    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-oauth-serving-cert\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.656460 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.656290    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-oauth-config\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.656917 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.656885    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-console-config\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.657041 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.656893    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-oauth-serving-cert\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.657041 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.656986    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-service-ca\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.657249 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.657208    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-trusted-ca-bundle\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.658823 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.658802    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-serving-cert\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.659004 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.658982    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-oauth-config\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.675555 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.675526    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbfs7\" (UniqueName: \"kubernetes.io/projected/d923c92a-be3a-4220-ac2f-b0f19151957d-kube-api-access-lbfs7\") pod \"console-858f87c8c9-jpp5p\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") " pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.821750 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.821654    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:38.969082 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.969057    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858f87c8c9-jpp5p"]
May 25 01:07:38.971506 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:07:38.971480    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd923c92a_be3a_4220_ac2f_b0f19151957d.slice/crio-7fc2ad5c519d421ec906cf7c725c34c5f0bafd7cbb5e0953d9d292428dbccf5a WatchSource:0}: Error finding container 7fc2ad5c519d421ec906cf7c725c34c5f0bafd7cbb5e0953d9d292428dbccf5a: Status 404 returned error can't find the container with id 7fc2ad5c519d421ec906cf7c725c34c5f0bafd7cbb5e0953d9d292428dbccf5a
May 25 01:07:38.973385 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:38.973359    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:07:39.173547 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:39.173509    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858f87c8c9-jpp5p" event={"ID":"d923c92a-be3a-4220-ac2f-b0f19151957d","Type":"ContainerStarted","Data":"3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad"}
May 25 01:07:39.173547 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:39.173547    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858f87c8c9-jpp5p" event={"ID":"d923c92a-be3a-4220-ac2f-b0f19151957d","Type":"ContainerStarted","Data":"7fc2ad5c519d421ec906cf7c725c34c5f0bafd7cbb5e0953d9d292428dbccf5a"}
May 25 01:07:39.199002 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:39.198944    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-858f87c8c9-jpp5p" podStartSLOduration=1.198928411 podStartE2EDuration="1.198928411s" podCreationTimestamp="2026-05-25 01:07:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:07:39.197505551 +0000 UTC m=+309.625716418" watchObservedRunningTime="2026-05-25 01:07:39.198928411 +0000 UTC m=+309.627139285"
May 25 01:07:48.822037 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:48.821987    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:48.822037 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:48.822039    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:48.826901 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:48.826877    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:49.204273 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:49.204236    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:07:49.250721 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:07:49.250689    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c457f67dc-b9qw7"]
May 25 01:08:09.371490 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.371449    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2z59s"]
May 25 01:08:09.374787 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.374768    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.377773 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.377750    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 01:08:09.390776 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.390749    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2z59s"]
May 25 01:08:09.527655 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.527614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cecc21eb-2753-4343-8511-6453a2b30417-dbus\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.527860 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.527714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cecc21eb-2753-4343-8511-6453a2b30417-kubelet-config\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.527860 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.527753    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cecc21eb-2753-4343-8511-6453a2b30417-original-pull-secret\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.629255 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.629124    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cecc21eb-2753-4343-8511-6453a2b30417-kubelet-config\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.629255 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.629200    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cecc21eb-2753-4343-8511-6453a2b30417-original-pull-secret\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.629446 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.629283    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cecc21eb-2753-4343-8511-6453a2b30417-dbus\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.629446 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.629299    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cecc21eb-2753-4343-8511-6453a2b30417-kubelet-config\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.629540 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.629473    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cecc21eb-2753-4343-8511-6453a2b30417-dbus\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.631684 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.631656    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cecc21eb-2753-4343-8511-6453a2b30417-original-pull-secret\") pod \"global-pull-secret-syncer-2z59s\" (UID: \"cecc21eb-2753-4343-8511-6453a2b30417\") " pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.683869 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.683819    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2z59s"
May 25 01:08:09.815623 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:09.815589    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2z59s"]
May 25 01:08:09.818750 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:08:09.818708    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecc21eb_2753_4343_8511_6453a2b30417.slice/crio-74c98548d97ac04ea21a0db010f4d9fc7c2600bfde55e1ff905003201467bb84 WatchSource:0}: Error finding container 74c98548d97ac04ea21a0db010f4d9fc7c2600bfde55e1ff905003201467bb84: Status 404 returned error can't find the container with id 74c98548d97ac04ea21a0db010f4d9fc7c2600bfde55e1ff905003201467bb84
May 25 01:08:10.260423 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:10.260377    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2z59s" event={"ID":"cecc21eb-2753-4343-8511-6453a2b30417","Type":"ContainerStarted","Data":"74c98548d97ac04ea21a0db010f4d9fc7c2600bfde55e1ff905003201467bb84"}
May 25 01:08:14.271251 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.271186    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c457f67dc-b9qw7" podUID="9370cd56-f9cc-4563-8bb9-187dc9793c95" containerName="console" containerID="cri-o://434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423" gracePeriod=15
May 25 01:08:14.273771 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.273745    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2z59s" event={"ID":"cecc21eb-2753-4343-8511-6453a2b30417","Type":"ContainerStarted","Data":"22ec6dda88c9c307827dbf44f6aadc3a02b6393667890fb8b0cd9c8db791e10c"}
May 25 01:08:14.290762 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.290717    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2z59s" podStartSLOduration=1.399585782 podStartE2EDuration="5.290702267s" podCreationTimestamp="2026-05-25 01:08:09 +0000 UTC" firstStartedPulling="2026-05-25 01:08:09.820344273 +0000 UTC m=+340.248555129" lastFinishedPulling="2026-05-25 01:08:13.711460762 +0000 UTC m=+344.139671614" observedRunningTime="2026-05-25 01:08:14.288501904 +0000 UTC m=+344.716712779" watchObservedRunningTime="2026-05-25 01:08:14.290702267 +0000 UTC m=+344.718913140"
May 25 01:08:14.516289 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.516264    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c457f67dc-b9qw7_9370cd56-f9cc-4563-8bb9-187dc9793c95/console/0.log"
May 25 01:08:14.516435 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.516362    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:08:14.570747 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.570629    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-serving-cert\") pod \"9370cd56-f9cc-4563-8bb9-187dc9793c95\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") "
May 25 01:08:14.570747 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.570675    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgk4x\" (UniqueName: \"kubernetes.io/projected/9370cd56-f9cc-4563-8bb9-187dc9793c95-kube-api-access-vgk4x\") pod \"9370cd56-f9cc-4563-8bb9-187dc9793c95\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") "
May 25 01:08:14.570747 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.570719    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-config\") pod \"9370cd56-f9cc-4563-8bb9-187dc9793c95\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") "
May 25 01:08:14.571057 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.570769    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-oauth-config\") pod \"9370cd56-f9cc-4563-8bb9-187dc9793c95\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") "
May 25 01:08:14.571057 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.570805    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-oauth-serving-cert\") pod \"9370cd56-f9cc-4563-8bb9-187dc9793c95\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") "
May 25 01:08:14.571057 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.570831    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-trusted-ca-bundle\") pod \"9370cd56-f9cc-4563-8bb9-187dc9793c95\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") "
May 25 01:08:14.571057 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.570874    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-service-ca\") pod \"9370cd56-f9cc-4563-8bb9-187dc9793c95\" (UID: \"9370cd56-f9cc-4563-8bb9-187dc9793c95\") "
May 25 01:08:14.571292 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.571196    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-config" (OuterVolumeSpecName: "console-config") pod "9370cd56-f9cc-4563-8bb9-187dc9793c95" (UID: "9370cd56-f9cc-4563-8bb9-187dc9793c95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:08:14.571363 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.571333    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9370cd56-f9cc-4563-8bb9-187dc9793c95" (UID: "9370cd56-f9cc-4563-8bb9-187dc9793c95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:08:14.571446 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.571420    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-service-ca" (OuterVolumeSpecName: "service-ca") pod "9370cd56-f9cc-4563-8bb9-187dc9793c95" (UID: "9370cd56-f9cc-4563-8bb9-187dc9793c95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:08:14.571556 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.571435    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9370cd56-f9cc-4563-8bb9-187dc9793c95" (UID: "9370cd56-f9cc-4563-8bb9-187dc9793c95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:08:14.573548 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.573513    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9370cd56-f9cc-4563-8bb9-187dc9793c95-kube-api-access-vgk4x" (OuterVolumeSpecName: "kube-api-access-vgk4x") pod "9370cd56-f9cc-4563-8bb9-187dc9793c95" (UID: "9370cd56-f9cc-4563-8bb9-187dc9793c95"). InnerVolumeSpecName "kube-api-access-vgk4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:08:14.573548 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.573514    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9370cd56-f9cc-4563-8bb9-187dc9793c95" (UID: "9370cd56-f9cc-4563-8bb9-187dc9793c95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:08:14.573729 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.573566    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9370cd56-f9cc-4563-8bb9-187dc9793c95" (UID: "9370cd56-f9cc-4563-8bb9-187dc9793c95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:08:14.671729 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.671694    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-oauth-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:08:14.671729 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.671724    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-oauth-serving-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:08:14.671729 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.671734    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-trusted-ca-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:08:14.671956 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.671745    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:08:14.671956 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.671754    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-serving-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:08:14.671956 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.671763    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgk4x\" (UniqueName: \"kubernetes.io/projected/9370cd56-f9cc-4563-8bb9-187dc9793c95-kube-api-access-vgk4x\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:08:14.671956 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:14.671772    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9370cd56-f9cc-4563-8bb9-187dc9793c95-console-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:08:15.277591 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.277562    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c457f67dc-b9qw7_9370cd56-f9cc-4563-8bb9-187dc9793c95/console/0.log"
May 25 01:08:15.278042 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.277600    2560 generic.go:358] "Generic (PLEG): container finished" podID="9370cd56-f9cc-4563-8bb9-187dc9793c95" containerID="434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423" exitCode=2
May 25 01:08:15.278042 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.277631    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c457f67dc-b9qw7" event={"ID":"9370cd56-f9cc-4563-8bb9-187dc9793c95","Type":"ContainerDied","Data":"434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423"}
May 25 01:08:15.278042 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.277666    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c457f67dc-b9qw7"
May 25 01:08:15.278042 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.277678    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c457f67dc-b9qw7" event={"ID":"9370cd56-f9cc-4563-8bb9-187dc9793c95","Type":"ContainerDied","Data":"9b58fd41f488ddb43de177dc89fde42752c241efa4a30b1208884b38f9082ad9"}
May 25 01:08:15.278042 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.277699    2560 scope.go:117] "RemoveContainer" containerID="434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423"
May 25 01:08:15.286747 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.286731    2560 scope.go:117] "RemoveContainer" containerID="434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423"
May 25 01:08:15.286999 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:08:15.286984    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423\": container with ID starting with 434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423 not found: ID does not exist" containerID="434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423"
May 25 01:08:15.287039 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.287010    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423"} err="failed to get container status \"434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423\": rpc error: code = NotFound desc = could not find container \"434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423\": container with ID starting with 434e07d34c03150436389fe8cac0040ca288cc302e4a2e2734354f8f2eda3423 not found: ID does not exist"
May 25 01:08:15.299293 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.299257    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c457f67dc-b9qw7"]
May 25 01:08:15.302944 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:15.302911    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c457f67dc-b9qw7"]
May 25 01:08:16.182293 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:16.182254    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9370cd56-f9cc-4563-8bb9-187dc9793c95" path="/var/lib/kubelet/pods/9370cd56-f9cc-4563-8bb9-187dc9793c95/volumes"
May 25 01:08:49.210891 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.210855    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"]
May 25 01:08:49.211389 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.211153    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9370cd56-f9cc-4563-8bb9-187dc9793c95" containerName="console"
May 25 01:08:49.211389 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.211163    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9370cd56-f9cc-4563-8bb9-187dc9793c95" containerName="console"
May 25 01:08:49.211389 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.211262    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9370cd56-f9cc-4563-8bb9-187dc9793c95" containerName="console"
May 25 01:08:49.214160 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.214142    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.216789 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.216767    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 25 01:08:49.216921 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.216772    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 25 01:08:49.216921 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.216837    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqxrz\""
May 25 01:08:49.222188 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.222165    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"]
May 25 01:08:49.362443 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.362409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.362657 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.362465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.362657 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.362570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dfpj\" (UniqueName: \"kubernetes.io/projected/78679ff4-da13-43af-8ddd-fa842748831c-kube-api-access-9dfpj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.463664 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.463557    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.463664 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.463621    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.463897 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.463684    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dfpj\" (UniqueName: \"kubernetes.io/projected/78679ff4-da13-43af-8ddd-fa842748831c-kube-api-access-9dfpj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.463961 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.463939    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.464052 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.464031    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.472763 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.472734    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dfpj\" (UniqueName: \"kubernetes.io/projected/78679ff4-da13-43af-8ddd-fa842748831c-kube-api-access-9dfpj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.523921 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.523878    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:08:49.655081 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:49.654934    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"]
May 25 01:08:49.657823 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:08:49.657791    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78679ff4_da13_43af_8ddd_fa842748831c.slice/crio-b96083d277f03d35db60baf329de70f53ffd5494e9ea227047a39645ec7c4473 WatchSource:0}: Error finding container b96083d277f03d35db60baf329de70f53ffd5494e9ea227047a39645ec7c4473: Status 404 returned error can't find the container with id b96083d277f03d35db60baf329de70f53ffd5494e9ea227047a39645ec7c4473
May 25 01:08:50.379169 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:50.379120    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg" event={"ID":"78679ff4-da13-43af-8ddd-fa842748831c","Type":"ContainerStarted","Data":"b96083d277f03d35db60baf329de70f53ffd5494e9ea227047a39645ec7c4473"}
May 25 01:08:55.394030 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:55.393933    2560 generic.go:358] "Generic (PLEG): container finished" podID="78679ff4-da13-43af-8ddd-fa842748831c" containerID="c4c54b07528c10deecf10c076709ddffccc4ea9ba8508966895253093f4ee5b7" exitCode=0
May 25 01:08:55.394030 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:55.394020    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg" event={"ID":"78679ff4-da13-43af-8ddd-fa842748831c","Type":"ContainerDied","Data":"c4c54b07528c10deecf10c076709ddffccc4ea9ba8508966895253093f4ee5b7"}
May 25 01:08:58.404996 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:58.404960    2560 generic.go:358] "Generic (PLEG): container finished" podID="78679ff4-da13-43af-8ddd-fa842748831c" containerID="2c5a785d1dcb87272ac5cc29a4386af628fe166b7e05273fb18fb88245ac91ed" exitCode=0
May 25 01:08:58.405413 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:08:58.405057    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg" event={"ID":"78679ff4-da13-43af-8ddd-fa842748831c","Type":"ContainerDied","Data":"2c5a785d1dcb87272ac5cc29a4386af628fe166b7e05273fb18fb88245ac91ed"}
May 25 01:09:06.434570 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:06.434530    2560 generic.go:358] "Generic (PLEG): container finished" podID="78679ff4-da13-43af-8ddd-fa842748831c" containerID="80150bdd3c60923572670818141d1bec9aa14b6c25f513c20e3d0205705ad2e0" exitCode=0
May 25 01:09:06.435048 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:06.434578    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg" event={"ID":"78679ff4-da13-43af-8ddd-fa842748831c","Type":"ContainerDied","Data":"80150bdd3c60923572670818141d1bec9aa14b6c25f513c20e3d0205705ad2e0"}
May 25 01:09:07.570617 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.570592    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:09:07.726025 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.725928    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-util\") pod \"78679ff4-da13-43af-8ddd-fa842748831c\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") "
May 25 01:09:07.726025 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.726008    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dfpj\" (UniqueName: \"kubernetes.io/projected/78679ff4-da13-43af-8ddd-fa842748831c-kube-api-access-9dfpj\") pod \"78679ff4-da13-43af-8ddd-fa842748831c\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") "
May 25 01:09:07.726287 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.726040    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-bundle\") pod \"78679ff4-da13-43af-8ddd-fa842748831c\" (UID: \"78679ff4-da13-43af-8ddd-fa842748831c\") "
May 25 01:09:07.726720 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.726691    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-bundle" (OuterVolumeSpecName: "bundle") pod "78679ff4-da13-43af-8ddd-fa842748831c" (UID: "78679ff4-da13-43af-8ddd-fa842748831c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:09:07.728478 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.728449    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78679ff4-da13-43af-8ddd-fa842748831c-kube-api-access-9dfpj" (OuterVolumeSpecName: "kube-api-access-9dfpj") pod "78679ff4-da13-43af-8ddd-fa842748831c" (UID: "78679ff4-da13-43af-8ddd-fa842748831c"). InnerVolumeSpecName "kube-api-access-9dfpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:09:07.730313 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.730291    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-util" (OuterVolumeSpecName: "util") pod "78679ff4-da13-43af-8ddd-fa842748831c" (UID: "78679ff4-da13-43af-8ddd-fa842748831c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:09:07.826961 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.826921    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:07.826961 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.826956    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dfpj\" (UniqueName: \"kubernetes.io/projected/78679ff4-da13-43af-8ddd-fa842748831c-kube-api-access-9dfpj\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:07.826961 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:07.826967    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78679ff4-da13-43af-8ddd-fa842748831c-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:08.442684 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:08.442590    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg" event={"ID":"78679ff4-da13-43af-8ddd-fa842748831c","Type":"ContainerDied","Data":"b96083d277f03d35db60baf329de70f53ffd5494e9ea227047a39645ec7c4473"}
May 25 01:09:08.442684 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:08.442626    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b96083d277f03d35db60baf329de70f53ffd5494e9ea227047a39645ec7c4473"
May 25 01:09:08.442684 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:08.442635    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8pffg"
May 25 01:09:12.394272 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.394187    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"]
May 25 01:09:12.394745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.394586    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78679ff4-da13-43af-8ddd-fa842748831c" containerName="util"
May 25 01:09:12.394745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.394602    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="78679ff4-da13-43af-8ddd-fa842748831c" containerName="util"
May 25 01:09:12.394745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.394611    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78679ff4-da13-43af-8ddd-fa842748831c" containerName="extract"
May 25 01:09:12.394745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.394617    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="78679ff4-da13-43af-8ddd-fa842748831c" containerName="extract"
May 25 01:09:12.394745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.394636    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78679ff4-da13-43af-8ddd-fa842748831c" containerName="pull"
May 25 01:09:12.394745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.394641    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="78679ff4-da13-43af-8ddd-fa842748831c" containerName="pull"
May 25 01:09:12.394745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.394705    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="78679ff4-da13-43af-8ddd-fa842748831c" containerName="extract"
May 25 01:09:12.398893 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.398871    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"
May 25 01:09:12.421668 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.421638    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 25 01:09:12.421804 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.421681    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 25 01:09:12.433810 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.433791    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mlqlw\""
May 25 01:09:12.443693 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.443663    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"]
May 25 01:09:12.464752 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.464717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89fb06a8-4941-463e-a832-be155b5eb45a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-lb2zw\" (UID: \"89fb06a8-4941-463e-a832-be155b5eb45a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"
May 25 01:09:12.464940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.464756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f7n7\" (UniqueName: \"kubernetes.io/projected/89fb06a8-4941-463e-a832-be155b5eb45a-kube-api-access-6f7n7\") pod \"cert-manager-operator-controller-manager-54b9655956-lb2zw\" (UID: \"89fb06a8-4941-463e-a832-be155b5eb45a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"
May 25 01:09:12.566052 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.566010    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89fb06a8-4941-463e-a832-be155b5eb45a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-lb2zw\" (UID: \"89fb06a8-4941-463e-a832-be155b5eb45a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"
May 25 01:09:12.566265 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.566060    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6f7n7\" (UniqueName: \"kubernetes.io/projected/89fb06a8-4941-463e-a832-be155b5eb45a-kube-api-access-6f7n7\") pod \"cert-manager-operator-controller-manager-54b9655956-lb2zw\" (UID: \"89fb06a8-4941-463e-a832-be155b5eb45a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"
May 25 01:09:12.566453 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.566430    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89fb06a8-4941-463e-a832-be155b5eb45a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-lb2zw\" (UID: \"89fb06a8-4941-463e-a832-be155b5eb45a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"
May 25 01:09:12.577704 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.577679    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f7n7\" (UniqueName: \"kubernetes.io/projected/89fb06a8-4941-463e-a832-be155b5eb45a-kube-api-access-6f7n7\") pod \"cert-manager-operator-controller-manager-54b9655956-lb2zw\" (UID: \"89fb06a8-4941-463e-a832-be155b5eb45a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"
May 25 01:09:12.707838 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.707744    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"
May 25 01:09:12.860616 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:12.860507    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw"]
May 25 01:09:12.863121 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:09:12.863090    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fb06a8_4941_463e_a832_be155b5eb45a.slice/crio-de36c6b76234ab2a7d265f07dbb91002a9bca943f1b48e65fce5565e15f2ac4e WatchSource:0}: Error finding container de36c6b76234ab2a7d265f07dbb91002a9bca943f1b48e65fce5565e15f2ac4e: Status 404 returned error can't find the container with id de36c6b76234ab2a7d265f07dbb91002a9bca943f1b48e65fce5565e15f2ac4e
May 25 01:09:13.459970 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:13.459930    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw" event={"ID":"89fb06a8-4941-463e-a832-be155b5eb45a","Type":"ContainerStarted","Data":"de36c6b76234ab2a7d265f07dbb91002a9bca943f1b48e65fce5565e15f2ac4e"}
May 25 01:09:15.469672 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:15.469631    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw" event={"ID":"89fb06a8-4941-463e-a832-be155b5eb45a","Type":"ContainerStarted","Data":"05cdef3eda5712d5648e92f4921c19217c3b9beec39248df49cf272cb0a29450"}
May 25 01:09:15.544294 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:15.544216    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lb2zw" podStartSLOduration=1.759348026 podStartE2EDuration="3.544199693s" podCreationTimestamp="2026-05-25 01:09:12 +0000 UTC" firstStartedPulling="2026-05-25 01:09:12.865652349 +0000 UTC m=+403.293863201" lastFinishedPulling="2026-05-25 01:09:14.650504016 +0000 UTC m=+405.078714868" observedRunningTime="2026-05-25 01:09:15.542968871 +0000 UTC m=+405.971179748" watchObservedRunningTime="2026-05-25 01:09:15.544199693 +0000 UTC m=+405.972410567"
May 25 01:09:16.930175 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:16.930132    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"]
May 25 01:09:16.933804 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:16.933780    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:16.936481 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:16.936453    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 25 01:09:16.937212 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:16.937193    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 25 01:09:16.937429 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:16.937195    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqxrz\""
May 25 01:09:16.945517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:16.945496    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"]
May 25 01:09:17.000807 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.000765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.000987 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.000829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4vx7\" (UniqueName: \"kubernetes.io/projected/6f851413-265f-4824-a4d9-d8acc769c606-kube-api-access-s4vx7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.000987 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.000920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.101509 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.101474    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4vx7\" (UniqueName: \"kubernetes.io/projected/6f851413-265f-4824-a4d9-d8acc769c606-kube-api-access-s4vx7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.101671 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.101550    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.101671 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.101619    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.101965 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.101944    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.102029 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.102012    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.110459 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.110432    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4vx7\" (UniqueName: \"kubernetes.io/projected/6f851413-265f-4824-a4d9-d8acc769c606-kube-api-access-s4vx7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.122610 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.122579    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-q9cfl"]
May 25 01:09:17.125929 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.125913    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:17.128419 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.128401    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 25 01:09:17.128509 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.128442    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 25 01:09:17.128509 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.128489    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cxs27\""
May 25 01:09:17.135045 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.135024    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-q9cfl"]
May 25 01:09:17.202504 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.202406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpcg8\" (UniqueName: \"kubernetes.io/projected/c2f9504e-bcd7-4e8d-a98d-92e9428a24ff-kube-api-access-kpcg8\") pod \"cert-manager-webhook-587ccfb98-q9cfl\" (UID: \"c2f9504e-bcd7-4e8d-a98d-92e9428a24ff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:17.202504 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.202452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2f9504e-bcd7-4e8d-a98d-92e9428a24ff-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-q9cfl\" (UID: \"c2f9504e-bcd7-4e8d-a98d-92e9428a24ff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:17.242865 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.242817    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:17.303908 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.303864    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpcg8\" (UniqueName: \"kubernetes.io/projected/c2f9504e-bcd7-4e8d-a98d-92e9428a24ff-kube-api-access-kpcg8\") pod \"cert-manager-webhook-587ccfb98-q9cfl\" (UID: \"c2f9504e-bcd7-4e8d-a98d-92e9428a24ff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:17.304127 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.303927    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2f9504e-bcd7-4e8d-a98d-92e9428a24ff-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-q9cfl\" (UID: \"c2f9504e-bcd7-4e8d-a98d-92e9428a24ff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:17.313387 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.313340    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpcg8\" (UniqueName: \"kubernetes.io/projected/c2f9504e-bcd7-4e8d-a98d-92e9428a24ff-kube-api-access-kpcg8\") pod \"cert-manager-webhook-587ccfb98-q9cfl\" (UID: \"c2f9504e-bcd7-4e8d-a98d-92e9428a24ff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:17.313794 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.313776    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2f9504e-bcd7-4e8d-a98d-92e9428a24ff-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-q9cfl\" (UID: \"c2f9504e-bcd7-4e8d-a98d-92e9428a24ff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:17.376794 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.376760    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"]
May 25 01:09:17.378623 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:09:17.378598    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f851413_265f_4824_a4d9_d8acc769c606.slice/crio-f99a928cb40029a835d1a92776a98d56e3a117462447c694c6da0aa3be6d9945 WatchSource:0}: Error finding container f99a928cb40029a835d1a92776a98d56e3a117462447c694c6da0aa3be6d9945: Status 404 returned error can't find the container with id f99a928cb40029a835d1a92776a98d56e3a117462447c694c6da0aa3be6d9945
May 25 01:09:17.443897 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.443868    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:17.480491 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.480451    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4" event={"ID":"6f851413-265f-4824-a4d9-d8acc769c606","Type":"ContainerStarted","Data":"98da2a91fcd2ab3168e886548ffe527f8fa2a3cf75a2bc0cf448e94813be7507"}
May 25 01:09:17.480641 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.480503    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4" event={"ID":"6f851413-265f-4824-a4d9-d8acc769c606","Type":"ContainerStarted","Data":"f99a928cb40029a835d1a92776a98d56e3a117462447c694c6da0aa3be6d9945"}
May 25 01:09:17.572330 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:17.572299    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-q9cfl"]
May 25 01:09:17.574725 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:09:17.574700    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2f9504e_bcd7_4e8d_a98d_92e9428a24ff.slice/crio-06a58b66481df5c82ce814e3deae5d0738eab170814b14774f8c2dd3c6f0248d WatchSource:0}: Error finding container 06a58b66481df5c82ce814e3deae5d0738eab170814b14774f8c2dd3c6f0248d: Status 404 returned error can't find the container with id 06a58b66481df5c82ce814e3deae5d0738eab170814b14774f8c2dd3c6f0248d
May 25 01:09:18.485759 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:18.485725    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl" event={"ID":"c2f9504e-bcd7-4e8d-a98d-92e9428a24ff","Type":"ContainerStarted","Data":"06a58b66481df5c82ce814e3deae5d0738eab170814b14774f8c2dd3c6f0248d"}
May 25 01:09:18.488055 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:18.488013    2560 generic.go:358] "Generic (PLEG): container finished" podID="6f851413-265f-4824-a4d9-d8acc769c606" containerID="98da2a91fcd2ab3168e886548ffe527f8fa2a3cf75a2bc0cf448e94813be7507" exitCode=0
May 25 01:09:18.488181 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:18.488048    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4" event={"ID":"6f851413-265f-4824-a4d9-d8acc769c606","Type":"ContainerDied","Data":"98da2a91fcd2ab3168e886548ffe527f8fa2a3cf75a2bc0cf448e94813be7507"}
May 25 01:09:21.068963 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.068926    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6hktk"]
May 25 01:09:21.072410 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.072390    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk"
May 25 01:09:21.076344 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.076316    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-b4lgx\""
May 25 01:09:21.089942 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.089913    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6hktk"]
May 25 01:09:21.138379 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.138323    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpd26\" (UniqueName: \"kubernetes.io/projected/815f1e4a-2ee7-4f10-b514-46587ec68eb2-kube-api-access-gpd26\") pod \"cert-manager-cainjector-68b757865b-6hktk\" (UID: \"815f1e4a-2ee7-4f10-b514-46587ec68eb2\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk"
May 25 01:09:21.138628 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.138484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/815f1e4a-2ee7-4f10-b514-46587ec68eb2-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6hktk\" (UID: \"815f1e4a-2ee7-4f10-b514-46587ec68eb2\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk"
May 25 01:09:21.239790 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.239747    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpd26\" (UniqueName: \"kubernetes.io/projected/815f1e4a-2ee7-4f10-b514-46587ec68eb2-kube-api-access-gpd26\") pod \"cert-manager-cainjector-68b757865b-6hktk\" (UID: \"815f1e4a-2ee7-4f10-b514-46587ec68eb2\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk"
May 25 01:09:21.239984 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.239876    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/815f1e4a-2ee7-4f10-b514-46587ec68eb2-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6hktk\" (UID: \"815f1e4a-2ee7-4f10-b514-46587ec68eb2\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk"
May 25 01:09:21.250904 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.250874    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/815f1e4a-2ee7-4f10-b514-46587ec68eb2-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6hktk\" (UID: \"815f1e4a-2ee7-4f10-b514-46587ec68eb2\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk"
May 25 01:09:21.251079 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.250995    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpd26\" (UniqueName: \"kubernetes.io/projected/815f1e4a-2ee7-4f10-b514-46587ec68eb2-kube-api-access-gpd26\") pod \"cert-manager-cainjector-68b757865b-6hktk\" (UID: \"815f1e4a-2ee7-4f10-b514-46587ec68eb2\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk"
May 25 01:09:21.383148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.383106    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk"
May 25 01:09:21.603030 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:21.602997    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6hktk"]
May 25 01:09:21.653178 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:09:21.653095    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod815f1e4a_2ee7_4f10_b514_46587ec68eb2.slice/crio-9b9547b737d13461ae4cd7fb9a6b6c3b34f76b8dcba1ecfeb56b026633b8124f WatchSource:0}: Error finding container 9b9547b737d13461ae4cd7fb9a6b6c3b34f76b8dcba1ecfeb56b026633b8124f: Status 404 returned error can't find the container with id 9b9547b737d13461ae4cd7fb9a6b6c3b34f76b8dcba1ecfeb56b026633b8124f
May 25 01:09:22.504187 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:22.504147    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk" event={"ID":"815f1e4a-2ee7-4f10-b514-46587ec68eb2","Type":"ContainerStarted","Data":"204594eb5797d5ed5cda0ae0f9b3fb6e4be2ba1095c2d71a92465de1788937a5"}
May 25 01:09:22.504187 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:22.504190    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk" event={"ID":"815f1e4a-2ee7-4f10-b514-46587ec68eb2","Type":"ContainerStarted","Data":"9b9547b737d13461ae4cd7fb9a6b6c3b34f76b8dcba1ecfeb56b026633b8124f"}
May 25 01:09:22.505510 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:22.505484    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl" event={"ID":"c2f9504e-bcd7-4e8d-a98d-92e9428a24ff","Type":"ContainerStarted","Data":"7c3a4c5710dfc9f5071f9080a7a402cf6859bc21ba46f5c4f5ead9b4e016e904"}
May 25 01:09:22.505646 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:22.505539    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:22.506957 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:22.506932    2560 generic.go:358] "Generic (PLEG): container finished" podID="6f851413-265f-4824-a4d9-d8acc769c606" containerID="c30fb29bada7286288c5622611a1efd980cb456d6d4eb778c37e2ea471eef21c" exitCode=0
May 25 01:09:22.507045 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:22.506986    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4" event={"ID":"6f851413-265f-4824-a4d9-d8acc769c606","Type":"ContainerDied","Data":"c30fb29bada7286288c5622611a1efd980cb456d6d4eb778c37e2ea471eef21c"}
May 25 01:09:22.524874 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:22.524824    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-6hktk" podStartSLOduration=1.5248112900000002 podStartE2EDuration="1.52481129s" podCreationTimestamp="2026-05-25 01:09:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:09:22.522966336 +0000 UTC m=+412.951177219" watchObservedRunningTime="2026-05-25 01:09:22.52481129 +0000 UTC m=+412.953022165"
May 25 01:09:22.583455 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:22.583399    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl" podStartSLOduration=1.709143904 podStartE2EDuration="5.583379656s" podCreationTimestamp="2026-05-25 01:09:17 +0000 UTC" firstStartedPulling="2026-05-25 01:09:17.576421675 +0000 UTC m=+408.004632527" lastFinishedPulling="2026-05-25 01:09:21.450657425 +0000 UTC m=+411.878868279" observedRunningTime="2026-05-25 01:09:22.581988609 +0000 UTC m=+413.010199484" watchObservedRunningTime="2026-05-25 01:09:22.583379656 +0000 UTC m=+413.011590532"
May 25 01:09:23.511893 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:23.511856    2560 generic.go:358] "Generic (PLEG): container finished" podID="6f851413-265f-4824-a4d9-d8acc769c606" containerID="fab18373618248f4c04580ff8d8389de084ffba6edca3024a4288a18b2a84503" exitCode=0
May 25 01:09:23.512397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:23.511981    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4" event={"ID":"6f851413-265f-4824-a4d9-d8acc769c606","Type":"ContainerDied","Data":"fab18373618248f4c04580ff8d8389de084ffba6edca3024a4288a18b2a84503"}
May 25 01:09:24.642335 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.642310    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:24.671025 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.670995    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4vx7\" (UniqueName: \"kubernetes.io/projected/6f851413-265f-4824-a4d9-d8acc769c606-kube-api-access-s4vx7\") pod \"6f851413-265f-4824-a4d9-d8acc769c606\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") "
May 25 01:09:24.671206 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.671169    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-bundle\") pod \"6f851413-265f-4824-a4d9-d8acc769c606\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") "
May 25 01:09:24.671471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.671213    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-util\") pod \"6f851413-265f-4824-a4d9-d8acc769c606\" (UID: \"6f851413-265f-4824-a4d9-d8acc769c606\") "
May 25 01:09:24.672322 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.672294    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-bundle" (OuterVolumeSpecName: "bundle") pod "6f851413-265f-4824-a4d9-d8acc769c606" (UID: "6f851413-265f-4824-a4d9-d8acc769c606"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:09:24.672835 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.672561    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:24.673675 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.673634    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f851413-265f-4824-a4d9-d8acc769c606-kube-api-access-s4vx7" (OuterVolumeSpecName: "kube-api-access-s4vx7") pod "6f851413-265f-4824-a4d9-d8acc769c606" (UID: "6f851413-265f-4824-a4d9-d8acc769c606"). InnerVolumeSpecName "kube-api-access-s4vx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:09:24.676820 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.676795    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-util" (OuterVolumeSpecName: "util") pod "6f851413-265f-4824-a4d9-d8acc769c606" (UID: "6f851413-265f-4824-a4d9-d8acc769c606"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:09:24.773507 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.773426    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4vx7\" (UniqueName: \"kubernetes.io/projected/6f851413-265f-4824-a4d9-d8acc769c606-kube-api-access-s4vx7\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:24.773507 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:24.773457    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f851413-265f-4824-a4d9-d8acc769c606-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:25.520415 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:25.520381    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4" event={"ID":"6f851413-265f-4824-a4d9-d8acc769c606","Type":"ContainerDied","Data":"f99a928cb40029a835d1a92776a98d56e3a117462447c694c6da0aa3be6d9945"}
May 25 01:09:25.520415 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:25.520418    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f99a928cb40029a835d1a92776a98d56e3a117462447c694c6da0aa3be6d9945"
May 25 01:09:25.520620 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:25.520397    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzdp4"
May 25 01:09:28.514854 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:28.514818    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-q9cfl"
May 25 01:09:36.085189 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.085154    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"]
May 25 01:09:36.085575 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.085475    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f851413-265f-4824-a4d9-d8acc769c606" containerName="util"
May 25 01:09:36.085575 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.085487    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f851413-265f-4824-a4d9-d8acc769c606" containerName="util"
May 25 01:09:36.085575 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.085499    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f851413-265f-4824-a4d9-d8acc769c606" containerName="pull"
May 25 01:09:36.085575 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.085504    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f851413-265f-4824-a4d9-d8acc769c606" containerName="pull"
May 25 01:09:36.085575 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.085512    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f851413-265f-4824-a4d9-d8acc769c606" containerName="extract"
May 25 01:09:36.085575 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.085518    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f851413-265f-4824-a4d9-d8acc769c606" containerName="extract"
May 25 01:09:36.085575 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.085569    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f851413-265f-4824-a4d9-d8acc769c606" containerName="extract"
May 25 01:09:36.119852 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.119819    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"]
May 25 01:09:36.120010 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.119911    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.123077 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.123055    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqxrz\""
May 25 01:09:36.123198 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.123056    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 25 01:09:36.123778 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.123763    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 25 01:09:36.182293 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.182262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.182458 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.182311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.182458 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.182343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7tpj\" (UniqueName: \"kubernetes.io/projected/88b7ae70-5364-4584-8deb-0df6dddf0bea-kube-api-access-s7tpj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.282936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.282897    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.283104 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.282948    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7tpj\" (UniqueName: \"kubernetes.io/projected/88b7ae70-5364-4584-8deb-0df6dddf0bea-kube-api-access-s7tpj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.283104 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.283001    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.283356 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.283341    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.283399 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.283340    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.292949 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.292924    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7tpj\" (UniqueName: \"kubernetes.io/projected/88b7ae70-5364-4584-8deb-0df6dddf0bea-kube-api-access-s7tpj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.429642 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.429551    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:36.571120 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:36.571092    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"]
May 25 01:09:36.573446 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:09:36.573417    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b7ae70_5364_4584_8deb_0df6dddf0bea.slice/crio-a31dd309eaffdb993010a0b2b4ad6ed6d52a1ff93875d65bbb5e3198bea838ba WatchSource:0}: Error finding container a31dd309eaffdb993010a0b2b4ad6ed6d52a1ff93875d65bbb5e3198bea838ba: Status 404 returned error can't find the container with id a31dd309eaffdb993010a0b2b4ad6ed6d52a1ff93875d65bbb5e3198bea838ba
May 25 01:09:37.560096 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:37.560010    2560 generic.go:358] "Generic (PLEG): container finished" podID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerID="82d3ee846f7dacdcd3023822f61f286354f5f7f2734d1381b46935fc22c23b95" exitCode=0
May 25 01:09:37.560096 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:37.560054    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn" event={"ID":"88b7ae70-5364-4584-8deb-0df6dddf0bea","Type":"ContainerDied","Data":"82d3ee846f7dacdcd3023822f61f286354f5f7f2734d1381b46935fc22c23b95"}
May 25 01:09:37.560096 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:37.560078    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn" event={"ID":"88b7ae70-5364-4584-8deb-0df6dddf0bea","Type":"ContainerStarted","Data":"a31dd309eaffdb993010a0b2b4ad6ed6d52a1ff93875d65bbb5e3198bea838ba"}
May 25 01:09:38.564693 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:38.564658    2560 generic.go:358] "Generic (PLEG): container finished" podID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerID="c47c6b08b71d01c60c6eb6a2be6a2eff4d628351a48024da4d83df3f466f842a" exitCode=0
May 25 01:09:38.565088 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:38.564742    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn" event={"ID":"88b7ae70-5364-4584-8deb-0df6dddf0bea","Type":"ContainerDied","Data":"c47c6b08b71d01c60c6eb6a2be6a2eff4d628351a48024da4d83df3f466f842a"}
May 25 01:09:39.569539 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:39.569507    2560 generic.go:358] "Generic (PLEG): container finished" podID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerID="2bc9dd1903a130efd3b31895bb3be293d2c3b5833d7a215e698df186b3ad6ae2" exitCode=0
May 25 01:09:39.570013 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:39.569625    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn" event={"ID":"88b7ae70-5364-4584-8deb-0df6dddf0bea","Type":"ContainerDied","Data":"2bc9dd1903a130efd3b31895bb3be293d2c3b5833d7a215e698df186b3ad6ae2"}
May 25 01:09:40.706456 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.706429    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:40.822517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.822473    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7tpj\" (UniqueName: \"kubernetes.io/projected/88b7ae70-5364-4584-8deb-0df6dddf0bea-kube-api-access-s7tpj\") pod \"88b7ae70-5364-4584-8deb-0df6dddf0bea\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") "
May 25 01:09:40.822707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.822543    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-bundle\") pod \"88b7ae70-5364-4584-8deb-0df6dddf0bea\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") "
May 25 01:09:40.822707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.822595    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-util\") pod \"88b7ae70-5364-4584-8deb-0df6dddf0bea\" (UID: \"88b7ae70-5364-4584-8deb-0df6dddf0bea\") "
May 25 01:09:40.823315 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.823210    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-bundle" (OuterVolumeSpecName: "bundle") pod "88b7ae70-5364-4584-8deb-0df6dddf0bea" (UID: "88b7ae70-5364-4584-8deb-0df6dddf0bea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:09:40.824873 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.824817    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b7ae70-5364-4584-8deb-0df6dddf0bea-kube-api-access-s7tpj" (OuterVolumeSpecName: "kube-api-access-s7tpj") pod "88b7ae70-5364-4584-8deb-0df6dddf0bea" (UID: "88b7ae70-5364-4584-8deb-0df6dddf0bea"). InnerVolumeSpecName "kube-api-access-s7tpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:09:40.827975 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.827951    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-util" (OuterVolumeSpecName: "util") pod "88b7ae70-5364-4584-8deb-0df6dddf0bea" (UID: "88b7ae70-5364-4584-8deb-0df6dddf0bea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:09:40.923528 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.923491    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7tpj\" (UniqueName: \"kubernetes.io/projected/88b7ae70-5364-4584-8deb-0df6dddf0bea-kube-api-access-s7tpj\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:40.923528 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.923523    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:40.923528 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:40.923532    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88b7ae70-5364-4584-8deb-0df6dddf0bea-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:41.578625 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:41.578588    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn" event={"ID":"88b7ae70-5364-4584-8deb-0df6dddf0bea","Type":"ContainerDied","Data":"a31dd309eaffdb993010a0b2b4ad6ed6d52a1ff93875d65bbb5e3198bea838ba"}
May 25 01:09:41.578625 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:41.578629    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a31dd309eaffdb993010a0b2b4ad6ed6d52a1ff93875d65bbb5e3198bea838ba"
May 25 01:09:41.578830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:41.578599    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lpknn"
May 25 01:09:46.884362 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.884327    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"]
May 25 01:09:46.884781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.884683    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerName="pull"
May 25 01:09:46.884781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.884702    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerName="pull"
May 25 01:09:46.884781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.884733    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerName="extract"
May 25 01:09:46.884781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.884742    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerName="extract"
May 25 01:09:46.884781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.884755    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerName="util"
May 25 01:09:46.884781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.884763    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerName="util"
May 25 01:09:46.884968 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.884850    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="88b7ae70-5364-4584-8deb-0df6dddf0bea" containerName="extract"
May 25 01:09:46.889161 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.889144    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:46.891767 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.891743    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 25 01:09:46.891767 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.891755    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 25 01:09:46.891955 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.891754    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqxrz\""
May 25 01:09:46.900383 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.900352    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"]
May 25 01:09:46.973046 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.973006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:46.973213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.973054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:46.973213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:46.973150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsrkg\" (UniqueName: \"kubernetes.io/projected/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-kube-api-access-xsrkg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:47.074609 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.074571    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:47.074784 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.074615    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:47.074784 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.074664    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsrkg\" (UniqueName: \"kubernetes.io/projected/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-kube-api-access-xsrkg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:47.075043 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.075018    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:47.075076 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.075023    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:47.083415 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.083385    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsrkg\" (UniqueName: \"kubernetes.io/projected/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-kube-api-access-xsrkg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:47.198862 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.198762    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:47.341079 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.341004    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"]
May 25 01:09:47.343861 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:09:47.343826    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ff9ea4_0ac9_479d_9607_ccb5131c7dd5.slice/crio-6f0759effac553c45d006035d0d92d32c131c4ecc3b281d0321af6739ada7200 WatchSource:0}: Error finding container 6f0759effac553c45d006035d0d92d32c131c4ecc3b281d0321af6739ada7200: Status 404 returned error can't find the container with id 6f0759effac553c45d006035d0d92d32c131c4ecc3b281d0321af6739ada7200
May 25 01:09:47.601237 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.601184    2560 generic.go:358] "Generic (PLEG): container finished" podID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerID="941c72810a11d1ffb6b977ab4383643f372db1960e49392f5f614483cb56254c" exitCode=0
May 25 01:09:47.601404 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.601272    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8" event={"ID":"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5","Type":"ContainerDied","Data":"941c72810a11d1ffb6b977ab4383643f372db1960e49392f5f614483cb56254c"}
May 25 01:09:47.601404 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:47.601308    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8" event={"ID":"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5","Type":"ContainerStarted","Data":"6f0759effac553c45d006035d0d92d32c131c4ecc3b281d0321af6739ada7200"}
May 25 01:09:48.605810 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:48.605776    2560 generic.go:358] "Generic (PLEG): container finished" podID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerID="b342ae7e2431462981c38e16780b7147d42b7a7fa83b1ae2446430d61ecdfa55" exitCode=0
May 25 01:09:48.606160 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:48.605860    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8" event={"ID":"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5","Type":"ContainerDied","Data":"b342ae7e2431462981c38e16780b7147d42b7a7fa83b1ae2446430d61ecdfa55"}
May 25 01:09:49.008260 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.008158    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"]
May 25 01:09:49.011422 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.011400    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.014181 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.014157    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 25 01:09:49.014530 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.014507    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 25 01:09:49.014632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.014542    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 25 01:09:49.014632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.014551    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 25 01:09:49.014632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.014542    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-79wbd\""
May 25 01:09:49.051817 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.051787    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"]
May 25 01:09:49.096785 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.096744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/617cf175-e776-4593-a5da-fc28c666cf2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.096954 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.096802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/617cf175-e776-4593-a5da-fc28c666cf2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.096954 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.096852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh4nr\" (UniqueName: \"kubernetes.io/projected/617cf175-e776-4593-a5da-fc28c666cf2f-kube-api-access-gh4nr\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.198169 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.198130    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/617cf175-e776-4593-a5da-fc28c666cf2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.198169 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.198168    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gh4nr\" (UniqueName: \"kubernetes.io/projected/617cf175-e776-4593-a5da-fc28c666cf2f-kube-api-access-gh4nr\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.198445 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.198266    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/617cf175-e776-4593-a5da-fc28c666cf2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.200748 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.200722    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/617cf175-e776-4593-a5da-fc28c666cf2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.200919 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.200846    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/617cf175-e776-4593-a5da-fc28c666cf2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.211242 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.211204    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh4nr\" (UniqueName: \"kubernetes.io/projected/617cf175-e776-4593-a5da-fc28c666cf2f-kube-api-access-gh4nr\") pod \"opendatahub-operator-controller-manager-6588b9546d-scssq\" (UID: \"617cf175-e776-4593-a5da-fc28c666cf2f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.321539 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.321452    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:49.497299 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.497268    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"]
May 25 01:09:49.499914 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:09:49.499884    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617cf175_e776_4593_a5da_fc28c666cf2f.slice/crio-f033b2be0f5562a390febcfb180fb4364d663d21ed53b771bab1a402cb468373 WatchSource:0}: Error finding container f033b2be0f5562a390febcfb180fb4364d663d21ed53b771bab1a402cb468373: Status 404 returned error can't find the container with id f033b2be0f5562a390febcfb180fb4364d663d21ed53b771bab1a402cb468373
May 25 01:09:49.610780 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.610732    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq" event={"ID":"617cf175-e776-4593-a5da-fc28c666cf2f","Type":"ContainerStarted","Data":"f033b2be0f5562a390febcfb180fb4364d663d21ed53b771bab1a402cb468373"}
May 25 01:09:49.612476 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.612448    2560 generic.go:358] "Generic (PLEG): container finished" podID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerID="060e7a074308fa0ef7106fc907a4bd0bcc8cab0d22a3d8082bfb17b5508f31c8" exitCode=0
May 25 01:09:49.612587 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:49.612540    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8" event={"ID":"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5","Type":"ContainerDied","Data":"060e7a074308fa0ef7106fc907a4bd0bcc8cab0d22a3d8082bfb17b5508f31c8"}
May 25 01:09:52.007390 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.007367    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:52.126058 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.126020    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-bundle\") pod \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") "
May 25 01:09:52.126280 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.126096    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-util\") pod \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") "
May 25 01:09:52.126280 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.126141    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsrkg\" (UniqueName: \"kubernetes.io/projected/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-kube-api-access-xsrkg\") pod \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\" (UID: \"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5\") "
May 25 01:09:52.127392 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.127352    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-bundle" (OuterVolumeSpecName: "bundle") pod "34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" (UID: "34ff9ea4-0ac9-479d-9607-ccb5131c7dd5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:09:52.128642 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.128611    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-kube-api-access-xsrkg" (OuterVolumeSpecName: "kube-api-access-xsrkg") pod "34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" (UID: "34ff9ea4-0ac9-479d-9607-ccb5131c7dd5"). InnerVolumeSpecName "kube-api-access-xsrkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:09:52.131942 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.131910    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-util" (OuterVolumeSpecName: "util") pod "34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" (UID: "34ff9ea4-0ac9-479d-9607-ccb5131c7dd5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:09:52.227343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.227315    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:52.227343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.227339    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:52.227343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.227349    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsrkg\" (UniqueName: \"kubernetes.io/projected/34ff9ea4-0ac9-479d-9607-ccb5131c7dd5-kube-api-access-xsrkg\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:09:52.624983 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.624939    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq" event={"ID":"617cf175-e776-4593-a5da-fc28c666cf2f","Type":"ContainerStarted","Data":"df9310cc584514a2a74d9ed16e82b03428b52fddb77a09709551200603b379b1"}
May 25 01:09:52.625193 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.625173    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:09:52.626679 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.626660    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8" event={"ID":"34ff9ea4-0ac9-479d-9607-ccb5131c7dd5","Type":"ContainerDied","Data":"6f0759effac553c45d006035d0d92d32c131c4ecc3b281d0321af6739ada7200"}
May 25 01:09:52.626727 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.626683    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f0759effac553c45d006035d0d92d32c131c4ecc3b281d0321af6739ada7200"
May 25 01:09:52.626727 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.626709    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9q5rv8"
May 25 01:09:52.657958 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:09:52.657184    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq" podStartSLOduration=2.117459863 podStartE2EDuration="4.657166288s" podCreationTimestamp="2026-05-25 01:09:48 +0000 UTC" firstStartedPulling="2026-05-25 01:09:49.501853517 +0000 UTC m=+439.930064368" lastFinishedPulling="2026-05-25 01:09:52.041559935 +0000 UTC m=+442.469770793" observedRunningTime="2026-05-25 01:09:52.655290395 +0000 UTC m=+443.083501270" watchObservedRunningTime="2026-05-25 01:09:52.657166288 +0000 UTC m=+443.085377164"
May 25 01:10:01.075218 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.075174    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"]
May 25 01:10:01.075630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.075506    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerName="util"
May 25 01:10:01.075630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.075518    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerName="util"
May 25 01:10:01.075630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.075528    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerName="pull"
May 25 01:10:01.075630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.075535    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerName="pull"
May 25 01:10:01.075630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.075545    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerName="extract"
May 25 01:10:01.075630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.075551    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerName="extract"
May 25 01:10:01.075630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.075607    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="34ff9ea4-0ac9-479d-9607-ccb5131c7dd5" containerName="extract"
May 25 01:10:01.079691 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.079671    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.083189 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.083165    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 25 01:10:01.083343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.083165    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 25 01:10:01.083343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.083165    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6nk8g\""
May 25 01:10:01.083343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.083173    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 25 01:10:01.083343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.083173    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 25 01:10:01.083343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.083211    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 25 01:10:01.088862 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.088837    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"]
May 25 01:10:01.099321 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.099294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-metrics-cert\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.099467 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.099362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hqrk\" (UniqueName: \"kubernetes.io/projected/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-kube-api-access-8hqrk\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.099467 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.099433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-manager-config\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.099467 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.099457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-cert\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.199981 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.199944    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-metrics-cert\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.200154 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.200038    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hqrk\" (UniqueName: \"kubernetes.io/projected/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-kube-api-access-8hqrk\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.200154 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.200112    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-manager-config\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.200303 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.200153    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-cert\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.201071 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.201037    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-manager-config\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.202948 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.202914    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-cert\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.203098 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.203076    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-metrics-cert\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.209123 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.209097    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hqrk\" (UniqueName: \"kubernetes.io/projected/f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c-kube-api-access-8hqrk\") pod \"lws-controller-manager-8556845d74-9gcvj\" (UID: \"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.390041 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.389988    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:01.523270 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.523246    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"]
May 25 01:10:01.525511 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:10:01.525481    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46f986d_7d1f_4e67_9a19_bb7c0f3c4c2c.slice/crio-7308d39aa4af19574bf3d0929d30d658b4357e4cb13985ba54f62d93546e3bc3 WatchSource:0}: Error finding container 7308d39aa4af19574bf3d0929d30d658b4357e4cb13985ba54f62d93546e3bc3: Status 404 returned error can't find the container with id 7308d39aa4af19574bf3d0929d30d658b4357e4cb13985ba54f62d93546e3bc3
May 25 01:10:01.657263 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:01.657156    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj" event={"ID":"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c","Type":"ContainerStarted","Data":"7308d39aa4af19574bf3d0929d30d658b4357e4cb13985ba54f62d93546e3bc3"}
May 25 01:10:03.632285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:03.632254    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-scssq"
May 25 01:10:04.670630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:04.670595    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj" event={"ID":"f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c","Type":"ContainerStarted","Data":"13a6426569bbec26b8d155742c3ad97dadfe590efbd35a7e669765f5cefec35b"}
May 25 01:10:04.671083 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:04.670665    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:04.690889 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:04.690831    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj" podStartSLOduration=1.0846632920000001 podStartE2EDuration="3.690816467s" podCreationTimestamp="2026-05-25 01:10:01 +0000 UTC" firstStartedPulling="2026-05-25 01:10:01.527518367 +0000 UTC m=+451.955729220" lastFinishedPulling="2026-05-25 01:10:04.133671541 +0000 UTC m=+454.561882395" observedRunningTime="2026-05-25 01:10:04.689761557 +0000 UTC m=+455.117972434" watchObservedRunningTime="2026-05-25 01:10:04.690816467 +0000 UTC m=+455.119027341"
May 25 01:10:05.724999 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.724956    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"]
May 25 01:10:05.729159 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.729135    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.731666 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.731647    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 25 01:10:05.731792 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.731666    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 25 01:10:05.732630 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.732613    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqxrz\""
May 25 01:10:05.738048 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.738025    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"]
May 25 01:10:05.840919 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.840885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.841103 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.840937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjgvj\" (UniqueName: \"kubernetes.io/projected/b32d570c-fb7f-4c6d-b49d-011329cb703e-kube-api-access-bjgvj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.841103 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.841083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.942392 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.942346    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjgvj\" (UniqueName: \"kubernetes.io/projected/b32d570c-fb7f-4c6d-b49d-011329cb703e-kube-api-access-bjgvj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.942604 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.942476    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.942604 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.942526    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.942970 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.942948    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.943188 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.943171    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:05.961672 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:05.961629    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjgvj\" (UniqueName: \"kubernetes.io/projected/b32d570c-fb7f-4c6d-b49d-011329cb703e-kube-api-access-bjgvj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:06.040313 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:06.040196    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:06.173772 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:06.173745    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"]
May 25 01:10:06.176376 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:10:06.176344    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32d570c_fb7f_4c6d_b49d_011329cb703e.slice/crio-3c3575bd746d701289a34d7c73e1bc5fd5d9f236ed578498a28fb4266167384b WatchSource:0}: Error finding container 3c3575bd746d701289a34d7c73e1bc5fd5d9f236ed578498a28fb4266167384b: Status 404 returned error can't find the container with id 3c3575bd746d701289a34d7c73e1bc5fd5d9f236ed578498a28fb4266167384b
May 25 01:10:06.678482 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:06.678448    2560 generic.go:358] "Generic (PLEG): container finished" podID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerID="fc34f635e0b18ac56309c6cc7f7985e8bbc8d0b57d316cd24ae526b3f0d06522" exitCode=0
May 25 01:10:06.678657 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:06.678502    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m" event={"ID":"b32d570c-fb7f-4c6d-b49d-011329cb703e","Type":"ContainerDied","Data":"fc34f635e0b18ac56309c6cc7f7985e8bbc8d0b57d316cd24ae526b3f0d06522"}
May 25 01:10:06.678657 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:06.678524    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m" event={"ID":"b32d570c-fb7f-4c6d-b49d-011329cb703e","Type":"ContainerStarted","Data":"3c3575bd746d701289a34d7c73e1bc5fd5d9f236ed578498a28fb4266167384b"}
May 25 01:10:07.683480 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:07.683379    2560 generic.go:358] "Generic (PLEG): container finished" podID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerID="5c9806135eb931dda2e5ea4719c0b74932d81782d0d63738f644f1454e840ab7" exitCode=0
May 25 01:10:07.683837 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:07.683468    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m" event={"ID":"b32d570c-fb7f-4c6d-b49d-011329cb703e","Type":"ContainerDied","Data":"5c9806135eb931dda2e5ea4719c0b74932d81782d0d63738f644f1454e840ab7"}
May 25 01:10:08.688431 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:08.688390    2560 generic.go:358] "Generic (PLEG): container finished" podID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerID="9d4cc6f2e31f905a46481f6e3b2f329fa62e41d1c6db5b35f11efe552ba01ceb" exitCode=0
May 25 01:10:08.688781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:08.688437    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m" event={"ID":"b32d570c-fb7f-4c6d-b49d-011329cb703e","Type":"ContainerDied","Data":"9d4cc6f2e31f905a46481f6e3b2f329fa62e41d1c6db5b35f11efe552ba01ceb"}
May 25 01:10:09.821704 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.821679    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:09.877505 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.877475    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjgvj\" (UniqueName: \"kubernetes.io/projected/b32d570c-fb7f-4c6d-b49d-011329cb703e-kube-api-access-bjgvj\") pod \"b32d570c-fb7f-4c6d-b49d-011329cb703e\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") "
May 25 01:10:09.877670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.877514    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-util\") pod \"b32d570c-fb7f-4c6d-b49d-011329cb703e\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") "
May 25 01:10:09.877670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.877605    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-bundle\") pod \"b32d570c-fb7f-4c6d-b49d-011329cb703e\" (UID: \"b32d570c-fb7f-4c6d-b49d-011329cb703e\") "
May 25 01:10:09.878736 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.878697    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-bundle" (OuterVolumeSpecName: "bundle") pod "b32d570c-fb7f-4c6d-b49d-011329cb703e" (UID: "b32d570c-fb7f-4c6d-b49d-011329cb703e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:10:09.879698 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.879670    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b32d570c-fb7f-4c6d-b49d-011329cb703e-kube-api-access-bjgvj" (OuterVolumeSpecName: "kube-api-access-bjgvj") pod "b32d570c-fb7f-4c6d-b49d-011329cb703e" (UID: "b32d570c-fb7f-4c6d-b49d-011329cb703e"). InnerVolumeSpecName "kube-api-access-bjgvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:10:09.883171 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.883151    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-util" (OuterVolumeSpecName: "util") pod "b32d570c-fb7f-4c6d-b49d-011329cb703e" (UID: "b32d570c-fb7f-4c6d-b49d-011329cb703e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:10:09.979040 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.978941    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjgvj\" (UniqueName: \"kubernetes.io/projected/b32d570c-fb7f-4c6d-b49d-011329cb703e-kube-api-access-bjgvj\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:10:09.979040 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.978982    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:10:09.979040 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:09.978991    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b32d570c-fb7f-4c6d-b49d-011329cb703e-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:10:10.696334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:10.696305    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m"
May 25 01:10:10.696504 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:10.696302    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rwk7m" event={"ID":"b32d570c-fb7f-4c6d-b49d-011329cb703e","Type":"ContainerDied","Data":"3c3575bd746d701289a34d7c73e1bc5fd5d9f236ed578498a28fb4266167384b"}
May 25 01:10:10.696504 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:10.696412    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c3575bd746d701289a34d7c73e1bc5fd5d9f236ed578498a28fb4266167384b"
May 25 01:10:15.676091 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:15.676058    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8556845d74-9gcvj"
May 25 01:10:19.949525 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.949483    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"]
May 25 01:10:19.950035 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.950010    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerName="extract"
May 25 01:10:19.950117 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.950038    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerName="extract"
May 25 01:10:19.950117 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.950059    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerName="pull"
May 25 01:10:19.950117 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.950068    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerName="pull"
May 25 01:10:19.950117 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.950079    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerName="util"
May 25 01:10:19.950117 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.950087    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerName="util"
May 25 01:10:19.950364 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.950164    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="b32d570c-fb7f-4c6d-b49d-011329cb703e" containerName="extract"
May 25 01:10:19.953839 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.953808    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:19.956455 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.956431    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 25 01:10:19.956626 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.956460    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 25 01:10:19.957485 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.957461    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqxrz\""
May 25 01:10:19.965632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:19.965607    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"]
May 25 01:10:20.065029 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.064985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.065029 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.065034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgjgf\" (UniqueName: \"kubernetes.io/projected/1a79e887-f3b9-4ff8-937d-ff89dd88e235-kube-api-access-sgjgf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.065334 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.065174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.166397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.166355    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.166567 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.166430    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.166567 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.166450    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgjgf\" (UniqueName: \"kubernetes.io/projected/1a79e887-f3b9-4ff8-937d-ff89dd88e235-kube-api-access-sgjgf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.166753 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.166733    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.166798 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.166770    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.180475 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.180442    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgjgf\" (UniqueName: \"kubernetes.io/projected/1a79e887-f3b9-4ff8-937d-ff89dd88e235-kube-api-access-sgjgf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.264499 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.264404    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:20.411497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.411470    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"]
May 25 01:10:20.414273 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:10:20.414240    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a79e887_f3b9_4ff8_937d_ff89dd88e235.slice/crio-056bc9fcd190e44ba1559678d8e49c472eaa51bdcd9a441de8aaf5e800147565 WatchSource:0}: Error finding container 056bc9fcd190e44ba1559678d8e49c472eaa51bdcd9a441de8aaf5e800147565: Status 404 returned error can't find the container with id 056bc9fcd190e44ba1559678d8e49c472eaa51bdcd9a441de8aaf5e800147565
May 25 01:10:20.736243 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.736190    2560 generic.go:358] "Generic (PLEG): container finished" podID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerID="5af20280beace58a81645ec8c72de1bd77e05c43fab3a05d6c03e27d9a14aec5" exitCode=0
May 25 01:10:20.736475 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.736255    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df" event={"ID":"1a79e887-f3b9-4ff8-937d-ff89dd88e235","Type":"ContainerDied","Data":"5af20280beace58a81645ec8c72de1bd77e05c43fab3a05d6c03e27d9a14aec5"}
May 25 01:10:20.736475 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:20.736291    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df" event={"ID":"1a79e887-f3b9-4ff8-937d-ff89dd88e235","Type":"ContainerStarted","Data":"056bc9fcd190e44ba1559678d8e49c472eaa51bdcd9a441de8aaf5e800147565"}
May 25 01:10:21.741249 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:21.741145    2560 generic.go:358] "Generic (PLEG): container finished" podID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerID="d2d83f501f6a4e790bccf8a994db23e32f34040facc6fa5b945509caefaf339a" exitCode=0
May 25 01:10:21.741249 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:21.741206    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df" event={"ID":"1a79e887-f3b9-4ff8-937d-ff89dd88e235","Type":"ContainerDied","Data":"d2d83f501f6a4e790bccf8a994db23e32f34040facc6fa5b945509caefaf339a"}
May 25 01:10:22.746392 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:22.746359    2560 generic.go:358] "Generic (PLEG): container finished" podID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerID="7de18baa78d55152b199404d766edad86e15e4cb3ec52f05d574d517aa065f77" exitCode=0
May 25 01:10:22.746762 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:22.746398    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df" event={"ID":"1a79e887-f3b9-4ff8-937d-ff89dd88e235","Type":"ContainerDied","Data":"7de18baa78d55152b199404d766edad86e15e4cb3ec52f05d574d517aa065f77"}
May 25 01:10:23.878524 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:23.878500    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:24.002161 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.002081    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-bundle\") pod \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") "
May 25 01:10:24.002161 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.002135    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-util\") pod \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") "
May 25 01:10:24.002418 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.002167    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgjgf\" (UniqueName: \"kubernetes.io/projected/1a79e887-f3b9-4ff8-937d-ff89dd88e235-kube-api-access-sgjgf\") pod \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\" (UID: \"1a79e887-f3b9-4ff8-937d-ff89dd88e235\") "
May 25 01:10:24.002993 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.002958    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-bundle" (OuterVolumeSpecName: "bundle") pod "1a79e887-f3b9-4ff8-937d-ff89dd88e235" (UID: "1a79e887-f3b9-4ff8-937d-ff89dd88e235"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:10:24.004534 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.004512    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a79e887-f3b9-4ff8-937d-ff89dd88e235-kube-api-access-sgjgf" (OuterVolumeSpecName: "kube-api-access-sgjgf") pod "1a79e887-f3b9-4ff8-937d-ff89dd88e235" (UID: "1a79e887-f3b9-4ff8-937d-ff89dd88e235"). InnerVolumeSpecName "kube-api-access-sgjgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:10:24.007535 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.007492    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-util" (OuterVolumeSpecName: "util") pod "1a79e887-f3b9-4ff8-937d-ff89dd88e235" (UID: "1a79e887-f3b9-4ff8-937d-ff89dd88e235"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:10:24.103359 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.103323    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:10:24.103359 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.103354    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgjgf\" (UniqueName: \"kubernetes.io/projected/1a79e887-f3b9-4ff8-937d-ff89dd88e235-kube-api-access-sgjgf\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:10:24.103359 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.103365    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a79e887-f3b9-4ff8-937d-ff89dd88e235-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:10:24.755978 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.755942    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df" event={"ID":"1a79e887-f3b9-4ff8-937d-ff89dd88e235","Type":"ContainerDied","Data":"056bc9fcd190e44ba1559678d8e49c472eaa51bdcd9a441de8aaf5e800147565"}
May 25 01:10:24.755978 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.755972    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awg2df"
May 25 01:10:24.755978 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:24.755981    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="056bc9fcd190e44ba1559678d8e49c472eaa51bdcd9a441de8aaf5e800147565"
May 25 01:10:33.248569 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.248531    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"]
May 25 01:10:33.249078 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.249057    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerName="util"
May 25 01:10:33.249170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.249084    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerName="util"
May 25 01:10:33.249170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.249099    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerName="extract"
May 25 01:10:33.249170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.249107    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerName="extract"
May 25 01:10:33.249170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.249131    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerName="pull"
May 25 01:10:33.249170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.249140    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerName="pull"
May 25 01:10:33.249374 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.249253    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a79e887-f3b9-4ff8-937d-ff89dd88e235" containerName="extract"
May 25 01:10:33.258130 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.258102    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.260798 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.260587    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 25 01:10:33.260798 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.260656    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 25 01:10:33.260798 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.260703    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b46rf\""
May 25 01:10:33.260798 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.260746    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 25 01:10:33.265182 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.265158    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"]
May 25 01:10:33.385565 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.385565 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d217c7c-106d-4693-abab-34c9843932b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.385830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.385830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.385830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d217c7c-106d-4693-abab-34c9843932b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.385830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq764\" (UniqueName: \"kubernetes.io/projected/1d217c7c-106d-4693-abab-34c9843932b0-kube-api-access-vq764\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.385830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d217c7c-106d-4693-abab-34c9843932b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.385830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.385830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.385814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487049 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487016    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d217c7c-106d-4693-abab-34c9843932b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487060    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487093    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487172    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487197    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d217c7c-106d-4693-abab-34c9843932b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487405 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487263    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487405 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487292    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487405 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487335    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d217c7c-106d-4693-abab-34c9843932b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487523 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487471    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq764\" (UniqueName: \"kubernetes.io/projected/1d217c7c-106d-4693-abab-34c9843932b0-kube-api-access-vq764\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487523 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487496    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487603    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487695 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487653    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.487867 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.487848    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.488271 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.488207    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d217c7c-106d-4693-abab-34c9843932b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.489867 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.489840    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d217c7c-106d-4693-abab-34c9843932b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.490190 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.490168    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d217c7c-106d-4693-abab-34c9843932b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.495377 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.495346    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d217c7c-106d-4693-abab-34c9843932b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.495470 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.495417    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq764\" (UniqueName: \"kubernetes.io/projected/1d217c7c-106d-4693-abab-34c9843932b0-kube-api-access-vq764\") pod \"data-science-gateway-data-science-gateway-class-595b7776f86md5r\" (UID: \"1d217c7c-106d-4693-abab-34c9843932b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.572929 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.572840    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:33.709489 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.709456    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"]
May 25 01:10:33.710713 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:10:33.710683    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d217c7c_106d_4693_abab_34c9843932b0.slice/crio-e6643927bd7776dafe295125b37a316c7d421826505412c2397d50d09f18d24f WatchSource:0}: Error finding container e6643927bd7776dafe295125b37a316c7d421826505412c2397d50d09f18d24f: Status 404 returned error can't find the container with id e6643927bd7776dafe295125b37a316c7d421826505412c2397d50d09f18d24f
May 25 01:10:33.790707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:33.790670    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r" event={"ID":"1d217c7c-106d-4693-abab-34c9843932b0","Type":"ContainerStarted","Data":"e6643927bd7776dafe295125b37a316c7d421826505412c2397d50d09f18d24f"}
May 25 01:10:36.109239 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:36.109173    2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 25 01:10:36.109475 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:36.109277    2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 25 01:10:36.109475 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:36.109307    2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 25 01:10:36.804879 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:36.804845    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r" event={"ID":"1d217c7c-106d-4693-abab-34c9843932b0","Type":"ContainerStarted","Data":"a9142177ec211a800353f115e30d9777da49b7913b289ff6c7f99ae40db677bc"}
May 25 01:10:36.825600 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:36.825526    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r" podStartSLOduration=1.429362886 podStartE2EDuration="3.825508141s" podCreationTimestamp="2026-05-25 01:10:33 +0000 UTC" firstStartedPulling="2026-05-25 01:10:33.712774555 +0000 UTC m=+484.140985421" lastFinishedPulling="2026-05-25 01:10:36.108919824 +0000 UTC m=+486.537130676" observedRunningTime="2026-05-25 01:10:36.824508344 +0000 UTC m=+487.252719242" watchObservedRunningTime="2026-05-25 01:10:36.825508141 +0000 UTC m=+487.253719018"
May 25 01:10:37.573554 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:37.573518    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:37.578573 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:37.578543    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:37.808536 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:37.808500    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:10:37.809579 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:10:37.809560    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f86md5r"
May 25 01:11:06.603414 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.603377    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4qkk"]
May 25 01:11:06.609524 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.609498    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk"
May 25 01:11:06.613579 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.613552    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-85877\""
May 25 01:11:06.613728 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.613554    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 25 01:11:06.613849 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.613554    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 25 01:11:06.615276 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.615255    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4qkk"]
May 25 01:11:06.650671 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.650641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx22f\" (UniqueName: \"kubernetes.io/projected/444e73e0-715f-49a5-b3c5-c26b3668dba2-kube-api-access-nx22f\") pod \"kuadrant-operator-catalog-g4qkk\" (UID: \"444e73e0-715f-49a5-b3c5-c26b3668dba2\") " pod="kuadrant-system/kuadrant-operator-catalog-g4qkk"
May 25 01:11:06.751527 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.751487    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx22f\" (UniqueName: \"kubernetes.io/projected/444e73e0-715f-49a5-b3c5-c26b3668dba2-kube-api-access-nx22f\") pod \"kuadrant-operator-catalog-g4qkk\" (UID: \"444e73e0-715f-49a5-b3c5-c26b3668dba2\") " pod="kuadrant-system/kuadrant-operator-catalog-g4qkk"
May 25 01:11:06.759986 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.759960    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx22f\" (UniqueName: \"kubernetes.io/projected/444e73e0-715f-49a5-b3c5-c26b3668dba2-kube-api-access-nx22f\") pod \"kuadrant-operator-catalog-g4qkk\" (UID: \"444e73e0-715f-49a5-b3c5-c26b3668dba2\") " pod="kuadrant-system/kuadrant-operator-catalog-g4qkk"
May 25 01:11:06.920433 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.920344    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk"
May 25 01:11:06.979253 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:06.975107    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4qkk"]
May 25 01:11:07.056869 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.056843    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4qkk"]
May 25 01:11:07.058774 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:07.058727    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444e73e0_715f_49a5_b3c5_c26b3668dba2.slice/crio-b48665b70559271bac3a8a1d3e6da0c7bdcee02de031582f8f0bec708c90d3c7 WatchSource:0}: Error finding container b48665b70559271bac3a8a1d3e6da0c7bdcee02de031582f8f0bec708c90d3c7: Status 404 returned error can't find the container with id b48665b70559271bac3a8a1d3e6da0c7bdcee02de031582f8f0bec708c90d3c7
May 25 01:11:07.182471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.182388    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bk5jb"]
May 25 01:11:07.191079 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.191054    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:07.192165 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.192141    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bk5jb"]
May 25 01:11:07.255189 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.255153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kgtw\" (UniqueName: \"kubernetes.io/projected/38e23db3-3ccb-4ab5-9c4c-5b89cad645b4-kube-api-access-6kgtw\") pod \"kuadrant-operator-catalog-bk5jb\" (UID: \"38e23db3-3ccb-4ab5-9c4c-5b89cad645b4\") " pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:07.355970 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.355933    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kgtw\" (UniqueName: \"kubernetes.io/projected/38e23db3-3ccb-4ab5-9c4c-5b89cad645b4-kube-api-access-6kgtw\") pod \"kuadrant-operator-catalog-bk5jb\" (UID: \"38e23db3-3ccb-4ab5-9c4c-5b89cad645b4\") " pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:07.365522 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.365497    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kgtw\" (UniqueName: \"kubernetes.io/projected/38e23db3-3ccb-4ab5-9c4c-5b89cad645b4-kube-api-access-6kgtw\") pod \"kuadrant-operator-catalog-bk5jb\" (UID: \"38e23db3-3ccb-4ab5-9c4c-5b89cad645b4\") " pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:07.502310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.502209    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:07.655907 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.655879    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bk5jb"]
May 25 01:11:07.657838 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:07.657812    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e23db3_3ccb_4ab5_9c4c_5b89cad645b4.slice/crio-64e7e8520563847c2e14e2c25947666557ae64e3df89242b65f6e76289fc8b2c WatchSource:0}: Error finding container 64e7e8520563847c2e14e2c25947666557ae64e3df89242b65f6e76289fc8b2c: Status 404 returned error can't find the container with id 64e7e8520563847c2e14e2c25947666557ae64e3df89242b65f6e76289fc8b2c
May 25 01:11:07.921302 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.921257    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk" event={"ID":"444e73e0-715f-49a5-b3c5-c26b3668dba2","Type":"ContainerStarted","Data":"b48665b70559271bac3a8a1d3e6da0c7bdcee02de031582f8f0bec708c90d3c7"}
May 25 01:11:07.922453 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:07.922423    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb" event={"ID":"38e23db3-3ccb-4ab5-9c4c-5b89cad645b4","Type":"ContainerStarted","Data":"64e7e8520563847c2e14e2c25947666557ae64e3df89242b65f6e76289fc8b2c"}
May 25 01:11:09.931588 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:09.931542    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk" event={"ID":"444e73e0-715f-49a5-b3c5-c26b3668dba2","Type":"ContainerStarted","Data":"cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a"}
May 25 01:11:09.931588 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:09.931581    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk" podUID="444e73e0-715f-49a5-b3c5-c26b3668dba2" containerName="registry-server" containerID="cri-o://cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a" gracePeriod=2
May 25 01:11:09.933088 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:09.933063    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb" event={"ID":"38e23db3-3ccb-4ab5-9c4c-5b89cad645b4","Type":"ContainerStarted","Data":"1117f4c4ac303089db38c1a84d99facaf13934fb0e0331056341f3073a591c95"}
May 25 01:11:09.948006 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:09.947952    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk" podStartSLOduration=1.466939473 podStartE2EDuration="3.947938521s" podCreationTimestamp="2026-05-25 01:11:06 +0000 UTC" firstStartedPulling="2026-05-25 01:11:07.06010251 +0000 UTC m=+517.488313363" lastFinishedPulling="2026-05-25 01:11:09.541101559 +0000 UTC m=+519.969312411" observedRunningTime="2026-05-25 01:11:09.946398634 +0000 UTC m=+520.374609510" watchObservedRunningTime="2026-05-25 01:11:09.947938521 +0000 UTC m=+520.376149425"
May 25 01:11:09.962068 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:09.962023    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb" podStartSLOduration=1.077291332 podStartE2EDuration="2.962011431s" podCreationTimestamp="2026-05-25 01:11:07 +0000 UTC" firstStartedPulling="2026-05-25 01:11:07.659429465 +0000 UTC m=+518.087640316" lastFinishedPulling="2026-05-25 01:11:09.544149563 +0000 UTC m=+519.972360415" observedRunningTime="2026-05-25 01:11:09.960071241 +0000 UTC m=+520.388282114" watchObservedRunningTime="2026-05-25 01:11:09.962011431 +0000 UTC m=+520.390222304"
May 25 01:11:10.177323 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.177295    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk"
May 25 01:11:10.284129 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.284023    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx22f\" (UniqueName: \"kubernetes.io/projected/444e73e0-715f-49a5-b3c5-c26b3668dba2-kube-api-access-nx22f\") pod \"444e73e0-715f-49a5-b3c5-c26b3668dba2\" (UID: \"444e73e0-715f-49a5-b3c5-c26b3668dba2\") "
May 25 01:11:10.286399 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.286377    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444e73e0-715f-49a5-b3c5-c26b3668dba2-kube-api-access-nx22f" (OuterVolumeSpecName: "kube-api-access-nx22f") pod "444e73e0-715f-49a5-b3c5-c26b3668dba2" (UID: "444e73e0-715f-49a5-b3c5-c26b3668dba2"). InnerVolumeSpecName "kube-api-access-nx22f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:11:10.385620 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.385580    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx22f\" (UniqueName: \"kubernetes.io/projected/444e73e0-715f-49a5-b3c5-c26b3668dba2-kube-api-access-nx22f\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:10.943386 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.943320    2560 generic.go:358] "Generic (PLEG): container finished" podID="444e73e0-715f-49a5-b3c5-c26b3668dba2" containerID="cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a" exitCode=0
May 25 01:11:10.943813 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.943428    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk"
May 25 01:11:10.943813 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.943421    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk" event={"ID":"444e73e0-715f-49a5-b3c5-c26b3668dba2","Type":"ContainerDied","Data":"cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a"}
May 25 01:11:10.943813 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.943559    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g4qkk" event={"ID":"444e73e0-715f-49a5-b3c5-c26b3668dba2","Type":"ContainerDied","Data":"b48665b70559271bac3a8a1d3e6da0c7bdcee02de031582f8f0bec708c90d3c7"}
May 25 01:11:10.943813 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.943595    2560 scope.go:117] "RemoveContainer" containerID="cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a"
May 25 01:11:10.952646 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.952630    2560 scope.go:117] "RemoveContainer" containerID="cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a"
May 25 01:11:10.952903 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:11:10.952884    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a\": container with ID starting with cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a not found: ID does not exist" containerID="cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a"
May 25 01:11:10.952953 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.952911    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a"} err="failed to get container status \"cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a\": rpc error: code = NotFound desc = could not find container \"cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a\": container with ID starting with cca6e8eee162faa74dd20cdd4a2e7a821d60188ff374803e92d97a493c70138a not found: ID does not exist"
May 25 01:11:10.963772 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.963749    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4qkk"]
May 25 01:11:10.967556 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:10.967532    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4qkk"]
May 25 01:11:12.183105 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:12.183069    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="444e73e0-715f-49a5-b3c5-c26b3668dba2" path="/var/lib/kubelet/pods/444e73e0-715f-49a5-b3c5-c26b3668dba2/volumes"
May 25 01:11:17.502670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:17.502630    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:17.503098 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:17.502781    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:17.524771 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:17.524737    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:17.989841 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:17.989813    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-bk5jb"
May 25 01:11:21.819999 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.819918    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"]
May 25 01:11:21.820373 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.820263    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444e73e0-715f-49a5-b3c5-c26b3668dba2" containerName="registry-server"
May 25 01:11:21.820373 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.820274    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="444e73e0-715f-49a5-b3c5-c26b3668dba2" containerName="registry-server"
May 25 01:11:21.820373 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.820343    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="444e73e0-715f-49a5-b3c5-c26b3668dba2" containerName="registry-server"
May 25 01:11:21.823500 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.823482    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.825921 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.825886    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cr74r\""
May 25 01:11:21.831548 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.831523    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"]
May 25 01:11:21.889068 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.889034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.889300 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.889132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256h2\" (UniqueName: \"kubernetes.io/projected/62d297fb-3449-4575-ac94-de525cbf4008-kube-api-access-256h2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.889300 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.889168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.989850 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.989810    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.990089 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.989899    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-256h2\" (UniqueName: \"kubernetes.io/projected/62d297fb-3449-4575-ac94-de525cbf4008-kube-api-access-256h2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.990089 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.989951    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.990342 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.990317    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.990392 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.990324    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:21.998247 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:21.998199    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-256h2\" (UniqueName: \"kubernetes.io/projected/62d297fb-3449-4575-ac94-de525cbf4008-kube-api-access-256h2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:22.133414 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.133375    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:22.216816 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.216794    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"]
May 25 01:11:22.222333 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.222306    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.227085 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.227051    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"]
May 25 01:11:22.271700 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.271670    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"]
May 25 01:11:22.273651 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:22.273619    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d297fb_3449_4575_ac94_de525cbf4008.slice/crio-5cff551629e98dcd80ac2260651bf3d52ed83f0eee3486d5330098c910b5a334 WatchSource:0}: Error finding container 5cff551629e98dcd80ac2260651bf3d52ed83f0eee3486d5330098c910b5a334: Status 404 returned error can't find the container with id 5cff551629e98dcd80ac2260651bf3d52ed83f0eee3486d5330098c910b5a334
May 25 01:11:22.292858 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.292831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.292996 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.292883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtvfc\" (UniqueName: \"kubernetes.io/projected/b27b1972-7740-47a1-a784-8761f4f6c24f-kube-api-access-qtvfc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.292996 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.292957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.394285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.394176    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.394285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.394252    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtvfc\" (UniqueName: \"kubernetes.io/projected/b27b1972-7740-47a1-a784-8761f4f6c24f-kube-api-access-qtvfc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.394503 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.394288    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.394642 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.394623    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.394713 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.394659    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.402003 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.401978    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtvfc\" (UniqueName: \"kubernetes.io/projected/b27b1972-7740-47a1-a784-8761f4f6c24f-kube-api-access-qtvfc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.534661 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.534620    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:22.667187 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.667156    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"]
May 25 01:11:22.669584 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:22.669554    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27b1972_7740_47a1_a784_8761f4f6c24f.slice/crio-0019d69dc72186db4cc2ac45f252648bf4a462331d70cda6540f1660527fb8cc WatchSource:0}: Error finding container 0019d69dc72186db4cc2ac45f252648bf4a462331d70cda6540f1660527fb8cc: Status 404 returned error can't find the container with id 0019d69dc72186db4cc2ac45f252648bf4a462331d70cda6540f1660527fb8cc
May 25 01:11:22.822574 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.822531    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"]
May 25 01:11:22.826155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.826132    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:22.832497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.832463    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"]
May 25 01:11:22.899253 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.899184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:22.899433 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.899333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:22.899433 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.899384    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq8cv\" (UniqueName: \"kubernetes.io/projected/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-kube-api-access-cq8cv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:22.987728 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.987645    2560 generic.go:358] "Generic (PLEG): container finished" podID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerID="c29fc7c60e18160d58f62a84e3322dacb62cf4db47e4bf4021ed813f3383a5c9" exitCode=0
May 25 01:11:22.987728 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.987714    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7" event={"ID":"b27b1972-7740-47a1-a784-8761f4f6c24f","Type":"ContainerDied","Data":"c29fc7c60e18160d58f62a84e3322dacb62cf4db47e4bf4021ed813f3383a5c9"}
May 25 01:11:22.987933 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.987747    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7" event={"ID":"b27b1972-7740-47a1-a784-8761f4f6c24f","Type":"ContainerStarted","Data":"0019d69dc72186db4cc2ac45f252648bf4a462331d70cda6540f1660527fb8cc"}
May 25 01:11:22.989311 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.989187    2560 generic.go:358] "Generic (PLEG): container finished" podID="62d297fb-3449-4575-ac94-de525cbf4008" containerID="b041ba43dea7fc775ae260cc1ccfc04d7cb0b740fd22b477c9dc795d0982b2eb" exitCode=0
May 25 01:11:22.989440 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.989267    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg" event={"ID":"62d297fb-3449-4575-ac94-de525cbf4008","Type":"ContainerDied","Data":"b041ba43dea7fc775ae260cc1ccfc04d7cb0b740fd22b477c9dc795d0982b2eb"}
May 25 01:11:22.989440 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.989387    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg" event={"ID":"62d297fb-3449-4575-ac94-de525cbf4008","Type":"ContainerStarted","Data":"5cff551629e98dcd80ac2260651bf3d52ed83f0eee3486d5330098c910b5a334"}
May 25 01:11:22.999779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.999752    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:22.999919 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.999845    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:22.999919 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:22.999893    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cq8cv\" (UniqueName: \"kubernetes.io/projected/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-kube-api-access-cq8cv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:23.000273 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.000252    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:23.000517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.000493    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:23.008321 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.008290    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq8cv\" (UniqueName: \"kubernetes.io/projected/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-kube-api-access-cq8cv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:23.138685 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.138645    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:23.274095 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.274069    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"]
May 25 01:11:23.276098 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:23.276069    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c0d296_7169_456e_8d5e_5d4ed72d5a9e.slice/crio-588c1111047a1a72d2877435049b59cce78695ad0b59e7b109e249bb8e42b468 WatchSource:0}: Error finding container 588c1111047a1a72d2877435049b59cce78695ad0b59e7b109e249bb8e42b468: Status 404 returned error can't find the container with id 588c1111047a1a72d2877435049b59cce78695ad0b59e7b109e249bb8e42b468
May 25 01:11:23.425394 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.425355    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"]
May 25 01:11:23.428891 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.428867    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.436827 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.436719    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"]
May 25 01:11:23.505902 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.505871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.506069 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.505922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.506069 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.505950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwwbj\" (UniqueName: \"kubernetes.io/projected/8a042dcd-eeae-4869-b988-5b14c9adbc63-kube-api-access-fwwbj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.607096 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.607054    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.607332 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.607121    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.607332 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.607153    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwwbj\" (UniqueName: \"kubernetes.io/projected/8a042dcd-eeae-4869-b988-5b14c9adbc63-kube-api-access-fwwbj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.607475 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.607455    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.607529 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.607473    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.616177 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.616152    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwwbj\" (UniqueName: \"kubernetes.io/projected/8a042dcd-eeae-4869-b988-5b14c9adbc63-kube-api-access-fwwbj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.740037 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.740006    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:23.994847 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.994813    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg" event={"ID":"62d297fb-3449-4575-ac94-de525cbf4008","Type":"ContainerStarted","Data":"32ccbe7734cea39a2aed3657dfcf20968c90b3cf81d75de117369620cec69e13"}
May 25 01:11:23.996331 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.996302    2560 generic.go:358] "Generic (PLEG): container finished" podID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerID="11efc7a19be4e9431c60c4af5720cc5c4c5380262fc1c9fb672fbd85efbe9985" exitCode=0
May 25 01:11:23.996471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.996384    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r" event={"ID":"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e","Type":"ContainerDied","Data":"11efc7a19be4e9431c60c4af5720cc5c4c5380262fc1c9fb672fbd85efbe9985"}
May 25 01:11:23.996471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.996419    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r" event={"ID":"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e","Type":"ContainerStarted","Data":"588c1111047a1a72d2877435049b59cce78695ad0b59e7b109e249bb8e42b468"}
May 25 01:11:23.998169 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.998150    2560 generic.go:358] "Generic (PLEG): container finished" podID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerID="e7801fe6c506efd9c1b8707abd81b157250654bfac7891bbde581a8f76bff61c" exitCode=0
May 25 01:11:23.998367 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:23.998205    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7" event={"ID":"b27b1972-7740-47a1-a784-8761f4f6c24f","Type":"ContainerDied","Data":"e7801fe6c506efd9c1b8707abd81b157250654bfac7891bbde581a8f76bff61c"}
May 25 01:11:24.007309 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:24.007284    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"]
May 25 01:11:24.016056 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:24.016006    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a042dcd_eeae_4869_b988_5b14c9adbc63.slice/crio-4f5521a1a1ae9e71d506bddf9ab862597d745dfc4a957b05168606ca943e6ab2 WatchSource:0}: Error finding container 4f5521a1a1ae9e71d506bddf9ab862597d745dfc4a957b05168606ca943e6ab2: Status 404 returned error can't find the container with id 4f5521a1a1ae9e71d506bddf9ab862597d745dfc4a957b05168606ca943e6ab2
May 25 01:11:25.003836 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.003744    2560 generic.go:358] "Generic (PLEG): container finished" podID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerID="c2891e57a524496988c335debdff7855ccfb4f4c327aeea42d449b62199f87f1" exitCode=0
May 25 01:11:25.003836 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.003813    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r" event={"ID":"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e","Type":"ContainerDied","Data":"c2891e57a524496988c335debdff7855ccfb4f4c327aeea42d449b62199f87f1"}
May 25 01:11:25.005371 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.005347    2560 generic.go:358] "Generic (PLEG): container finished" podID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerID="ce5839a3743d2eddc9da6e6023caf0c68a1e5f8f1e7a230dc750f9e141a089d5" exitCode=0
May 25 01:11:25.005478 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.005429    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8" event={"ID":"8a042dcd-eeae-4869-b988-5b14c9adbc63","Type":"ContainerDied","Data":"ce5839a3743d2eddc9da6e6023caf0c68a1e5f8f1e7a230dc750f9e141a089d5"}
May 25 01:11:25.005533 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.005485    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8" event={"ID":"8a042dcd-eeae-4869-b988-5b14c9adbc63","Type":"ContainerStarted","Data":"4f5521a1a1ae9e71d506bddf9ab862597d745dfc4a957b05168606ca943e6ab2"}
May 25 01:11:25.007691 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.007671    2560 generic.go:358] "Generic (PLEG): container finished" podID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerID="9fa79e2e26645f64790928f961295d584047eae577c60bad94d9523a6d4de442" exitCode=0
May 25 01:11:25.007802 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.007702    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7" event={"ID":"b27b1972-7740-47a1-a784-8761f4f6c24f","Type":"ContainerDied","Data":"9fa79e2e26645f64790928f961295d584047eae577c60bad94d9523a6d4de442"}
May 25 01:11:25.009503 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.009444    2560 generic.go:358] "Generic (PLEG): container finished" podID="62d297fb-3449-4575-ac94-de525cbf4008" containerID="32ccbe7734cea39a2aed3657dfcf20968c90b3cf81d75de117369620cec69e13" exitCode=0
May 25 01:11:25.009503 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:25.009487    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg" event={"ID":"62d297fb-3449-4575-ac94-de525cbf4008","Type":"ContainerDied","Data":"32ccbe7734cea39a2aed3657dfcf20968c90b3cf81d75de117369620cec69e13"}
May 25 01:11:26.015445 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.015411    2560 generic.go:358] "Generic (PLEG): container finished" podID="62d297fb-3449-4575-ac94-de525cbf4008" containerID="ba254229119e02b0e6b70034253d84f6b901699da5f81eeb91d83f3487109bd9" exitCode=0
May 25 01:11:26.015868 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.015490    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg" event={"ID":"62d297fb-3449-4575-ac94-de525cbf4008","Type":"ContainerDied","Data":"ba254229119e02b0e6b70034253d84f6b901699da5f81eeb91d83f3487109bd9"}
May 25 01:11:26.017378 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.017352    2560 generic.go:358] "Generic (PLEG): container finished" podID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerID="9dbfe0073a5cd4d777069b728cfd993393d3027deef55c16fce12c04244c04a4" exitCode=0
May 25 01:11:26.017476 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.017419    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r" event={"ID":"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e","Type":"ContainerDied","Data":"9dbfe0073a5cd4d777069b728cfd993393d3027deef55c16fce12c04244c04a4"}
May 25 01:11:26.019016 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.018989    2560 generic.go:358] "Generic (PLEG): container finished" podID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerID="70a3fba989c1a71bc3ef65ce6ff1ab8400c000a7af613bdc39cf0011002f4d0a" exitCode=0
May 25 01:11:26.019097 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.019016    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8" event={"ID":"8a042dcd-eeae-4869-b988-5b14c9adbc63","Type":"ContainerDied","Data":"70a3fba989c1a71bc3ef65ce6ff1ab8400c000a7af613bdc39cf0011002f4d0a"}
May 25 01:11:26.158667 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.158644    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:26.231551 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.231518    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-util\") pod \"b27b1972-7740-47a1-a784-8761f4f6c24f\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") "
May 25 01:11:26.231703 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.231587    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtvfc\" (UniqueName: \"kubernetes.io/projected/b27b1972-7740-47a1-a784-8761f4f6c24f-kube-api-access-qtvfc\") pod \"b27b1972-7740-47a1-a784-8761f4f6c24f\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") "
May 25 01:11:26.231703 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.231686    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-bundle\") pod \"b27b1972-7740-47a1-a784-8761f4f6c24f\" (UID: \"b27b1972-7740-47a1-a784-8761f4f6c24f\") "
May 25 01:11:26.232293 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.232200    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-bundle" (OuterVolumeSpecName: "bundle") pod "b27b1972-7740-47a1-a784-8761f4f6c24f" (UID: "b27b1972-7740-47a1-a784-8761f4f6c24f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:11:26.233818 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.233796    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27b1972-7740-47a1-a784-8761f4f6c24f-kube-api-access-qtvfc" (OuterVolumeSpecName: "kube-api-access-qtvfc") pod "b27b1972-7740-47a1-a784-8761f4f6c24f" (UID: "b27b1972-7740-47a1-a784-8761f4f6c24f"). InnerVolumeSpecName "kube-api-access-qtvfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:11:26.236826 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.236796    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-util" (OuterVolumeSpecName: "util") pod "b27b1972-7740-47a1-a784-8761f4f6c24f" (UID: "b27b1972-7740-47a1-a784-8761f4f6c24f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:11:26.333217 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.333120    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:26.333217 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.333159    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b27b1972-7740-47a1-a784-8761f4f6c24f-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:26.333217 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:26.333175    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtvfc\" (UniqueName: \"kubernetes.io/projected/b27b1972-7740-47a1-a784-8761f4f6c24f-kube-api-access-qtvfc\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:27.024499 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.024460    2560 generic.go:358] "Generic (PLEG): container finished" podID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerID="bea9a942f1b7e79a1fa19a6ec33044bcec9483711cc5cdfc3f7ccc8ac2965efc" exitCode=0
May 25 01:11:27.024898 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.024541    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8" event={"ID":"8a042dcd-eeae-4869-b988-5b14c9adbc63","Type":"ContainerDied","Data":"bea9a942f1b7e79a1fa19a6ec33044bcec9483711cc5cdfc3f7ccc8ac2965efc"}
May 25 01:11:27.026266 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.026243    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7"
May 25 01:11:27.026266 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.026256    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7" event={"ID":"b27b1972-7740-47a1-a784-8761f4f6c24f","Type":"ContainerDied","Data":"0019d69dc72186db4cc2ac45f252648bf4a462331d70cda6540f1660527fb8cc"}
May 25 01:11:27.026396 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.026282    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0019d69dc72186db4cc2ac45f252648bf4a462331d70cda6540f1660527fb8cc"
May 25 01:11:27.177099 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.177077    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:27.180123 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.180103    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:27.241120 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.241076    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-bundle\") pod \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") "
May 25 01:11:27.241304 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.241165    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-util\") pod \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") "
May 25 01:11:27.241304 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.241218    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq8cv\" (UniqueName: \"kubernetes.io/projected/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-kube-api-access-cq8cv\") pod \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\" (UID: \"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e\") "
May 25 01:11:27.241675 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.241629    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-bundle" (OuterVolumeSpecName: "bundle") pod "c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" (UID: "c2c0d296-7169-456e-8d5e-5d4ed72d5a9e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:11:27.243414 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.243388    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-kube-api-access-cq8cv" (OuterVolumeSpecName: "kube-api-access-cq8cv") pod "c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" (UID: "c2c0d296-7169-456e-8d5e-5d4ed72d5a9e"). InnerVolumeSpecName "kube-api-access-cq8cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:11:27.246511 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.246480    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-util" (OuterVolumeSpecName: "util") pod "c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" (UID: "c2c0d296-7169-456e-8d5e-5d4ed72d5a9e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:11:27.342365 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.342325    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-256h2\" (UniqueName: \"kubernetes.io/projected/62d297fb-3449-4575-ac94-de525cbf4008-kube-api-access-256h2\") pod \"62d297fb-3449-4575-ac94-de525cbf4008\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") "
May 25 01:11:27.342555 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.342437    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-bundle\") pod \"62d297fb-3449-4575-ac94-de525cbf4008\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") "
May 25 01:11:27.342555 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.342493    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-util\") pod \"62d297fb-3449-4575-ac94-de525cbf4008\" (UID: \"62d297fb-3449-4575-ac94-de525cbf4008\") "
May 25 01:11:27.342761 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.342744    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:27.342817 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.342767    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq8cv\" (UniqueName: \"kubernetes.io/projected/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-kube-api-access-cq8cv\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:27.342817 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.342783    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2c0d296-7169-456e-8d5e-5d4ed72d5a9e-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:27.342907 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.342853    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-bundle" (OuterVolumeSpecName: "bundle") pod "62d297fb-3449-4575-ac94-de525cbf4008" (UID: "62d297fb-3449-4575-ac94-de525cbf4008"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:11:27.344628 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.344601    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d297fb-3449-4575-ac94-de525cbf4008-kube-api-access-256h2" (OuterVolumeSpecName: "kube-api-access-256h2") pod "62d297fb-3449-4575-ac94-de525cbf4008" (UID: "62d297fb-3449-4575-ac94-de525cbf4008"). InnerVolumeSpecName "kube-api-access-256h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:11:27.348124 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.348095    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-util" (OuterVolumeSpecName: "util") pod "62d297fb-3449-4575-ac94-de525cbf4008" (UID: "62d297fb-3449-4575-ac94-de525cbf4008"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:11:27.443237 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.443193    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-256h2\" (UniqueName: \"kubernetes.io/projected/62d297fb-3449-4575-ac94-de525cbf4008-kube-api-access-256h2\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:27.443388 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.443261    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:27.443388 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:27.443272    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d297fb-3449-4575-ac94-de525cbf4008-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:28.032262 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.032214    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r"
May 25 01:11:28.032680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.032213    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r" event={"ID":"c2c0d296-7169-456e-8d5e-5d4ed72d5a9e","Type":"ContainerDied","Data":"588c1111047a1a72d2877435049b59cce78695ad0b59e7b109e249bb8e42b468"}
May 25 01:11:28.032680 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.032374    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="588c1111047a1a72d2877435049b59cce78695ad0b59e7b109e249bb8e42b468"
May 25 01:11:28.034034 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.034011    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg" event={"ID":"62d297fb-3449-4575-ac94-de525cbf4008","Type":"ContainerDied","Data":"5cff551629e98dcd80ac2260651bf3d52ed83f0eee3486d5330098c910b5a334"}
May 25 01:11:28.034121 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.034038    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cff551629e98dcd80ac2260651bf3d52ed83f0eee3486d5330098c910b5a334"
May 25 01:11:28.034170 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.034148    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg"
May 25 01:11:28.163959 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.163934    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:28.250741 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.250700    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwwbj\" (UniqueName: \"kubernetes.io/projected/8a042dcd-eeae-4869-b988-5b14c9adbc63-kube-api-access-fwwbj\") pod \"8a042dcd-eeae-4869-b988-5b14c9adbc63\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") "
May 25 01:11:28.250900 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.250769    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-util\") pod \"8a042dcd-eeae-4869-b988-5b14c9adbc63\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") "
May 25 01:11:28.250900 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.250818    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-bundle\") pod \"8a042dcd-eeae-4869-b988-5b14c9adbc63\" (UID: \"8a042dcd-eeae-4869-b988-5b14c9adbc63\") "
May 25 01:11:28.251594 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.251565    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-bundle" (OuterVolumeSpecName: "bundle") pod "8a042dcd-eeae-4869-b988-5b14c9adbc63" (UID: "8a042dcd-eeae-4869-b988-5b14c9adbc63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:11:28.253049 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.253026    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a042dcd-eeae-4869-b988-5b14c9adbc63-kube-api-access-fwwbj" (OuterVolumeSpecName: "kube-api-access-fwwbj") pod "8a042dcd-eeae-4869-b988-5b14c9adbc63" (UID: "8a042dcd-eeae-4869-b988-5b14c9adbc63"). InnerVolumeSpecName "kube-api-access-fwwbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:11:28.256351 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.256320    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-util" (OuterVolumeSpecName: "util") pod "8a042dcd-eeae-4869-b988-5b14c9adbc63" (UID: "8a042dcd-eeae-4869-b988-5b14c9adbc63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:11:28.351991 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.351956    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-util\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:28.351991 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.351980    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a042dcd-eeae-4869-b988-5b14c9adbc63-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:28.351991 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:28.351990    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwwbj\" (UniqueName: \"kubernetes.io/projected/8a042dcd-eeae-4869-b988-5b14c9adbc63-kube-api-access-fwwbj\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:11:29.039145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:29.039111    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8" event={"ID":"8a042dcd-eeae-4869-b988-5b14c9adbc63","Type":"ContainerDied","Data":"4f5521a1a1ae9e71d506bddf9ab862597d745dfc4a957b05168606ca943e6ab2"}
May 25 01:11:29.039145 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:29.039144    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f5521a1a1ae9e71d506bddf9ab862597d745dfc4a957b05168606ca943e6ab2"
May 25 01:11:29.039568 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:29.039161    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8"
May 25 01:11:31.784670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.784629    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f97c86858-59z7q"]
May 25 01:11:31.785055 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785025    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerName="util"
May 25 01:11:31.785055 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785038    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerName="util"
May 25 01:11:31.785055 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785051    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d297fb-3449-4575-ac94-de525cbf4008" containerName="extract"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785060    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d297fb-3449-4575-ac94-de525cbf4008" containerName="extract"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785069    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerName="pull"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785075    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerName="pull"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785080    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerName="pull"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785085    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerName="pull"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785093    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d297fb-3449-4575-ac94-de525cbf4008" containerName="pull"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785098    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d297fb-3449-4575-ac94-de525cbf4008" containerName="pull"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785107    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerName="util"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785112    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerName="util"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785116    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerName="extract"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785121    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerName="extract"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785128    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerName="pull"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785136    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerName="pull"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785156    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerName="extract"
May 25 01:11:31.785158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785161    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerName="extract"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785167    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerName="extract"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785173    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerName="extract"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785181    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d297fb-3449-4575-ac94-de525cbf4008" containerName="util"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785186    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d297fb-3449-4575-ac94-de525cbf4008" containerName="util"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785191    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerName="util"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785196    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerName="util"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785268    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a042dcd-eeae-4869-b988-5b14c9adbc63" containerName="extract"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785278    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="b27b1972-7740-47a1-a784-8761f4f6c24f" containerName="extract"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785286    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2c0d296-7169-456e-8d5e-5d4ed72d5a9e" containerName="extract"
May 25 01:11:31.785779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.785294    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="62d297fb-3449-4575-ac94-de525cbf4008" containerName="extract"
May 25 01:11:31.789877 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.789858    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.796437 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.796413    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f97c86858-59z7q"]
May 25 01:11:31.884155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.884122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwv6m\" (UniqueName: \"kubernetes.io/projected/0fc5e053-5214-4cd1-8dcf-220482480363-kube-api-access-rwv6m\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.884339 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.884167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fc5e053-5214-4cd1-8dcf-220482480363-console-oauth-config\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.884339 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.884195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-oauth-serving-cert\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.884339 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.884310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-trusted-ca-bundle\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.884437 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.884353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-console-config\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.884482 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.884439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-service-ca\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.884529 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.884480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fc5e053-5214-4cd1-8dcf-220482480363-console-serving-cert\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.985166 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.985130    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fc5e053-5214-4cd1-8dcf-220482480363-console-serving-cert\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.985359 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.985185    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwv6m\" (UniqueName: \"kubernetes.io/projected/0fc5e053-5214-4cd1-8dcf-220482480363-kube-api-access-rwv6m\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.985359 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.985219    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fc5e053-5214-4cd1-8dcf-220482480363-console-oauth-config\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.985359 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.985270    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-oauth-serving-cert\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.985540 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.985484    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-trusted-ca-bundle\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.985595 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.985537    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-console-config\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.985649 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.985599    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-service-ca\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.986191 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.986165    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-console-config\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.986321 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.986168    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-oauth-serving-cert\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.986439 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.986414    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-trusted-ca-bundle\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.986472 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.986424    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc5e053-5214-4cd1-8dcf-220482480363-service-ca\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.987826 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.987806    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fc5e053-5214-4cd1-8dcf-220482480363-console-oauth-config\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.987923 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.987910    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fc5e053-5214-4cd1-8dcf-220482480363-console-serving-cert\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:31.993329 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:31.993307    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwv6m\" (UniqueName: \"kubernetes.io/projected/0fc5e053-5214-4cd1-8dcf-220482480363-kube-api-access-rwv6m\") pod \"console-6f97c86858-59z7q\" (UID: \"0fc5e053-5214-4cd1-8dcf-220482480363\") " pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:32.101108 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:32.101072    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:32.245208 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:32.245182    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f97c86858-59z7q"]
May 25 01:11:32.246474 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:32.246448    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc5e053_5214_4cd1_8dcf_220482480363.slice/crio-c760671a32078c31cff38ff4f2207dda4f36deb8e658e6397d0bdf4da1daf54c WatchSource:0}: Error finding container c760671a32078c31cff38ff4f2207dda4f36deb8e658e6397d0bdf4da1daf54c: Status 404 returned error can't find the container with id c760671a32078c31cff38ff4f2207dda4f36deb8e658e6397d0bdf4da1daf54c
May 25 01:11:33.054571 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:33.054532    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f97c86858-59z7q" event={"ID":"0fc5e053-5214-4cd1-8dcf-220482480363","Type":"ContainerStarted","Data":"30342bb31a34d64788f771c1219e23933762f8f04eadc144ad171b87c83d6d7d"}
May 25 01:11:33.054571 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:33.054577    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f97c86858-59z7q" event={"ID":"0fc5e053-5214-4cd1-8dcf-220482480363","Type":"ContainerStarted","Data":"c760671a32078c31cff38ff4f2207dda4f36deb8e658e6397d0bdf4da1daf54c"}
May 25 01:11:33.070960 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:33.070850    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6f97c86858-59z7q" podStartSLOduration=2.070834946 podStartE2EDuration="2.070834946s" podCreationTimestamp="2026-05-25 01:11:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:11:33.069138487 +0000 UTC m=+543.497349361" watchObservedRunningTime="2026-05-25 01:11:33.070834946 +0000 UTC m=+543.499045820"
May 25 01:11:37.667289 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:37.667247    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"]
May 25 01:11:37.670844 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:37.670828    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:11:37.677191 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:37.677157    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vwfcn\""
May 25 01:11:37.682245 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:37.682205    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"]
May 25 01:11:37.842356 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:37.842315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtxh8\" (UniqueName: \"kubernetes.io/projected/7edd20ce-27c4-41c4-b520-2d67db187c43-kube-api-access-jtxh8\") pod \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" (UID: \"7edd20ce-27c4-41c4-b520-2d67db187c43\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:11:37.943747 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:37.943645    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtxh8\" (UniqueName: \"kubernetes.io/projected/7edd20ce-27c4-41c4-b520-2d67db187c43-kube-api-access-jtxh8\") pod \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" (UID: \"7edd20ce-27c4-41c4-b520-2d67db187c43\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:11:37.951925 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:37.951898    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtxh8\" (UniqueName: \"kubernetes.io/projected/7edd20ce-27c4-41c4-b520-2d67db187c43-kube-api-access-jtxh8\") pod \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" (UID: \"7edd20ce-27c4-41c4-b520-2d67db187c43\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:11:37.982001 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:37.981970    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:11:38.117478 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:38.117444    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"]
May 25 01:11:38.119149 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:38.119125    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7edd20ce_27c4_41c4_b520_2d67db187c43.slice/crio-5b10a82a42a434ed7d0ff7852c4fec77e7bc5aa33ef88ac85a3c7029be8f4fc8 WatchSource:0}: Error finding container 5b10a82a42a434ed7d0ff7852c4fec77e7bc5aa33ef88ac85a3c7029be8f4fc8: Status 404 returned error can't find the container with id 5b10a82a42a434ed7d0ff7852c4fec77e7bc5aa33ef88ac85a3c7029be8f4fc8
May 25 01:11:39.078005 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:39.077966    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" event={"ID":"7edd20ce-27c4-41c4-b520-2d67db187c43","Type":"ContainerStarted","Data":"5b10a82a42a434ed7d0ff7852c4fec77e7bc5aa33ef88ac85a3c7029be8f4fc8"}
May 25 01:11:40.083182 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:40.083143    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" event={"ID":"7edd20ce-27c4-41c4-b520-2d67db187c43","Type":"ContainerStarted","Data":"5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9"}
May 25 01:11:40.083579 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:40.083269    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:11:40.100241 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:40.100170    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" podStartSLOduration=1.6705293239999999 podStartE2EDuration="3.100154623s" podCreationTimestamp="2026-05-25 01:11:37 +0000 UTC" firstStartedPulling="2026-05-25 01:11:38.121058759 +0000 UTC m=+548.549269610" lastFinishedPulling="2026-05-25 01:11:39.550684057 +0000 UTC m=+549.978894909" observedRunningTime="2026-05-25 01:11:40.098670024 +0000 UTC m=+550.526880897" watchObservedRunningTime="2026-05-25 01:11:40.100154623 +0000 UTC m=+550.528365497"
May 25 01:11:42.102193 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:42.102158    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:42.102577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:42.102259    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:42.107068 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:42.107047    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:43.097664 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:43.097637    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f97c86858-59z7q"
May 25 01:11:43.156690 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:43.156655    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858f87c8c9-jpp5p"]
May 25 01:11:49.772781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.772737    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"]
May 25 01:11:49.780766 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.780743    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:49.783194 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.783165    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s7l95\""
May 25 01:11:49.786096 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.786067    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"]
May 25 01:11:49.851813 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.851773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjkjz\" (UniqueName: \"kubernetes.io/projected/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-kube-api-access-hjkjz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" (UID: \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:49.851813 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.851819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" (UID: \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:49.953125 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.953083    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjkjz\" (UniqueName: \"kubernetes.io/projected/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-kube-api-access-hjkjz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" (UID: \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:49.953325 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.953133    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" (UID: \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:49.953566 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.953546    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" (UID: \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:49.963194 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:49.963167    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjkjz\" (UniqueName: \"kubernetes.io/projected/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-kube-api-access-hjkjz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" (UID: \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:50.092718 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:50.092683    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:50.236155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:50.236113    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"]
May 25 01:11:50.240204 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:11:50.240175    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92ca52e_8b65_4300_bedf_6efa4ec4e58e.slice/crio-5204a5416007f279d73d15f090fb7d81685cd3a98f7458c4cf432f694fc26110 WatchSource:0}: Error finding container 5204a5416007f279d73d15f090fb7d81685cd3a98f7458c4cf432f694fc26110: Status 404 returned error can't find the container with id 5204a5416007f279d73d15f090fb7d81685cd3a98f7458c4cf432f694fc26110
May 25 01:11:51.089343 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:51.089308    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:11:51.127092 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:51.127060    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" event={"ID":"b92ca52e-8b65-4300-bedf-6efa4ec4e58e","Type":"ContainerStarted","Data":"5204a5416007f279d73d15f090fb7d81685cd3a98f7458c4cf432f694fc26110"}
May 25 01:11:56.148709 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:56.148664    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" event={"ID":"b92ca52e-8b65-4300-bedf-6efa4ec4e58e","Type":"ContainerStarted","Data":"60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a"}
May 25 01:11:56.149107 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:56.148759    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:11:56.168362 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:11:56.168308    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" podStartSLOduration=1.7319668190000002 podStartE2EDuration="7.168290923s" podCreationTimestamp="2026-05-25 01:11:49 +0000 UTC" firstStartedPulling="2026-05-25 01:11:50.243363837 +0000 UTC m=+560.671574688" lastFinishedPulling="2026-05-25 01:11:55.679687936 +0000 UTC m=+566.107898792" observedRunningTime="2026-05-25 01:11:56.166251249 +0000 UTC m=+566.594462119" watchObservedRunningTime="2026-05-25 01:11:56.168290923 +0000 UTC m=+566.596501797"
May 25 01:12:07.154803 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:07.154772    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:12:08.058201 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.058156    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"]
May 25 01:12:08.063175 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.063147    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:08.074759 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.074734    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"]
May 25 01:12:08.124174 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.124132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ghc\" (UniqueName: \"kubernetes.io/projected/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-kube-api-access-98ghc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" (UID: \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:08.124378 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.124189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" (UID: \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:08.177464 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.177413    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-858f87c8c9-jpp5p" podUID="d923c92a-be3a-4220-ac2f-b0f19151957d" containerName="console" containerID="cri-o://3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad" gracePeriod=15
May 25 01:12:08.225350 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.225319    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98ghc\" (UniqueName: \"kubernetes.io/projected/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-kube-api-access-98ghc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" (UID: \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:08.225488 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.225372    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" (UID: \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:08.225707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.225686    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" (UID: \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:08.237482 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.237454    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ghc\" (UniqueName: \"kubernetes.io/projected/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-kube-api-access-98ghc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" (UID: \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:08.374569 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.374535    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:08.423364 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.423340    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-858f87c8c9-jpp5p_d923c92a-be3a-4220-ac2f-b0f19151957d/console/0.log"
May 25 01:12:08.423498 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.423409    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:12:08.527761 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.527712    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbfs7\" (UniqueName: \"kubernetes.io/projected/d923c92a-be3a-4220-ac2f-b0f19151957d-kube-api-access-lbfs7\") pod \"d923c92a-be3a-4220-ac2f-b0f19151957d\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") "
May 25 01:12:08.527924 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.527791    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-oauth-config\") pod \"d923c92a-be3a-4220-ac2f-b0f19151957d\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") "
May 25 01:12:08.527924 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.527837    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-console-config\") pod \"d923c92a-be3a-4220-ac2f-b0f19151957d\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") "
May 25 01:12:08.527924 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.527900    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-oauth-serving-cert\") pod \"d923c92a-be3a-4220-ac2f-b0f19151957d\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") "
May 25 01:12:08.528101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.527924    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-service-ca\") pod \"d923c92a-be3a-4220-ac2f-b0f19151957d\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") "
May 25 01:12:08.528101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.527962    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-trusted-ca-bundle\") pod \"d923c92a-be3a-4220-ac2f-b0f19151957d\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") "
May 25 01:12:08.528101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.528012    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-serving-cert\") pod \"d923c92a-be3a-4220-ac2f-b0f19151957d\" (UID: \"d923c92a-be3a-4220-ac2f-b0f19151957d\") "
May 25 01:12:08.528545 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.528473    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d923c92a-be3a-4220-ac2f-b0f19151957d" (UID: "d923c92a-be3a-4220-ac2f-b0f19151957d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:12:08.528545 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.528486    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-console-config" (OuterVolumeSpecName: "console-config") pod "d923c92a-be3a-4220-ac2f-b0f19151957d" (UID: "d923c92a-be3a-4220-ac2f-b0f19151957d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:12:08.528730 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.528620    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d923c92a-be3a-4220-ac2f-b0f19151957d" (UID: "d923c92a-be3a-4220-ac2f-b0f19151957d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:12:08.528941 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.528914    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d923c92a-be3a-4220-ac2f-b0f19151957d" (UID: "d923c92a-be3a-4220-ac2f-b0f19151957d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:12:08.531045 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.531022    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d923c92a-be3a-4220-ac2f-b0f19151957d-kube-api-access-lbfs7" (OuterVolumeSpecName: "kube-api-access-lbfs7") pod "d923c92a-be3a-4220-ac2f-b0f19151957d" (UID: "d923c92a-be3a-4220-ac2f-b0f19151957d"). InnerVolumeSpecName "kube-api-access-lbfs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:12:08.531157 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.531039    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d923c92a-be3a-4220-ac2f-b0f19151957d" (UID: "d923c92a-be3a-4220-ac2f-b0f19151957d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:12:08.531275 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.531253    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d923c92a-be3a-4220-ac2f-b0f19151957d" (UID: "d923c92a-be3a-4220-ac2f-b0f19151957d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:12:08.535829 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.534120    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"]
May 25 01:12:08.536472 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:12:08.536450    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a199a8f_bb8d_4f8a_a103_fbcf503b7034.slice/crio-694460dc4bc6f466d00f255b80eb3d9caca549f2a5152dbfcfe06759eca8ddaa WatchSource:0}: Error finding container 694460dc4bc6f466d00f255b80eb3d9caca549f2a5152dbfcfe06759eca8ddaa: Status 404 returned error can't find the container with id 694460dc4bc6f466d00f255b80eb3d9caca549f2a5152dbfcfe06759eca8ddaa
May 25 01:12:08.629765 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.629727    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-oauth-serving-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:08.629765 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.629757    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:08.629765 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.629767    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-trusted-ca-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:08.629990 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.629777    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-serving-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:08.629990 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.629786    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbfs7\" (UniqueName: \"kubernetes.io/projected/d923c92a-be3a-4220-ac2f-b0f19151957d-kube-api-access-lbfs7\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:08.629990 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.629795    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d923c92a-be3a-4220-ac2f-b0f19151957d-console-oauth-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:08.629990 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.629803    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d923c92a-be3a-4220-ac2f-b0f19151957d-console-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:08.699786 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.699746    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"]
May 25 01:12:08.700076 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.700046    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" containerName="manager" containerID="cri-o://60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a" gracePeriod=2
May 25 01:12:08.708625 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.708572    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"]
May 25 01:12:08.722535 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.722454    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"]
May 25 01:12:08.723052 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.723033    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d923c92a-be3a-4220-ac2f-b0f19151957d" containerName="console"
May 25 01:12:08.723148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.723055    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d923c92a-be3a-4220-ac2f-b0f19151957d" containerName="console"
May 25 01:12:08.723148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.723083    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" containerName="manager"
May 25 01:12:08.723148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.723091    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" containerName="manager"
May 25 01:12:08.723293 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.723179    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" containerName="manager"
May 25 01:12:08.723293 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.723196    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="d923c92a-be3a-4220-ac2f-b0f19151957d" containerName="console"
May 25 01:12:08.726639 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.726497    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"]
May 25 01:12:08.726751 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.726638    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:08.728702 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.728668    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:08.730238 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.730195    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"]
May 25 01:12:08.737856 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.737811    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"]
May 25 01:12:08.757090 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.757040    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"]
May 25 01:12:08.757392 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.757355    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" containerName="manager" containerID="cri-o://5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9" gracePeriod=2
May 25 01:12:08.759712 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.759674    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:08.761545 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.761510    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:08.761835 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.761812    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"]
May 25 01:12:08.762614 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.762592    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" containerName="manager"
May 25 01:12:08.762825 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.762781    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" containerName="manager"
May 25 01:12:08.762982 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.762965    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" containerName="manager"
May 25 01:12:08.766507 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.766488    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:08.769638 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.769606    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:08.771115 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.771080    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"]
May 25 01:12:08.780325 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.780300    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"]
May 25 01:12:08.793847 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.793807    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:08.831121 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.831095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxb9f\" (UniqueName: \"kubernetes.io/projected/027bb234-ee10-4ad1-8b85-a076f0b4af9a-kube-api-access-zxb9f\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mdgs9\" (UID: \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:08.831285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.831129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6cf9\" (UniqueName: \"kubernetes.io/projected/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-kube-api-access-t6cf9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj\" (UID: \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:08.831285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.831167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/027bb234-ee10-4ad1-8b85-a076f0b4af9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mdgs9\" (UID: \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:08.831285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.831239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj\" (UID: \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:08.932875 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.932838    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxb9f\" (UniqueName: \"kubernetes.io/projected/027bb234-ee10-4ad1-8b85-a076f0b4af9a-kube-api-access-zxb9f\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mdgs9\" (UID: \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:08.933028 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.932885    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6cf9\" (UniqueName: \"kubernetes.io/projected/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-kube-api-access-t6cf9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj\" (UID: \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:08.933028 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.932915    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/027bb234-ee10-4ad1-8b85-a076f0b4af9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mdgs9\" (UID: \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:08.933028 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.932962    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj\" (UID: \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:08.933563 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.933365    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/027bb234-ee10-4ad1-8b85-a076f0b4af9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mdgs9\" (UID: \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:08.933563 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.933432    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj\" (UID: \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:08.945378 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.945343    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6cf9\" (UniqueName: \"kubernetes.io/projected/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-kube-api-access-t6cf9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj\" (UID: \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:08.945779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.945753    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxb9f\" (UniqueName: \"kubernetes.io/projected/027bb234-ee10-4ad1-8b85-a076f0b4af9a-kube-api-access-zxb9f\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mdgs9\" (UID: \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:08.984929 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.984904    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:12:08.987203 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.987167    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:08.989045 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.989011    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:08.994143 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.994121    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:12:08.996086 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.996060    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:08.997687 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:08.997664    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.134776 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.134742    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:09.134943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.134822    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjkjz\" (UniqueName: \"kubernetes.io/projected/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-kube-api-access-hjkjz\") pod \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\" (UID: \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\") "
May 25 01:12:09.134943 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.134864    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-extensions-socket-volume\") pod \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\" (UID: \"b92ca52e-8b65-4300-bedf-6efa4ec4e58e\") "
May 25 01:12:09.135026 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.134980    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtxh8\" (UniqueName: \"kubernetes.io/projected/7edd20ce-27c4-41c4-b520-2d67db187c43-kube-api-access-jtxh8\") pod \"7edd20ce-27c4-41c4-b520-2d67db187c43\" (UID: \"7edd20ce-27c4-41c4-b520-2d67db187c43\") "
May 25 01:12:09.135792 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.135441    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b92ca52e-8b65-4300-bedf-6efa4ec4e58e" (UID: "b92ca52e-8b65-4300-bedf-6efa4ec4e58e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:12:09.137101 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.137080    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-kube-api-access-hjkjz" (OuterVolumeSpecName: "kube-api-access-hjkjz") pod "b92ca52e-8b65-4300-bedf-6efa4ec4e58e" (UID: "b92ca52e-8b65-4300-bedf-6efa4ec4e58e"). InnerVolumeSpecName "kube-api-access-hjkjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:12:09.137192 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.137147    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7edd20ce-27c4-41c4-b520-2d67db187c43-kube-api-access-jtxh8" (OuterVolumeSpecName: "kube-api-access-jtxh8") pod "7edd20ce-27c4-41c4-b520-2d67db187c43" (UID: "7edd20ce-27c4-41c4-b520-2d67db187c43"). InnerVolumeSpecName "kube-api-access-jtxh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:12:09.140852 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.140833    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:09.211386 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.210165    2560 generic.go:358] "Generic (PLEG): container finished" podID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" containerID="60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a" exitCode=0
May 25 01:12:09.211386 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.210321    2560 scope.go:117] "RemoveContainer" containerID="60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a"
May 25 01:12:09.211386 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.210474    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb"
May 25 01:12:09.216149 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.215877    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.216620 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:12:09.216588    2560 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" container="manager"
May 25 01:12:09.218030 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.217818    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.220827 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.219245    2560 generic.go:358] "Generic (PLEG): container finished" podID="7edd20ce-27c4-41c4-b520-2d67db187c43" containerID="5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9" exitCode=0
May 25 01:12:09.220827 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.219432    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5"
May 25 01:12:09.220827 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.220208    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.221649 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.221627    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-858f87c8c9-jpp5p_d923c92a-be3a-4220-ac2f-b0f19151957d/console/0.log"
May 25 01:12:09.221784 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.221667    2560 generic.go:358] "Generic (PLEG): container finished" podID="d923c92a-be3a-4220-ac2f-b0f19151957d" containerID="3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad" exitCode=2
May 25 01:12:09.221784 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.221703    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858f87c8c9-jpp5p" event={"ID":"d923c92a-be3a-4220-ac2f-b0f19151957d","Type":"ContainerDied","Data":"3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad"}
May 25 01:12:09.221784 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.221732    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858f87c8c9-jpp5p" event={"ID":"d923c92a-be3a-4220-ac2f-b0f19151957d","Type":"ContainerDied","Data":"7fc2ad5c519d421ec906cf7c725c34c5f0bafd7cbb5e0953d9d292428dbccf5a"}
May 25 01:12:09.221974 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.221811    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858f87c8c9-jpp5p"
May 25 01:12:09.228723 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.227475    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.232483 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.232257    2560 status_manager.go:895] "Failed to get status for pod" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.234471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.234284    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.234471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.234365    2560 scope.go:117] "RemoveContainer" containerID="60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a"
May 25 01:12:09.234939 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:12:09.234913    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a\": container with ID starting with 60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a not found: ID does not exist" containerID="60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a"
May 25 01:12:09.235213 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.235170    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a"} err="failed to get container status \"60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a\": rpc error: code = NotFound desc = could not find container \"60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a\": container with ID starting with 60b2bf30bd331a1d6e1eade2a99d70c80e751ea340911e9e0f32c300be90867a not found: ID does not exist"
May 25 01:12:09.235413 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.235383    2560 scope.go:117] "RemoveContainer" containerID="5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9"
May 25 01:12:09.236002 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.235813    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtxh8\" (UniqueName: \"kubernetes.io/projected/7edd20ce-27c4-41c4-b520-2d67db187c43-kube-api-access-jtxh8\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:09.236002 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.235841    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjkjz\" (UniqueName: \"kubernetes.io/projected/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-kube-api-access-hjkjz\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:09.236002 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.235859    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92ca52e-8b65-4300-bedf-6efa4ec4e58e-extensions-socket-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:09.236740 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.236124    2560 status_manager.go:895] "Failed to get status for pod" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.238177 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.238135    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.253757 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.253735    2560 scope.go:117] "RemoveContainer" containerID="5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9"
May 25 01:12:09.254156 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:12:09.254096    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9\": container with ID starting with 5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9 not found: ID does not exist" containerID="5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9"
May 25 01:12:09.254212 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.254174    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9"} err="failed to get container status \"5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9\": rpc error: code = NotFound desc = could not find container \"5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9\": container with ID starting with 5242ceff07f62c31615f9a31bc9b4d3e68ca2c509ab6f440f37a72943b4bb7e9 not found: ID does not exist"
May 25 01:12:09.254212 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.254200    2560 scope.go:117] "RemoveContainer" containerID="3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad"
May 25 01:12:09.255697 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.255673    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.265158 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.265133    2560 scope.go:117] "RemoveContainer" containerID="3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad"
May 25 01:12:09.265568 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:12:09.265539    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad\": container with ID starting with 3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad not found: ID does not exist" containerID="3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad"
May 25 01:12:09.265653 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.265575    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad"} err="failed to get container status \"3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad\": rpc error: code = NotFound desc = could not find container \"3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad\": container with ID starting with 3e89a92fceddaae0af8e4a3ccaf604864fb43f877aee4c7895c74665ab7148ad not found: ID does not exist"
May 25 01:12:09.279598 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.279558    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858f87c8c9-jpp5p"]
May 25 01:12:09.283554 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.283291    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.285064 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.285032    2560 status_manager.go:895] "Failed to get status for pod" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:09.285574 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.285553    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-858f87c8c9-jpp5p"]
May 25 01:12:09.309104 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.309076    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"]
May 25 01:12:09.311195 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:12:09.311164    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027bb234_ee10_4ad1_8b85_a076f0b4af9a.slice/crio-2044aa6e093f9573ec95a0341edcf663d64fdfc2fde007af5a7ea50020da99d7 WatchSource:0}: Error finding container 2044aa6e093f9573ec95a0341edcf663d64fdfc2fde007af5a7ea50020da99d7: Status 404 returned error can't find the container with id 2044aa6e093f9573ec95a0341edcf663d64fdfc2fde007af5a7ea50020da99d7
May 25 01:12:09.325947 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:09.325918    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"]
May 25 01:12:09.327588 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:12:09.327559    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ae6c1b_0a28_4291_b9dc_450b258e6ac8.slice/crio-96ea09e9b3d3981e89c4ef8457354ed01df2d0c8f95302a69a402d9aa59e1129 WatchSource:0}: Error finding container 96ea09e9b3d3981e89c4ef8457354ed01df2d0c8f95302a69a402d9aa59e1129: Status 404 returned error can't find the container with id 96ea09e9b3d3981e89c4ef8457354ed01df2d0c8f95302a69a402d9aa59e1129
May 25 01:12:10.188195 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.188145    2560 status_manager.go:895] "Failed to get status for pod" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8sxx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-8sxx5\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:10.189849 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.189815    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" path="/var/lib/kubelet/pods/7edd20ce-27c4-41c4-b520-2d67db187c43/volumes"
May 25 01:12:10.190175 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.190162    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" path="/var/lib/kubelet/pods/b92ca52e-8b65-4300-bedf-6efa4ec4e58e/volumes"
May 25 01:12:10.190564 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.190541    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d923c92a-be3a-4220-ac2f-b0f19151957d" path="/var/lib/kubelet/pods/d923c92a-be3a-4220-ac2f-b0f19151957d/volumes"
May 25 01:12:10.190707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.190555    2560 status_manager.go:895] "Failed to get status for pod" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:10.227629 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.227569    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" containerName="manager" containerID="cri-o://c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6" gracePeriod=2
May 25 01:12:10.229294 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.229259    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj" event={"ID":"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8","Type":"ContainerStarted","Data":"53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6"}
May 25 01:12:10.229419 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.229302    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj" event={"ID":"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8","Type":"ContainerStarted","Data":"96ea09e9b3d3981e89c4ef8457354ed01df2d0c8f95302a69a402d9aa59e1129"}
May 25 01:12:10.229419 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.229414    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:10.232529 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.231919    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9" event={"ID":"027bb234-ee10-4ad1-8b85-a076f0b4af9a","Type":"ContainerStarted","Data":"be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0"}
May 25 01:12:10.232529 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.231953    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9" event={"ID":"027bb234-ee10-4ad1-8b85-a076f0b4af9a","Type":"ContainerStarted","Data":"2044aa6e093f9573ec95a0341edcf663d64fdfc2fde007af5a7ea50020da99d7"}
May 25 01:12:10.232529 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.231987    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:10.240776 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.240736    2560 status_manager.go:895] "Failed to get status for pod" podUID="b92ca52e-8b65-4300-bedf-6efa4ec4e58e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xc5kb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xc5kb\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:10.290198 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.290139    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9" podStartSLOduration=2.290123946 podStartE2EDuration="2.290123946s" podCreationTimestamp="2026-05-25 01:12:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:12:10.288957177 +0000 UTC m=+580.717168052" watchObservedRunningTime="2026-05-25 01:12:10.290123946 +0000 UTC m=+580.718334821"
May 25 01:12:10.311904 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.311846    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj" podStartSLOduration=2.311827006 podStartE2EDuration="2.311827006s" podCreationTimestamp="2026-05-25 01:12:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:12:10.30909452 +0000 UTC m=+580.737305399" watchObservedRunningTime="2026-05-25 01:12:10.311827006 +0000 UTC m=+580.740037880"
May 25 01:12:10.470038 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.470014    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:10.472208 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.472178    2560 status_manager.go:895] "Failed to get status for pod" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:10.550077 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.550038    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-extensions-socket-volume\") pod \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\" (UID: \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\") "
May 25 01:12:10.550281 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.550103    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98ghc\" (UniqueName: \"kubernetes.io/projected/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-kube-api-access-98ghc\") pod \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\" (UID: \"9a199a8f-bb8d-4f8a-a103-fbcf503b7034\") "
May 25 01:12:10.550410 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.550382    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9a199a8f-bb8d-4f8a-a103-fbcf503b7034" (UID: "9a199a8f-bb8d-4f8a-a103-fbcf503b7034"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:12:10.552392 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.552364    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-kube-api-access-98ghc" (OuterVolumeSpecName: "kube-api-access-98ghc") pod "9a199a8f-bb8d-4f8a-a103-fbcf503b7034" (UID: "9a199a8f-bb8d-4f8a-a103-fbcf503b7034"). InnerVolumeSpecName "kube-api-access-98ghc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:12:10.651206 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.651162    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-extensions-socket-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:10.651206 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:10.651199    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ghc\" (UniqueName: \"kubernetes.io/projected/9a199a8f-bb8d-4f8a-a103-fbcf503b7034-kube-api-access-98ghc\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:11.239861 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:11.239823    2560 generic.go:358] "Generic (PLEG): container finished" podID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" containerID="c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6" exitCode=2
May 25 01:12:11.240360 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:11.239879    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9"
May 25 01:12:11.240360 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:11.239908    2560 scope.go:117] "RemoveContainer" containerID="c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6"
May 25 01:12:11.242172 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:11.242145    2560 status_manager.go:895] "Failed to get status for pod" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:11.249216 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:11.249200    2560 scope.go:117] "RemoveContainer" containerID="c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6"
May 25 01:12:11.249507 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:12:11.249490    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6\": container with ID starting with c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6 not found: ID does not exist" containerID="c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6"
May 25 01:12:11.249559 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:11.249515    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6"} err="failed to get container status \"c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6\": rpc error: code = NotFound desc = could not find container \"c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6\": container with ID starting with c5017e8665408f3a0f2db92d07580d9f028b4405dbf14b35c36ff95006349da6 not found: ID does not exist"
May 25 01:12:11.250074 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:11.250056    2560 status_manager.go:895] "Failed to get status for pod" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-fdhj9\" is forbidden: User \"system:node:ip-10-0-133-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-121.ec2.internal' and this object"
May 25 01:12:12.184287 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:12.184252    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a199a8f-bb8d-4f8a-a103-fbcf503b7034" path="/var/lib/kubelet/pods/9a199a8f-bb8d-4f8a-a103-fbcf503b7034/volumes"
May 25 01:12:21.242824 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.242787    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:21.243345 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.242848    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:21.312766 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.312715    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"]
May 25 01:12:21.313007 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.312964    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9" podUID="027bb234-ee10-4ad1-8b85-a076f0b4af9a" containerName="manager" containerID="cri-o://be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0" gracePeriod=10
May 25 01:12:21.557848 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.557818    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:21.573628 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.573595    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"]
May 25 01:12:21.573929 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.573918    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="027bb234-ee10-4ad1-8b85-a076f0b4af9a" containerName="manager"
May 25 01:12:21.573973 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.573931    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="027bb234-ee10-4ad1-8b85-a076f0b4af9a" containerName="manager"
May 25 01:12:21.573973 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.573949    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" containerName="manager"
May 25 01:12:21.573973 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.573954    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" containerName="manager"
May 25 01:12:21.574063 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.574007    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="027bb234-ee10-4ad1-8b85-a076f0b4af9a" containerName="manager"
May 25 01:12:21.574063 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.574018    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="7edd20ce-27c4-41c4-b520-2d67db187c43" containerName="manager"
May 25 01:12:21.576975 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.576956    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:21.593358 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.593305    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"]
May 25 01:12:21.647911 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.647870    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/027bb234-ee10-4ad1-8b85-a076f0b4af9a-extensions-socket-volume\") pod \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\" (UID: \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\") "
May 25 01:12:21.648210 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.647923    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxb9f\" (UniqueName: \"kubernetes.io/projected/027bb234-ee10-4ad1-8b85-a076f0b4af9a-kube-api-access-zxb9f\") pod \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\" (UID: \"027bb234-ee10-4ad1-8b85-a076f0b4af9a\") "
May 25 01:12:21.648368 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.648343    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/027bb234-ee10-4ad1-8b85-a076f0b4af9a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "027bb234-ee10-4ad1-8b85-a076f0b4af9a" (UID: "027bb234-ee10-4ad1-8b85-a076f0b4af9a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:12:21.650594 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.650557    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/027bb234-ee10-4ad1-8b85-a076f0b4af9a-kube-api-access-zxb9f" (OuterVolumeSpecName: "kube-api-access-zxb9f") pod "027bb234-ee10-4ad1-8b85-a076f0b4af9a" (UID: "027bb234-ee10-4ad1-8b85-a076f0b4af9a"). InnerVolumeSpecName "kube-api-access-zxb9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:12:21.749165 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.749125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vd67r\" (UID: \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:21.749397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.749287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsxrd\" (UniqueName: \"kubernetes.io/projected/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-kube-api-access-wsxrd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vd67r\" (UID: \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:21.749397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.749344    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/027bb234-ee10-4ad1-8b85-a076f0b4af9a-extensions-socket-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:21.749397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.749358    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxb9f\" (UniqueName: \"kubernetes.io/projected/027bb234-ee10-4ad1-8b85-a076f0b4af9a-kube-api-access-zxb9f\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:21.850749 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.850713    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsxrd\" (UniqueName: \"kubernetes.io/projected/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-kube-api-access-wsxrd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vd67r\" (UID: \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:21.850950 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.850770    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vd67r\" (UID: \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:21.851192 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.851171    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vd67r\" (UID: \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:21.859344 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.859318    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsxrd\" (UniqueName: \"kubernetes.io/projected/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-kube-api-access-wsxrd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vd67r\" (UID: \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:21.887437 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:21.887406    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:22.023143 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.023113    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"]
May 25 01:12:22.025314 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:12:22.025288    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf658a1d8_798c_4e0c_a260_aa4ebf0da1bd.slice/crio-9a81a92f9bc8140e67d02ff9a2231e84c76e39c6c331a9a01a20527af859b9c6 WatchSource:0}: Error finding container 9a81a92f9bc8140e67d02ff9a2231e84c76e39c6c331a9a01a20527af859b9c6: Status 404 returned error can't find the container with id 9a81a92f9bc8140e67d02ff9a2231e84c76e39c6c331a9a01a20527af859b9c6
May 25 01:12:22.287153 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.287114    2560 generic.go:358] "Generic (PLEG): container finished" podID="027bb234-ee10-4ad1-8b85-a076f0b4af9a" containerID="be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0" exitCode=0
May 25 01:12:22.287632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.287164    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9" event={"ID":"027bb234-ee10-4ad1-8b85-a076f0b4af9a","Type":"ContainerDied","Data":"be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0"}
May 25 01:12:22.287632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.287198    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9" event={"ID":"027bb234-ee10-4ad1-8b85-a076f0b4af9a","Type":"ContainerDied","Data":"2044aa6e093f9573ec95a0341edcf663d64fdfc2fde007af5a7ea50020da99d7"}
May 25 01:12:22.287632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.287214    2560 scope.go:117] "RemoveContainer" containerID="be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0"
May 25 01:12:22.287632 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.287240    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"
May 25 01:12:22.288864 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.288835    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r" event={"ID":"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd","Type":"ContainerStarted","Data":"d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240"}
May 25 01:12:22.288864 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.288873    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r" event={"ID":"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd","Type":"ContainerStarted","Data":"9a81a92f9bc8140e67d02ff9a2231e84c76e39c6c331a9a01a20527af859b9c6"}
May 25 01:12:22.289054 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.289026    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:22.296791 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.296772    2560 scope.go:117] "RemoveContainer" containerID="be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0"
May 25 01:12:22.297049 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:12:22.297030    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0\": container with ID starting with be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0 not found: ID does not exist" containerID="be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0"
May 25 01:12:22.297109 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.297058    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0"} err="failed to get container status \"be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0\": rpc error: code = NotFound desc = could not find container \"be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0\": container with ID starting with be26ce12cee37b3a54eb2f74b4cf64cd0acc2f71e68cf1f31e66b90a52366cc0 not found: ID does not exist"
May 25 01:12:22.304529 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.304504    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"]
May 25 01:12:22.314471 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.314445    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mdgs9"]
May 25 01:12:22.346967 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:22.346917    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r" podStartSLOduration=1.346900752 podStartE2EDuration="1.346900752s" podCreationTimestamp="2026-05-25 01:12:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:12:22.343219326 +0000 UTC m=+592.771430202" watchObservedRunningTime="2026-05-25 01:12:22.346900752 +0000 UTC m=+592.775111625"
May 25 01:12:24.183175 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:24.183136    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="027bb234-ee10-4ad1-8b85-a076f0b4af9a" path="/var/lib/kubelet/pods/027bb234-ee10-4ad1-8b85-a076f0b4af9a/volumes"
May 25 01:12:30.123432 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:30.123403    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:12:30.125913 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:30.125887    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:12:30.126303 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:30.126287    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:12:30.128646 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:30.128630    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:12:33.296833 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.296795    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:12:33.348299 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.348267    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"]
May 25 01:12:33.348593 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.348568    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj" podUID="e5ae6c1b-0a28-4291-b9dc-450b258e6ac8" containerName="manager" containerID="cri-o://53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6" gracePeriod=10
May 25 01:12:33.601259 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.601213    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:33.655962 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.655931    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-extensions-socket-volume\") pod \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\" (UID: \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\") "
May 25 01:12:33.656157 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.656059    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6cf9\" (UniqueName: \"kubernetes.io/projected/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-kube-api-access-t6cf9\") pod \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\" (UID: \"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8\") "
May 25 01:12:33.656375 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.656348    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e5ae6c1b-0a28-4291-b9dc-450b258e6ac8" (UID: "e5ae6c1b-0a28-4291-b9dc-450b258e6ac8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:12:33.658360 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.658325    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-kube-api-access-t6cf9" (OuterVolumeSpecName: "kube-api-access-t6cf9") pod "e5ae6c1b-0a28-4291-b9dc-450b258e6ac8" (UID: "e5ae6c1b-0a28-4291-b9dc-450b258e6ac8"). InnerVolumeSpecName "kube-api-access-t6cf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:12:33.756949 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.756919    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6cf9\" (UniqueName: \"kubernetes.io/projected/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-kube-api-access-t6cf9\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:33.756949 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:33.756946    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8-extensions-socket-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:12:34.334167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.334133    2560 generic.go:358] "Generic (PLEG): container finished" podID="e5ae6c1b-0a28-4291-b9dc-450b258e6ac8" containerID="53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6" exitCode=0
May 25 01:12:34.334577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.334209    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"
May 25 01:12:34.334577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.334246    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj" event={"ID":"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8","Type":"ContainerDied","Data":"53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6"}
May 25 01:12:34.334577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.334291    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj" event={"ID":"e5ae6c1b-0a28-4291-b9dc-450b258e6ac8","Type":"ContainerDied","Data":"96ea09e9b3d3981e89c4ef8457354ed01df2d0c8f95302a69a402d9aa59e1129"}
May 25 01:12:34.334577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.334313    2560 scope.go:117] "RemoveContainer" containerID="53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6"
May 25 01:12:34.342963 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.342947    2560 scope.go:117] "RemoveContainer" containerID="53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6"
May 25 01:12:34.343273 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:12:34.343255    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6\": container with ID starting with 53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6 not found: ID does not exist" containerID="53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6"
May 25 01:12:34.343349 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.343286    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6"} err="failed to get container status \"53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6\": rpc error: code = NotFound desc = could not find container \"53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6\": container with ID starting with 53afd5e3760fd9708f624ba4a0793b97c9212feed85b87b46a52fc126da61ba6 not found: ID does not exist"
May 25 01:12:34.353782 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.353760    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"]
May 25 01:12:34.360727 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:34.360707    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-vnqpj"]
May 25 01:12:36.183200 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:36.183164    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5ae6c1b-0a28-4291-b9dc-450b258e6ac8" path="/var/lib/kubelet/pods/e5ae6c1b-0a28-4291-b9dc-450b258e6ac8/volumes"
May 25 01:12:37.491061 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.491029    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"]
May 25 01:12:37.491457 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.491447    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ae6c1b-0a28-4291-b9dc-450b258e6ac8" containerName="manager"
May 25 01:12:37.491515 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.491461    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ae6c1b-0a28-4291-b9dc-450b258e6ac8" containerName="manager"
May 25 01:12:37.491552 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.491533    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5ae6c1b-0a28-4291-b9dc-450b258e6ac8" containerName="manager"
May 25 01:12:37.496103 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.496076    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.498637 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.498611    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v7n8t\""
May 25 01:12:37.504565 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.504534    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"]
May 25 01:12:37.594886 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.594844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.594886 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.594888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.595132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.594910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.595132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.594961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.595132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.595058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.595132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.595090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.595132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.595110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/826c9caa-8034-4d90-8ae1-063b4c1664b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.595358 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.595141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8ql9\" (UniqueName: \"kubernetes.io/projected/826c9caa-8034-4d90-8ae1-063b4c1664b3-kube-api-access-l8ql9\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.595358 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.595176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.696526 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696490    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.696526 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696530    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.696731 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696549    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/826c9caa-8034-4d90-8ae1-063b4c1664b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.696731 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696674    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8ql9\" (UniqueName: \"kubernetes.io/projected/826c9caa-8034-4d90-8ae1-063b4c1664b3-kube-api-access-l8ql9\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.696731 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696726    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.696873 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696773    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.696873 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696811    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.696873 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696854    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.697026 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696891    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.697026 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.696937    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.697153 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.697131    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.697275 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.697251    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.697332 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.697310    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.697372 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.697335    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/826c9caa-8034-4d90-8ae1-063b4c1664b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.699277 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.699247    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.699450 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.699433    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.703992 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.703965    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/826c9caa-8034-4d90-8ae1-063b4c1664b3-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.704345 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.704219    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8ql9\" (UniqueName: \"kubernetes.io/projected/826c9caa-8034-4d90-8ae1-063b4c1664b3-kube-api-access-l8ql9\") pod \"maas-default-gateway-openshift-default-7df95f575-wkch7\" (UID: \"826c9caa-8034-4d90-8ae1-063b4c1664b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.809916 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.809828    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:37.945936 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.945908    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"]
May 25 01:12:37.947782 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:12:37.947744    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826c9caa_8034_4d90_8ae1_063b4c1664b3.slice/crio-8027c315f5b176cc286e4056bdd39e28cd5333cab15d5c3147ce2d53b7422b79 WatchSource:0}: Error finding container 8027c315f5b176cc286e4056bdd39e28cd5333cab15d5c3147ce2d53b7422b79: Status 404 returned error can't find the container with id 8027c315f5b176cc286e4056bdd39e28cd5333cab15d5c3147ce2d53b7422b79
May 25 01:12:37.949967 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.949931    2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 25 01:12:37.950062 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.950003    2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 25 01:12:37.950062 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:37.950031    2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 25 01:12:38.351426 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:38.351391    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7" event={"ID":"826c9caa-8034-4d90-8ae1-063b4c1664b3","Type":"ContainerStarted","Data":"1adc26e30ed871b358988adb9b34ab5a3774b994da54f9a5df8615203846ed35"}
May 25 01:12:38.351426 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:38.351432    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7" event={"ID":"826c9caa-8034-4d90-8ae1-063b4c1664b3","Type":"ContainerStarted","Data":"8027c315f5b176cc286e4056bdd39e28cd5333cab15d5c3147ce2d53b7422b79"}
May 25 01:12:38.371149 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:38.371104    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7" podStartSLOduration=1.371088517 podStartE2EDuration="1.371088517s" podCreationTimestamp="2026-05-25 01:12:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:12:38.368069568 +0000 UTC m=+608.796280443" watchObservedRunningTime="2026-05-25 01:12:38.371088517 +0000 UTC m=+608.799299391"
May 25 01:12:38.810274 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:38.810170    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:39.815165 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:39.815137    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:40.359366 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:40.359328    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:40.360426 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:40.360407    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-wkch7"
May 25 01:12:52.431013 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.430930    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6hrkv"]
May 25 01:12:52.434164 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.434149    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:52.436397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.436371    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 25 01:12:52.436506 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.436415    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cr74r\""
May 25 01:12:52.440761 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.440730    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6hrkv"]
May 25 01:12:52.532058 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.532018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1154c013-23f3-4dbf-8941-fa19fcfc75b1-config-file\") pod \"limitador-limitador-7d549b5b-6hrkv\" (UID: \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:52.532268 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.532208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4bf2\" (UniqueName: \"kubernetes.io/projected/1154c013-23f3-4dbf-8941-fa19fcfc75b1-kube-api-access-k4bf2\") pod \"limitador-limitador-7d549b5b-6hrkv\" (UID: \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:52.532827 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.532805    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6hrkv"]
May 25 01:12:52.633290 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.633249    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4bf2\" (UniqueName: \"kubernetes.io/projected/1154c013-23f3-4dbf-8941-fa19fcfc75b1-kube-api-access-k4bf2\") pod \"limitador-limitador-7d549b5b-6hrkv\" (UID: \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:52.633472 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.633303    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1154c013-23f3-4dbf-8941-fa19fcfc75b1-config-file\") pod \"limitador-limitador-7d549b5b-6hrkv\" (UID: \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:52.633930 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.633911    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1154c013-23f3-4dbf-8941-fa19fcfc75b1-config-file\") pod \"limitador-limitador-7d549b5b-6hrkv\" (UID: \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:52.641318 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.641293    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4bf2\" (UniqueName: \"kubernetes.io/projected/1154c013-23f3-4dbf-8941-fa19fcfc75b1-kube-api-access-k4bf2\") pod \"limitador-limitador-7d549b5b-6hrkv\" (UID: \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:52.745597 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.745515    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:52.885151 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.885125    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6hrkv"]
May 25 01:12:52.886582 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:12:52.886548    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1154c013_23f3_4dbf_8941_fa19fcfc75b1.slice/crio-09266d6eb8471de76cfa216da6f2a1e259c80f7dbca957af0d75efe7cd0931da WatchSource:0}: Error finding container 09266d6eb8471de76cfa216da6f2a1e259c80f7dbca957af0d75efe7cd0931da: Status 404 returned error can't find the container with id 09266d6eb8471de76cfa216da6f2a1e259c80f7dbca957af0d75efe7cd0931da
May 25 01:12:52.888478 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:52.888460    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:12:53.213679 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.213642    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gf8h"]
May 25 01:12:53.218378 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.218345    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h"
May 25 01:12:53.220911 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.220885    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-psqnc\""
May 25 01:12:53.230464 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.230135    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gf8h"]
May 25 01:12:53.341612 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.341571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b7nx\" (UniqueName: \"kubernetes.io/projected/61bb0385-621e-4348-9298-c8a1650cfcdf-kube-api-access-7b7nx\") pod \"authorino-f99f4b5cd-5gf8h\" (UID: \"61bb0385-621e-4348-9298-c8a1650cfcdf\") " pod="kuadrant-system/authorino-f99f4b5cd-5gf8h"
May 25 01:12:53.408505 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.408472    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv" event={"ID":"1154c013-23f3-4dbf-8941-fa19fcfc75b1","Type":"ContainerStarted","Data":"09266d6eb8471de76cfa216da6f2a1e259c80f7dbca957af0d75efe7cd0931da"}
May 25 01:12:53.442978 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.442934    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b7nx\" (UniqueName: \"kubernetes.io/projected/61bb0385-621e-4348-9298-c8a1650cfcdf-kube-api-access-7b7nx\") pod \"authorino-f99f4b5cd-5gf8h\" (UID: \"61bb0385-621e-4348-9298-c8a1650cfcdf\") " pod="kuadrant-system/authorino-f99f4b5cd-5gf8h"
May 25 01:12:53.450940 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.450914    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b7nx\" (UniqueName: \"kubernetes.io/projected/61bb0385-621e-4348-9298-c8a1650cfcdf-kube-api-access-7b7nx\") pod \"authorino-f99f4b5cd-5gf8h\" (UID: \"61bb0385-621e-4348-9298-c8a1650cfcdf\") " pod="kuadrant-system/authorino-f99f4b5cd-5gf8h"
May 25 01:12:53.506497 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.506404    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-wr2w8"]
May 25 01:12:53.510045 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.510021    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wr2w8"
May 25 01:12:53.516276 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.516209    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-wr2w8"]
May 25 01:12:53.536829 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.536796    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h"
May 25 01:12:53.644496 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.644460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxrw8\" (UniqueName: \"kubernetes.io/projected/e7bd704b-a86b-41e7-9b47-fd2117743437-kube-api-access-pxrw8\") pod \"authorino-7498df8756-wr2w8\" (UID: \"e7bd704b-a86b-41e7-9b47-fd2117743437\") " pod="kuadrant-system/authorino-7498df8756-wr2w8"
May 25 01:12:53.717319 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.717281    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gf8h"]
May 25 01:12:53.725336 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:12:53.725303    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61bb0385_621e_4348_9298_c8a1650cfcdf.slice/crio-87357e28552a65aeb53c9d5d15ef64025db76cd1935b2b7d27ee1441cc4ccc11 WatchSource:0}: Error finding container 87357e28552a65aeb53c9d5d15ef64025db76cd1935b2b7d27ee1441cc4ccc11: Status 404 returned error can't find the container with id 87357e28552a65aeb53c9d5d15ef64025db76cd1935b2b7d27ee1441cc4ccc11
May 25 01:12:53.745692 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.745661    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxrw8\" (UniqueName: \"kubernetes.io/projected/e7bd704b-a86b-41e7-9b47-fd2117743437-kube-api-access-pxrw8\") pod \"authorino-7498df8756-wr2w8\" (UID: \"e7bd704b-a86b-41e7-9b47-fd2117743437\") " pod="kuadrant-system/authorino-7498df8756-wr2w8"
May 25 01:12:53.755808 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.755780    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxrw8\" (UniqueName: \"kubernetes.io/projected/e7bd704b-a86b-41e7-9b47-fd2117743437-kube-api-access-pxrw8\") pod \"authorino-7498df8756-wr2w8\" (UID: \"e7bd704b-a86b-41e7-9b47-fd2117743437\") " pod="kuadrant-system/authorino-7498df8756-wr2w8"
May 25 01:12:53.822247 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:53.822140    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wr2w8"
May 25 01:12:54.037900 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:54.037874    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-wr2w8"]
May 25 01:12:54.040246 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:12:54.040205    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7bd704b_a86b_41e7_9b47_fd2117743437.slice/crio-b82eba4481980a69697e525e6f93c3c60884ac678053286fbc77bce572a667dc WatchSource:0}: Error finding container b82eba4481980a69697e525e6f93c3c60884ac678053286fbc77bce572a667dc: Status 404 returned error can't find the container with id b82eba4481980a69697e525e6f93c3c60884ac678053286fbc77bce572a667dc
May 25 01:12:54.414634 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:54.414583    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wr2w8" event={"ID":"e7bd704b-a86b-41e7-9b47-fd2117743437","Type":"ContainerStarted","Data":"b82eba4481980a69697e525e6f93c3c60884ac678053286fbc77bce572a667dc"}
May 25 01:12:54.415897 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:54.415860    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h" event={"ID":"61bb0385-621e-4348-9298-c8a1650cfcdf","Type":"ContainerStarted","Data":"87357e28552a65aeb53c9d5d15ef64025db76cd1935b2b7d27ee1441cc4ccc11"}
May 25 01:12:58.436138 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:58.436104    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv" event={"ID":"1154c013-23f3-4dbf-8941-fa19fcfc75b1","Type":"ContainerStarted","Data":"f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11"}
May 25 01:12:58.436560 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:58.436164    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:12:58.437477 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:58.437456    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wr2w8" event={"ID":"e7bd704b-a86b-41e7-9b47-fd2117743437","Type":"ContainerStarted","Data":"ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961"}
May 25 01:12:58.438760 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:58.438734    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h" event={"ID":"61bb0385-621e-4348-9298-c8a1650cfcdf","Type":"ContainerStarted","Data":"2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7"}
May 25 01:12:58.453863 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:58.453827    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv" podStartSLOduration=1.4897346200000001 podStartE2EDuration="6.453816123s" podCreationTimestamp="2026-05-25 01:12:52 +0000 UTC" firstStartedPulling="2026-05-25 01:12:52.888639727 +0000 UTC m=+623.316850583" lastFinishedPulling="2026-05-25 01:12:57.852721229 +0000 UTC m=+628.280932086" observedRunningTime="2026-05-25 01:12:58.452556353 +0000 UTC m=+628.880767228" watchObservedRunningTime="2026-05-25 01:12:58.453816123 +0000 UTC m=+628.882026996"
May 25 01:12:58.465953 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:58.465913    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-wr2w8" podStartSLOduration=1.642627932 podStartE2EDuration="5.465904513s" podCreationTimestamp="2026-05-25 01:12:53 +0000 UTC" firstStartedPulling="2026-05-25 01:12:54.041686734 +0000 UTC m=+624.469897586" lastFinishedPulling="2026-05-25 01:12:57.864963312 +0000 UTC m=+628.293174167" observedRunningTime="2026-05-25 01:12:58.465422947 +0000 UTC m=+628.893633822" watchObservedRunningTime="2026-05-25 01:12:58.465904513 +0000 UTC m=+628.894115386"
May 25 01:12:58.482286 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:58.482239    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h" podStartSLOduration=1.356422175 podStartE2EDuration="5.482208931s" podCreationTimestamp="2026-05-25 01:12:53 +0000 UTC" firstStartedPulling="2026-05-25 01:12:53.727263946 +0000 UTC m=+624.155474803" lastFinishedPulling="2026-05-25 01:12:57.853050689 +0000 UTC m=+628.281261559" observedRunningTime="2026-05-25 01:12:58.479629564 +0000 UTC m=+628.907840432" watchObservedRunningTime="2026-05-25 01:12:58.482208931 +0000 UTC m=+628.910419805"
May 25 01:12:58.504709 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:12:58.504678    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gf8h"]
May 25 01:13:00.446578 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:00.446525    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h" podUID="61bb0385-621e-4348-9298-c8a1650cfcdf" containerName="authorino" containerID="cri-o://2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7" gracePeriod=30
May 25 01:13:00.686244 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:00.686201    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h"
May 25 01:13:00.811728 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:00.811660    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b7nx\" (UniqueName: \"kubernetes.io/projected/61bb0385-621e-4348-9298-c8a1650cfcdf-kube-api-access-7b7nx\") pod \"61bb0385-621e-4348-9298-c8a1650cfcdf\" (UID: \"61bb0385-621e-4348-9298-c8a1650cfcdf\") "
May 25 01:13:00.813835 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:00.813804    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61bb0385-621e-4348-9298-c8a1650cfcdf-kube-api-access-7b7nx" (OuterVolumeSpecName: "kube-api-access-7b7nx") pod "61bb0385-621e-4348-9298-c8a1650cfcdf" (UID: "61bb0385-621e-4348-9298-c8a1650cfcdf"). InnerVolumeSpecName "kube-api-access-7b7nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:13:00.912896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:00.912867    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b7nx\" (UniqueName: \"kubernetes.io/projected/61bb0385-621e-4348-9298-c8a1650cfcdf-kube-api-access-7b7nx\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:13:01.451733 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.451698    2560 generic.go:358] "Generic (PLEG): container finished" podID="61bb0385-621e-4348-9298-c8a1650cfcdf" containerID="2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7" exitCode=0
May 25 01:13:01.452285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.451745    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h"
May 25 01:13:01.452285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.451785    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h" event={"ID":"61bb0385-621e-4348-9298-c8a1650cfcdf","Type":"ContainerDied","Data":"2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7"}
May 25 01:13:01.452285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.451829    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5gf8h" event={"ID":"61bb0385-621e-4348-9298-c8a1650cfcdf","Type":"ContainerDied","Data":"87357e28552a65aeb53c9d5d15ef64025db76cd1935b2b7d27ee1441cc4ccc11"}
May 25 01:13:01.452285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.451851    2560 scope.go:117] "RemoveContainer" containerID="2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7"
May 25 01:13:01.461132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.461116    2560 scope.go:117] "RemoveContainer" containerID="2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7"
May 25 01:13:01.461433 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:13:01.461411    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7\": container with ID starting with 2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7 not found: ID does not exist" containerID="2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7"
May 25 01:13:01.461536 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.461437    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7"} err="failed to get container status \"2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7\": rpc error: code = NotFound desc = could not find container \"2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7\": container with ID starting with 2d17df73f9c5517d05e3e0c684f0ada44eb2d9420c8d79bf8c06f4f2f5f398b7 not found: ID does not exist"
May 25 01:13:01.472188 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.472161    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gf8h"]
May 25 01:13:01.475476 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:01.475455    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gf8h"]
May 25 01:13:02.184110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:02.184072    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61bb0385-621e-4348-9298-c8a1650cfcdf" path="/var/lib/kubelet/pods/61bb0385-621e-4348-9298-c8a1650cfcdf/volumes"
May 25 01:13:06.897266 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:06.897211    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6hrkv"]
May 25 01:13:06.897645 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:06.897469    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv" podUID="1154c013-23f3-4dbf-8941-fa19fcfc75b1" containerName="limitador" containerID="cri-o://f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11" gracePeriod=30
May 25 01:13:06.898128 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:06.898077    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:13:07.444816 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.444795    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:13:07.476235 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.476107    2560 generic.go:358] "Generic (PLEG): container finished" podID="1154c013-23f3-4dbf-8941-fa19fcfc75b1" containerID="f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11" exitCode=0
May 25 01:13:07.476235 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.476181    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv" event={"ID":"1154c013-23f3-4dbf-8941-fa19fcfc75b1","Type":"ContainerDied","Data":"f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11"}
May 25 01:13:07.476235 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.476190    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv"
May 25 01:13:07.476235 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.476207    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-6hrkv" event={"ID":"1154c013-23f3-4dbf-8941-fa19fcfc75b1","Type":"ContainerDied","Data":"09266d6eb8471de76cfa216da6f2a1e259c80f7dbca957af0d75efe7cd0931da"}
May 25 01:13:07.476590 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.476240    2560 scope.go:117] "RemoveContainer" containerID="f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11"
May 25 01:13:07.487023 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.487001    2560 scope.go:117] "RemoveContainer" containerID="f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11"
May 25 01:13:07.487394 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:13:07.487373    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11\": container with ID starting with f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11 not found: ID does not exist" containerID="f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11"
May 25 01:13:07.487468 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.487403    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11"} err="failed to get container status \"f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11\": rpc error: code = NotFound desc = could not find container \"f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11\": container with ID starting with f1d8cbd1bbc85dd6d84e9fbd300c20cff9a1cf111b4ae0434b0c19139be5bc11 not found: ID does not exist"
May 25 01:13:07.574799 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.574768    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4bf2\" (UniqueName: \"kubernetes.io/projected/1154c013-23f3-4dbf-8941-fa19fcfc75b1-kube-api-access-k4bf2\") pod \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\" (UID: \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\") "
May 25 01:13:07.574999 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.574842    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1154c013-23f3-4dbf-8941-fa19fcfc75b1-config-file\") pod \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\" (UID: \"1154c013-23f3-4dbf-8941-fa19fcfc75b1\") "
May 25 01:13:07.575278 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.575252    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1154c013-23f3-4dbf-8941-fa19fcfc75b1-config-file" (OuterVolumeSpecName: "config-file") pod "1154c013-23f3-4dbf-8941-fa19fcfc75b1" (UID: "1154c013-23f3-4dbf-8941-fa19fcfc75b1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:13:07.577261 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.577236    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1154c013-23f3-4dbf-8941-fa19fcfc75b1-kube-api-access-k4bf2" (OuterVolumeSpecName: "kube-api-access-k4bf2") pod "1154c013-23f3-4dbf-8941-fa19fcfc75b1" (UID: "1154c013-23f3-4dbf-8941-fa19fcfc75b1"). InnerVolumeSpecName "kube-api-access-k4bf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:13:07.676135 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.676102    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4bf2\" (UniqueName: \"kubernetes.io/projected/1154c013-23f3-4dbf-8941-fa19fcfc75b1-kube-api-access-k4bf2\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:13:07.676135 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.676134    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1154c013-23f3-4dbf-8941-fa19fcfc75b1-config-file\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:13:07.797250 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.797205    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6hrkv"]
May 25 01:13:07.802572 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:07.802548    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6hrkv"]
May 25 01:13:08.182853 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:08.182823    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1154c013-23f3-4dbf-8941-fa19fcfc75b1" path="/var/lib/kubelet/pods/1154c013-23f3-4dbf-8941-fa19fcfc75b1/volumes"
May 25 01:13:12.862115 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.862081    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-s56c8"]
May 25 01:13:12.862603 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.862511    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1154c013-23f3-4dbf-8941-fa19fcfc75b1" containerName="limitador"
May 25 01:13:12.862603 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.862528    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1154c013-23f3-4dbf-8941-fa19fcfc75b1" containerName="limitador"
May 25 01:13:12.862603 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.862543    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61bb0385-621e-4348-9298-c8a1650cfcdf" containerName="authorino"
May 25 01:13:12.862603 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.862551    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61bb0385-621e-4348-9298-c8a1650cfcdf" containerName="authorino"
May 25 01:13:12.862763 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.862662    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1154c013-23f3-4dbf-8941-fa19fcfc75b1" containerName="limitador"
May 25 01:13:12.862763 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.862677    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="61bb0385-621e-4348-9298-c8a1650cfcdf" containerName="authorino"
May 25 01:13:12.867411 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.867384    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:12.869852 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.869813    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 25 01:13:12.870037 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.869814    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d45zz\""
May 25 01:13:12.872171 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.872145    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-s56c8"]
May 25 01:13:12.915991 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.915945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfcw\" (UniqueName: \"kubernetes.io/projected/bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5-kube-api-access-rcfcw\") pod \"postgres-68c4fbbd6f-s56c8\" (UID: \"bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5\") " pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:12.916173 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:12.916006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5-data\") pod \"postgres-68c4fbbd6f-s56c8\" (UID: \"bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5\") " pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:13.017075 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:13.017039    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfcw\" (UniqueName: \"kubernetes.io/projected/bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5-kube-api-access-rcfcw\") pod \"postgres-68c4fbbd6f-s56c8\" (UID: \"bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5\") " pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:13.017075 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:13.017090    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5-data\") pod \"postgres-68c4fbbd6f-s56c8\" (UID: \"bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5\") " pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:13.017580 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:13.017561    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5-data\") pod \"postgres-68c4fbbd6f-s56c8\" (UID: \"bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5\") " pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:13.024919 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:13.024892    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfcw\" (UniqueName: \"kubernetes.io/projected/bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5-kube-api-access-rcfcw\") pod \"postgres-68c4fbbd6f-s56c8\" (UID: \"bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5\") " pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:13.180775 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:13.180675    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:13.316648 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:13.316622    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-s56c8"]
May 25 01:13:13.319176 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:13:13.319148    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc32c03_d17b_4120_ad2f_f8b76bb7b4e5.slice/crio-ae7e8610f5d6671c17de95f84b88bcb9657e6c9209469306590ccba586438e26 WatchSource:0}: Error finding container ae7e8610f5d6671c17de95f84b88bcb9657e6c9209469306590ccba586438e26: Status 404 returned error can't find the container with id ae7e8610f5d6671c17de95f84b88bcb9657e6c9209469306590ccba586438e26
May 25 01:13:13.502328 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:13.502207    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-s56c8" event={"ID":"bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5","Type":"ContainerStarted","Data":"ae7e8610f5d6671c17de95f84b88bcb9657e6c9209469306590ccba586438e26"}
May 25 01:13:18.524489 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:18.524448    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-s56c8" event={"ID":"bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5","Type":"ContainerStarted","Data":"b523c494abe23ee848799793389fbeb28ca7fb9a382693f0a65cb32b59d97cf8"}
May 25 01:13:18.524967 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:18.524572    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:18.539731 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:18.539626    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-s56c8" podStartSLOduration=1.582657518 podStartE2EDuration="6.539608909s" podCreationTimestamp="2026-05-25 01:13:12 +0000 UTC" firstStartedPulling="2026-05-25 01:13:13.320467978 +0000 UTC m=+643.748678834" lastFinishedPulling="2026-05-25 01:13:18.277419374 +0000 UTC m=+648.705630225" observedRunningTime="2026-05-25 01:13:18.538662738 +0000 UTC m=+648.966873612" watchObservedRunningTime="2026-05-25 01:13:18.539608909 +0000 UTC m=+648.967819782"
May 25 01:13:24.558925 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:24.558889    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-s56c8"
May 25 01:13:25.072403 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.072365    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-68mw4"]
May 25 01:13:25.079214 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.079177    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-68mw4"]
May 25 01:13:25.079415 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.079318    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-68mw4"
May 25 01:13:25.138830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.138795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fph9\" (UniqueName: \"kubernetes.io/projected/7ffa67e6-f3ea-4c44-b716-3cb27a9353ef-kube-api-access-6fph9\") pod \"authorino-8b475cf9f-68mw4\" (UID: \"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef\") " pod="kuadrant-system/authorino-8b475cf9f-68mw4"
May 25 01:13:25.240033 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.239993    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6fph9\" (UniqueName: \"kubernetes.io/projected/7ffa67e6-f3ea-4c44-b716-3cb27a9353ef-kube-api-access-6fph9\") pod \"authorino-8b475cf9f-68mw4\" (UID: \"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef\") " pod="kuadrant-system/authorino-8b475cf9f-68mw4"
May 25 01:13:25.248036 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.248011    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fph9\" (UniqueName: \"kubernetes.io/projected/7ffa67e6-f3ea-4c44-b716-3cb27a9353ef-kube-api-access-6fph9\") pod \"authorino-8b475cf9f-68mw4\" (UID: \"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef\") " pod="kuadrant-system/authorino-8b475cf9f-68mw4"
May 25 01:13:25.285798 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.285759    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-68mw4"]
May 25 01:13:25.286054 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.286043    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-68mw4"
May 25 01:13:25.325181 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.325084    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d4bc96978-vvql8"]
May 25 01:13:25.330828 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.330798    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4bc96978-vvql8"
May 25 01:13:25.348912 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.348798    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d4bc96978-vvql8"]
May 25 01:13:25.431551 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.431515    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-68mw4"]
May 25 01:13:25.434593 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:13:25.434560    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ffa67e6_f3ea_4c44_b716_3cb27a9353ef.slice/crio-da7ecc196116a191e1dc50241b96b4941b852a76cf4a04e29dcb06f9cca178f3 WatchSource:0}: Error finding container da7ecc196116a191e1dc50241b96b4941b852a76cf4a04e29dcb06f9cca178f3: Status 404 returned error can't find the container with id da7ecc196116a191e1dc50241b96b4941b852a76cf4a04e29dcb06f9cca178f3
May 25 01:13:25.442767 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.442730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxkhc\" (UniqueName: \"kubernetes.io/projected/3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95-kube-api-access-lxkhc\") pod \"authorino-7d4bc96978-vvql8\" (UID: \"3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95\") " pod="kuadrant-system/authorino-7d4bc96978-vvql8"
May 25 01:13:25.449648 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.449613    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d4bc96978-vvql8"]
May 25 01:13:25.449975 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:13:25.449950    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lxkhc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7d4bc96978-vvql8" podUID="3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95"
May 25 01:13:25.470050 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.470013    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d8d4f8d54-5vm9l"]
May 25 01:13:25.474178 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.474158    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:13:25.476908 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.476875    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 25 01:13:25.479692 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.479665    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d8d4f8d54-5vm9l"]
May 25 01:13:25.543877 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.543833    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxkhc\" (UniqueName: \"kubernetes.io/projected/3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95-kube-api-access-lxkhc\") pod \"authorino-7d4bc96978-vvql8\" (UID: \"3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95\") " pod="kuadrant-system/authorino-7d4bc96978-vvql8"
May 25 01:13:25.544067 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.543894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de147107-5dc6-4bb6-b738-a7ef5157e760-tls-cert\") pod \"authorino-6d8d4f8d54-5vm9l\" (UID: \"de147107-5dc6-4bb6-b738-a7ef5157e760\") " pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:13:25.544067 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.543996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pj5s\" (UniqueName: \"kubernetes.io/projected/de147107-5dc6-4bb6-b738-a7ef5157e760-kube-api-access-2pj5s\") pod \"authorino-6d8d4f8d54-5vm9l\" (UID: \"de147107-5dc6-4bb6-b738-a7ef5157e760\") " pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:13:25.552531 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.552498    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxkhc\" (UniqueName: \"kubernetes.io/projected/3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95-kube-api-access-lxkhc\") pod \"authorino-7d4bc96978-vvql8\" (UID: \"3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95\") " pod="kuadrant-system/authorino-7d4bc96978-vvql8"
May 25 01:13:25.553689 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.553660    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-68mw4" event={"ID":"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef","Type":"ContainerStarted","Data":"da7ecc196116a191e1dc50241b96b4941b852a76cf4a04e29dcb06f9cca178f3"}
May 25 01:13:25.553854 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.553692    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4bc96978-vvql8"
May 25 01:13:25.564960 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.564937    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4bc96978-vvql8"
May 25 01:13:25.644985 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.644948    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxkhc\" (UniqueName: \"kubernetes.io/projected/3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95-kube-api-access-lxkhc\") pod \"3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95\" (UID: \"3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95\") "
May 25 01:13:25.645168 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.645148    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de147107-5dc6-4bb6-b738-a7ef5157e760-tls-cert\") pod \"authorino-6d8d4f8d54-5vm9l\" (UID: \"de147107-5dc6-4bb6-b738-a7ef5157e760\") " pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:13:25.645216 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.645209    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pj5s\" (UniqueName: \"kubernetes.io/projected/de147107-5dc6-4bb6-b738-a7ef5157e760-kube-api-access-2pj5s\") pod \"authorino-6d8d4f8d54-5vm9l\" (UID: \"de147107-5dc6-4bb6-b738-a7ef5157e760\") " pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:13:25.647329 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.647296    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95-kube-api-access-lxkhc" (OuterVolumeSpecName: "kube-api-access-lxkhc") pod "3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95" (UID: "3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95"). InnerVolumeSpecName "kube-api-access-lxkhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:13:25.647720 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.647702    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de147107-5dc6-4bb6-b738-a7ef5157e760-tls-cert\") pod \"authorino-6d8d4f8d54-5vm9l\" (UID: \"de147107-5dc6-4bb6-b738-a7ef5157e760\") " pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:13:25.652961 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.652940    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pj5s\" (UniqueName: \"kubernetes.io/projected/de147107-5dc6-4bb6-b738-a7ef5157e760-kube-api-access-2pj5s\") pod \"authorino-6d8d4f8d54-5vm9l\" (UID: \"de147107-5dc6-4bb6-b738-a7ef5157e760\") " pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:13:25.746364 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.746325    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxkhc\" (UniqueName: \"kubernetes.io/projected/3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95-kube-api-access-lxkhc\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:13:25.785380 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.785344    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:13:25.937038 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:13:25.936998    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde147107_5dc6_4bb6_b738_a7ef5157e760.slice/crio-74ae0306a5c410373a87d0d5fc5ce53959633c0fb730092bc6c36f67ad26781d WatchSource:0}: Error finding container 74ae0306a5c410373a87d0d5fc5ce53959633c0fb730092bc6c36f67ad26781d: Status 404 returned error can't find the container with id 74ae0306a5c410373a87d0d5fc5ce53959633c0fb730092bc6c36f67ad26781d
May 25 01:13:25.937171 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:25.937145    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d8d4f8d54-5vm9l"]
May 25 01:13:26.559354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.559252    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l" event={"ID":"de147107-5dc6-4bb6-b738-a7ef5157e760","Type":"ContainerStarted","Data":"f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213"}
May 25 01:13:26.559354 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.559299    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l" event={"ID":"de147107-5dc6-4bb6-b738-a7ef5157e760","Type":"ContainerStarted","Data":"74ae0306a5c410373a87d0d5fc5ce53959633c0fb730092bc6c36f67ad26781d"}
May 25 01:13:26.560785 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.560758    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4bc96978-vvql8"
May 25 01:13:26.560785 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.560773    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-68mw4" event={"ID":"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef","Type":"ContainerStarted","Data":"f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85"}
May 25 01:13:26.560984 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.560804    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-68mw4" podUID="7ffa67e6-f3ea-4c44-b716-3cb27a9353ef" containerName="authorino" containerID="cri-o://f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85" gracePeriod=30
May 25 01:13:26.575514 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.575465    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l" podStartSLOduration=1.239585128 podStartE2EDuration="1.575449412s" podCreationTimestamp="2026-05-25 01:13:25 +0000 UTC" firstStartedPulling="2026-05-25 01:13:25.938436584 +0000 UTC m=+656.366647436" lastFinishedPulling="2026-05-25 01:13:26.274300854 +0000 UTC m=+656.702511720" observedRunningTime="2026-05-25 01:13:26.573389672 +0000 UTC m=+657.001600548" watchObservedRunningTime="2026-05-25 01:13:26.575449412 +0000 UTC m=+657.003660285"
May 25 01:13:26.597803 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.597765    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d4bc96978-vvql8"]
May 25 01:13:26.605850 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.605818    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-wr2w8"]
May 25 01:13:26.606095 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.606070    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-wr2w8" podUID="e7bd704b-a86b-41e7-9b47-fd2117743437" containerName="authorino" containerID="cri-o://ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961" gracePeriod=30
May 25 01:13:26.608512 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.608483    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d4bc96978-vvql8"]
May 25 01:13:26.628017 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.627967    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-68mw4" podStartSLOduration=1.277191073 podStartE2EDuration="1.627948389s" podCreationTimestamp="2026-05-25 01:13:25 +0000 UTC" firstStartedPulling="2026-05-25 01:13:25.435899328 +0000 UTC m=+655.864110180" lastFinishedPulling="2026-05-25 01:13:25.78665644 +0000 UTC m=+656.214867496" observedRunningTime="2026-05-25 01:13:26.626018461 +0000 UTC m=+657.054229336" watchObservedRunningTime="2026-05-25 01:13:26.627948389 +0000 UTC m=+657.056159260"
May 25 01:13:26.861068 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.861039    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-68mw4"
May 25 01:13:26.872622 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.872599    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wr2w8"
May 25 01:13:26.959252 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.959167    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxrw8\" (UniqueName: \"kubernetes.io/projected/e7bd704b-a86b-41e7-9b47-fd2117743437-kube-api-access-pxrw8\") pod \"e7bd704b-a86b-41e7-9b47-fd2117743437\" (UID: \"e7bd704b-a86b-41e7-9b47-fd2117743437\") "
May 25 01:13:26.959468 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.959343    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fph9\" (UniqueName: \"kubernetes.io/projected/7ffa67e6-f3ea-4c44-b716-3cb27a9353ef-kube-api-access-6fph9\") pod \"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef\" (UID: \"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef\") "
May 25 01:13:26.961538 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.961500    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7bd704b-a86b-41e7-9b47-fd2117743437-kube-api-access-pxrw8" (OuterVolumeSpecName: "kube-api-access-pxrw8") pod "e7bd704b-a86b-41e7-9b47-fd2117743437" (UID: "e7bd704b-a86b-41e7-9b47-fd2117743437"). InnerVolumeSpecName "kube-api-access-pxrw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:13:26.961538 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:26.961521    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ffa67e6-f3ea-4c44-b716-3cb27a9353ef-kube-api-access-6fph9" (OuterVolumeSpecName: "kube-api-access-6fph9") pod "7ffa67e6-f3ea-4c44-b716-3cb27a9353ef" (UID: "7ffa67e6-f3ea-4c44-b716-3cb27a9353ef"). InnerVolumeSpecName "kube-api-access-6fph9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:13:27.060394 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.060352    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fph9\" (UniqueName: \"kubernetes.io/projected/7ffa67e6-f3ea-4c44-b716-3cb27a9353ef-kube-api-access-6fph9\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:13:27.060394 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.060384    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxrw8\" (UniqueName: \"kubernetes.io/projected/e7bd704b-a86b-41e7-9b47-fd2117743437-kube-api-access-pxrw8\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:13:27.566957 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.566863    2560 generic.go:358] "Generic (PLEG): container finished" podID="e7bd704b-a86b-41e7-9b47-fd2117743437" containerID="ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961" exitCode=0
May 25 01:13:27.566957 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.566952    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wr2w8" event={"ID":"e7bd704b-a86b-41e7-9b47-fd2117743437","Type":"ContainerDied","Data":"ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961"}
May 25 01:13:27.567202 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.566973    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wr2w8"
May 25 01:13:27.567202 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.566988    2560 scope.go:117] "RemoveContainer" containerID="ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961"
May 25 01:13:27.567202 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.566978    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wr2w8" event={"ID":"e7bd704b-a86b-41e7-9b47-fd2117743437","Type":"ContainerDied","Data":"b82eba4481980a69697e525e6f93c3c60884ac678053286fbc77bce572a667dc"}
May 25 01:13:27.568406 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.568383    2560 generic.go:358] "Generic (PLEG): container finished" podID="7ffa67e6-f3ea-4c44-b716-3cb27a9353ef" containerID="f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85" exitCode=0
May 25 01:13:27.568472 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.568439    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-68mw4"
May 25 01:13:27.568522 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.568476    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-68mw4" event={"ID":"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef","Type":"ContainerDied","Data":"f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85"}
May 25 01:13:27.568616 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.568523    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-68mw4" event={"ID":"7ffa67e6-f3ea-4c44-b716-3cb27a9353ef","Type":"ContainerDied","Data":"da7ecc196116a191e1dc50241b96b4941b852a76cf4a04e29dcb06f9cca178f3"}
May 25 01:13:27.578388 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.578365    2560 scope.go:117] "RemoveContainer" containerID="ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961"
May 25 01:13:27.578786 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:13:27.578762    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961\": container with ID starting with ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961 not found: ID does not exist" containerID="ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961"
May 25 01:13:27.578838 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.578801    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961"} err="failed to get container status \"ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961\": rpc error: code = NotFound desc = could not find container \"ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961\": container with ID starting with ee5e6bed638dbeb8c6224bdda24af09ebf9bdee9044b28f331e2e83933cb5961 not found: ID does not exist"
May 25 01:13:27.578838 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.578829    2560 scope.go:117] "RemoveContainer" containerID="f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85"
May 25 01:13:27.587143 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.587119    2560 scope.go:117] "RemoveContainer" containerID="f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85"
May 25 01:13:27.587419 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:13:27.587402    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85\": container with ID starting with f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85 not found: ID does not exist" containerID="f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85"
May 25 01:13:27.587474 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.587427    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85"} err="failed to get container status \"f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85\": rpc error: code = NotFound desc = could not find container \"f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85\": container with ID starting with f151be2fd2ebdcd72ae5e46a127f4780d90bd23cd3e2c5b3ebed9339955d8f85 not found: ID does not exist"
May 25 01:13:27.591697 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.591661    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-wr2w8"]
May 25 01:13:27.594244 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.594211    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-wr2w8"]
May 25 01:13:27.602845 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.602821    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-68mw4"]
May 25 01:13:27.606355 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:27.606331    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-68mw4"]
May 25 01:13:28.183517 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:28.183486    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95" path="/var/lib/kubelet/pods/3d11bfcd-e9a5-4f94-b4f2-9baa1f826a95/volumes"
May 25 01:13:28.183734 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:28.183714    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ffa67e6-f3ea-4c44-b716-3cb27a9353ef" path="/var/lib/kubelet/pods/7ffa67e6-f3ea-4c44-b716-3cb27a9353ef/volumes"
May 25 01:13:28.184000 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:28.183988    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7bd704b-a86b-41e7-9b47-fd2117743437" path="/var/lib/kubelet/pods/e7bd704b-a86b-41e7-9b47-fd2117743437/volumes"
May 25 01:13:29.673949 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.673898    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-5jq27"]
May 25 01:13:29.674550 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.674513    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7bd704b-a86b-41e7-9b47-fd2117743437" containerName="authorino"
May 25 01:13:29.674550 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.674548    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7bd704b-a86b-41e7-9b47-fd2117743437" containerName="authorino"
May 25 01:13:29.674736 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.674578    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffa67e6-f3ea-4c44-b716-3cb27a9353ef" containerName="authorino"
May 25 01:13:29.674736 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.674588    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffa67e6-f3ea-4c44-b716-3cb27a9353ef" containerName="authorino"
May 25 01:13:29.674736 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.674676    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ffa67e6-f3ea-4c44-b716-3cb27a9353ef" containerName="authorino"
May 25 01:13:29.674736 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.674692    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7bd704b-a86b-41e7-9b47-fd2117743437" containerName="authorino"
May 25 01:13:29.768747 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.768697    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-5jq27"]
May 25 01:13:29.768967 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.768860    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:13:29.771314 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.771286    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 25 01:13:29.771470 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.771286    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-chf7f\""
May 25 01:13:29.892124 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.892071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8b8w\" (UniqueName: \"kubernetes.io/projected/a4e69afe-a8f1-4c16-ad5f-ef1546e08e67-kube-api-access-b8b8w\") pod \"maas-controller-5dc4757f9c-5jq27\" (UID: \"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67\") " pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:13:29.993459 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:29.993367    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8b8w\" (UniqueName: \"kubernetes.io/projected/a4e69afe-a8f1-4c16-ad5f-ef1546e08e67-kube-api-access-b8b8w\") pod \"maas-controller-5dc4757f9c-5jq27\" (UID: \"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67\") " pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:13:30.001413 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:30.001383    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8b8w\" (UniqueName: \"kubernetes.io/projected/a4e69afe-a8f1-4c16-ad5f-ef1546e08e67-kube-api-access-b8b8w\") pod \"maas-controller-5dc4757f9c-5jq27\" (UID: \"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67\") " pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:13:30.092421 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:30.092384    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-chf7f\""
May 25 01:13:30.100482 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:30.100456    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:13:30.247029 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:30.246998    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-5jq27"]
May 25 01:13:30.248854 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:13:30.248823    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e69afe_a8f1_4c16_ad5f_ef1546e08e67.slice/crio-64ce9e5818603db374600da0fb3267bc28efee4089141f914e03d790356ba423 WatchSource:0}: Error finding container 64ce9e5818603db374600da0fb3267bc28efee4089141f914e03d790356ba423: Status 404 returned error can't find the container with id 64ce9e5818603db374600da0fb3267bc28efee4089141f914e03d790356ba423
May 25 01:13:30.583495 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:30.583462    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dc4757f9c-5jq27" event={"ID":"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67","Type":"ContainerStarted","Data":"64ce9e5818603db374600da0fb3267bc28efee4089141f914e03d790356ba423"}
May 25 01:13:33.104576 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:33.104551    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 25 01:13:33.596635 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:33.596599    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dc4757f9c-5jq27" event={"ID":"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67","Type":"ContainerStarted","Data":"a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8"}
May 25 01:13:33.596958 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:33.596702    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:13:33.613980 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:33.613924    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5dc4757f9c-5jq27" podStartSLOduration=1.762227355 podStartE2EDuration="4.613906248s" podCreationTimestamp="2026-05-25 01:13:29 +0000 UTC" firstStartedPulling="2026-05-25 01:13:30.25044656 +0000 UTC m=+660.678657412" lastFinishedPulling="2026-05-25 01:13:33.102125441 +0000 UTC m=+663.530336305" observedRunningTime="2026-05-25 01:13:33.611000296 +0000 UTC m=+664.039211172" watchObservedRunningTime="2026-05-25 01:13:33.613906248 +0000 UTC m=+664.042117121"
May 25 01:13:44.605890 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:13:44.605854    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:14:07.684323 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.684286    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5697844489-65mgs"]
May 25 01:14:07.690787 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.690762    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:07.693933 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.693903    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 25 01:14:07.694087 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.693907    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-blz4s\""
May 25 01:14:07.696705 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.696677    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5697844489-65mgs"]
May 25 01:14:07.769736 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.769695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n46kx\" (UniqueName: \"kubernetes.io/projected/b3d7ff77-5b2b-440b-b96f-416a1b32a9ad-kube-api-access-n46kx\") pod \"maas-api-5697844489-65mgs\" (UID: \"b3d7ff77-5b2b-440b-b96f-416a1b32a9ad\") " pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:07.769920 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.769748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d7ff77-5b2b-440b-b96f-416a1b32a9ad-maas-api-tls\") pod \"maas-api-5697844489-65mgs\" (UID: \"b3d7ff77-5b2b-440b-b96f-416a1b32a9ad\") " pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:07.870886 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.870851    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n46kx\" (UniqueName: \"kubernetes.io/projected/b3d7ff77-5b2b-440b-b96f-416a1b32a9ad-kube-api-access-n46kx\") pod \"maas-api-5697844489-65mgs\" (UID: \"b3d7ff77-5b2b-440b-b96f-416a1b32a9ad\") " pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:07.870886 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.870890    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d7ff77-5b2b-440b-b96f-416a1b32a9ad-maas-api-tls\") pod \"maas-api-5697844489-65mgs\" (UID: \"b3d7ff77-5b2b-440b-b96f-416a1b32a9ad\") " pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:07.873867 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.873838    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3d7ff77-5b2b-440b-b96f-416a1b32a9ad-maas-api-tls\") pod \"maas-api-5697844489-65mgs\" (UID: \"b3d7ff77-5b2b-440b-b96f-416a1b32a9ad\") " pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:07.879355 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:07.879334    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n46kx\" (UniqueName: \"kubernetes.io/projected/b3d7ff77-5b2b-440b-b96f-416a1b32a9ad-kube-api-access-n46kx\") pod \"maas-api-5697844489-65mgs\" (UID: \"b3d7ff77-5b2b-440b-b96f-416a1b32a9ad\") " pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:08.003918 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.003817    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:08.086925 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.086895    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-67gf9"]
May 25 01:14:08.091165 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.091144    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9"
May 25 01:14:08.093539 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.093515    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 25 01:14:08.102707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.102663    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-67gf9"]
May 25 01:14:08.158584 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.158551    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5697844489-65mgs"]
May 25 01:14:08.160633 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:14:08.160590    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d7ff77_5b2b_440b_b96f_416a1b32a9ad.slice/crio-b3ef3208492e29c9d63bd6560da648ef843ed957e8f89622ebac6901bc0efbaf WatchSource:0}: Error finding container b3ef3208492e29c9d63bd6560da648ef843ed957e8f89622ebac6901bc0efbaf: Status 404 returned error can't find the container with id b3ef3208492e29c9d63bd6560da648ef843ed957e8f89622ebac6901bc0efbaf
May 25 01:14:08.175183 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.175124    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4d5\" (UniqueName: \"kubernetes.io/projected/02f0a436-9c1e-41d9-9c68-87d079750630-kube-api-access-lv4d5\") pod \"payload-processing-58b6c8fdc7-67gf9\" (UID: \"02f0a436-9c1e-41d9-9c68-87d079750630\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9"
May 25 01:14:08.276429 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.276321    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4d5\" (UniqueName: \"kubernetes.io/projected/02f0a436-9c1e-41d9-9c68-87d079750630-kube-api-access-lv4d5\") pod \"payload-processing-58b6c8fdc7-67gf9\" (UID: \"02f0a436-9c1e-41d9-9c68-87d079750630\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9"
May 25 01:14:08.284649 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.284619    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4d5\" (UniqueName: \"kubernetes.io/projected/02f0a436-9c1e-41d9-9c68-87d079750630-kube-api-access-lv4d5\") pod \"payload-processing-58b6c8fdc7-67gf9\" (UID: \"02f0a436-9c1e-41d9-9c68-87d079750630\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9"
May 25 01:14:08.410977 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.410938    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9"
May 25 01:14:08.576348 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.576284    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-67gf9"]
May 25 01:14:08.578900 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:14:08.578867    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f0a436_9c1e_41d9_9c68_87d079750630.slice/crio-9919c4d4c37cd1715e4eff09d85d14cc1431707528ed134f8e0befa2b7364731 WatchSource:0}: Error finding container 9919c4d4c37cd1715e4eff09d85d14cc1431707528ed134f8e0befa2b7364731: Status 404 returned error can't find the container with id 9919c4d4c37cd1715e4eff09d85d14cc1431707528ed134f8e0befa2b7364731
May 25 01:14:08.742120 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.742078    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9" event={"ID":"02f0a436-9c1e-41d9-9c68-87d079750630","Type":"ContainerStarted","Data":"9919c4d4c37cd1715e4eff09d85d14cc1431707528ed134f8e0befa2b7364731"}
May 25 01:14:08.743340 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:08.743309    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5697844489-65mgs" event={"ID":"b3d7ff77-5b2b-440b-b96f-416a1b32a9ad","Type":"ContainerStarted","Data":"b3ef3208492e29c9d63bd6560da648ef843ed957e8f89622ebac6901bc0efbaf"}
May 25 01:14:10.788924 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:10.788874    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5697844489-65mgs" event={"ID":"b3d7ff77-5b2b-440b-b96f-416a1b32a9ad","Type":"ContainerStarted","Data":"711c406e8cb1993f4b1a1bdc3d70913314b488dd226a2b23b186aaf18971749a"}
May 25 01:14:10.789410 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:10.788942    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:10.809277 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:10.808985    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5697844489-65mgs" podStartSLOduration=1.9544278149999998 podStartE2EDuration="3.808969988s" podCreationTimestamp="2026-05-25 01:14:07 +0000 UTC" firstStartedPulling="2026-05-25 01:14:08.162073169 +0000 UTC m=+698.590284022" lastFinishedPulling="2026-05-25 01:14:10.016615335 +0000 UTC m=+700.444826195" observedRunningTime="2026-05-25 01:14:10.806884552 +0000 UTC m=+701.235095441" watchObservedRunningTime="2026-05-25 01:14:10.808969988 +0000 UTC m=+701.237180861"
May 25 01:14:11.794364 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:11.794260    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9" event={"ID":"02f0a436-9c1e-41d9-9c68-87d079750630","Type":"ContainerStarted","Data":"8a1f53ad84bbcd50a67d5a9f7dac888179a0d97cbd41edbc49b7c73b48d97e37"}
May 25 01:14:11.794781 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:11.794597    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9"
May 25 01:14:11.810678 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:11.810629    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9" podStartSLOduration=0.936360368 podStartE2EDuration="3.810614339s" podCreationTimestamp="2026-05-25 01:14:08 +0000 UTC" firstStartedPulling="2026-05-25 01:14:08.580700064 +0000 UTC m=+699.008910919" lastFinishedPulling="2026-05-25 01:14:11.454954024 +0000 UTC m=+701.883164890" observedRunningTime="2026-05-25 01:14:11.807599314 +0000 UTC m=+702.235810189" watchObservedRunningTime="2026-05-25 01:14:11.810614339 +0000 UTC m=+702.238825213"
May 25 01:14:16.799956 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:16.799925    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5697844489-65mgs"
May 25 01:14:22.800488 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:22.800399    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-67gf9"
May 25 01:14:30.382540 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.382503    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"]
May 25 01:14:30.387032 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.387010    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.395171 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.395144    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 25 01:14:30.395577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.395330    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 25 01:14:30.395577 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.395498    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2lx8d\""
May 25 01:14:30.395853 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.395834    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 25 01:14:30.397621 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.397599    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"]
May 25 01:14:30.482997 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.482951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.483191 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.483010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/609aa2a8-2e64-4daf-9875-1a07a9447ccb-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.483191 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.483105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.483191 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.483172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.483406 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.483257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5b7j\" (UniqueName: \"kubernetes.io/projected/609aa2a8-2e64-4daf-9875-1a07a9447ccb-kube-api-access-g5b7j\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.483406 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.483340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.583899 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.583857    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.584115 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.583916    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.584115 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.583935    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/609aa2a8-2e64-4daf-9875-1a07a9447ccb-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.584115 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.583957    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.584115 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.583989    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.584115 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.584032    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5b7j\" (UniqueName: \"kubernetes.io/projected/609aa2a8-2e64-4daf-9875-1a07a9447ccb-kube-api-access-g5b7j\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.584427 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.584368    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.584467 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.584428    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.584499 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.584470    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.586500 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.586474    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/609aa2a8-2e64-4daf-9875-1a07a9447ccb-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.586622 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.586603    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/609aa2a8-2e64-4daf-9875-1a07a9447ccb-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.591879 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.591856    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5b7j\" (UniqueName: \"kubernetes.io/projected/609aa2a8-2e64-4daf-9875-1a07a9447ccb-kube-api-access-g5b7j\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs\" (UID: \"609aa2a8-2e64-4daf-9875-1a07a9447ccb\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.699934 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.699834    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:30.844405 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.844379    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"]
May 25 01:14:30.845203 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:14:30.845176    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609aa2a8_2e64_4daf_9875_1a07a9447ccb.slice/crio-ccbcffc0d0d3f13c293e4fbd963d9caf461ee7e36d234177971cdf1ca26f3e1a WatchSource:0}: Error finding container ccbcffc0d0d3f13c293e4fbd963d9caf461ee7e36d234177971cdf1ca26f3e1a: Status 404 returned error can't find the container with id ccbcffc0d0d3f13c293e4fbd963d9caf461ee7e36d234177971cdf1ca26f3e1a
May 25 01:14:30.872108 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:30.872057    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs" event={"ID":"609aa2a8-2e64-4daf-9875-1a07a9447ccb","Type":"ContainerStarted","Data":"ccbcffc0d0d3f13c293e4fbd963d9caf461ee7e36d234177971cdf1ca26f3e1a"}
May 25 01:14:37.902327 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:37.902282    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs" event={"ID":"609aa2a8-2e64-4daf-9875-1a07a9447ccb","Type":"ContainerStarted","Data":"27f1ff30a6cfb4740cdaa07543c70b9e2c2c0d009071ff9db31f0f01375e60a5"}
May 25 01:14:43.386761 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.386669    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"]
May 25 01:14:43.390447 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.390429    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.392851 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.392835    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 25 01:14:43.397867 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.397787    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"]
May 25 01:14:43.515830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.515791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.516033 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.515842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2528a319-5fee-4644-a623-deb3df0dbe23-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.516033 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.515983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.516033 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.516022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.516174 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.516039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.516174 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.516055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tvdd\" (UniqueName: \"kubernetes.io/projected/2528a319-5fee-4644-a623-deb3df0dbe23-kube-api-access-9tvdd\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617257 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617198    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617453 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617271    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2528a319-5fee-4644-a623-deb3df0dbe23-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617453 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617371    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617453 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617405    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617453 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617431    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617453    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tvdd\" (UniqueName: \"kubernetes.io/projected/2528a319-5fee-4644-a623-deb3df0dbe23-kube-api-access-9tvdd\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617663 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617584    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617760 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617735    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.617760 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.617741    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.619752 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.619729    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2528a319-5fee-4644-a623-deb3df0dbe23-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.619923 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.619906    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2528a319-5fee-4644-a623-deb3df0dbe23-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.625087 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.625068    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tvdd\" (UniqueName: \"kubernetes.io/projected/2528a319-5fee-4644-a623-deb3df0dbe23-kube-api-access-9tvdd\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7\" (UID: \"2528a319-5fee-4644-a623-deb3df0dbe23\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.701916 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.701831    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:43.844713 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.844682    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"]
May 25 01:14:43.845592 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:14:43.845569    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2528a319_5fee_4644_a623_deb3df0dbe23.slice/crio-e95bfa469c805921872f4a92b3f9b3b117d35683f2316a603b5de04e54174733 WatchSource:0}: Error finding container e95bfa469c805921872f4a92b3f9b3b117d35683f2316a603b5de04e54174733: Status 404 returned error can't find the container with id e95bfa469c805921872f4a92b3f9b3b117d35683f2316a603b5de04e54174733
May 25 01:14:43.929633 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.929601    2560 generic.go:358] "Generic (PLEG): container finished" podID="609aa2a8-2e64-4daf-9875-1a07a9447ccb" containerID="27f1ff30a6cfb4740cdaa07543c70b9e2c2c0d009071ff9db31f0f01375e60a5" exitCode=0
May 25 01:14:43.929828 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.929677    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs" event={"ID":"609aa2a8-2e64-4daf-9875-1a07a9447ccb","Type":"ContainerDied","Data":"27f1ff30a6cfb4740cdaa07543c70b9e2c2c0d009071ff9db31f0f01375e60a5"}
May 25 01:14:43.931344 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:43.931320    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7" event={"ID":"2528a319-5fee-4644-a623-deb3df0dbe23","Type":"ContainerStarted","Data":"e95bfa469c805921872f4a92b3f9b3b117d35683f2316a603b5de04e54174733"}
May 25 01:14:44.937853 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:44.937810    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7" event={"ID":"2528a319-5fee-4644-a623-deb3df0dbe23","Type":"ContainerStarted","Data":"553d8d99adaa276dd07fa3eeb43b6cdde1bd54276c180b76aafc6f53246be2e7"}
May 25 01:14:45.944063 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:45.944021    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs" event={"ID":"609aa2a8-2e64-4daf-9875-1a07a9447ccb","Type":"ContainerStarted","Data":"8dc1c0d4a4e27dc8607ee4cd24bde6b53edda5ec30689429d91d96f79b30e586"}
May 25 01:14:45.965122 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:45.965066    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs" podStartSLOduration=1.704887965 podStartE2EDuration="15.965050499s" podCreationTimestamp="2026-05-25 01:14:30 +0000 UTC" firstStartedPulling="2026-05-25 01:14:30.847137864 +0000 UTC m=+721.275348716" lastFinishedPulling="2026-05-25 01:14:45.107300391 +0000 UTC m=+735.535511250" observedRunningTime="2026-05-25 01:14:45.963015384 +0000 UTC m=+736.391226292" watchObservedRunningTime="2026-05-25 01:14:45.965050499 +0000 UTC m=+736.393261373"
May 25 01:14:49.963622 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:49.963589    2560 generic.go:358] "Generic (PLEG): container finished" podID="2528a319-5fee-4644-a623-deb3df0dbe23" containerID="553d8d99adaa276dd07fa3eeb43b6cdde1bd54276c180b76aafc6f53246be2e7" exitCode=0
May 25 01:14:49.963977 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:49.963664    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7" event={"ID":"2528a319-5fee-4644-a623-deb3df0dbe23","Type":"ContainerDied","Data":"553d8d99adaa276dd07fa3eeb43b6cdde1bd54276c180b76aafc6f53246be2e7"}
May 25 01:14:50.975836 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:50.975799    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7" event={"ID":"2528a319-5fee-4644-a623-deb3df0dbe23","Type":"ContainerStarted","Data":"f7e74b2e36a22fddfa025de997a2654987b0de9cbc049c9fb562a3748a5f8b5c"}
May 25 01:14:50.976336 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:50.976048    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:14:50.993324 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:50.993254    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7" podStartSLOduration=7.796072252 podStartE2EDuration="7.99321616s" podCreationTimestamp="2026-05-25 01:14:43 +0000 UTC" firstStartedPulling="2026-05-25 01:14:49.964302531 +0000 UTC m=+740.392513383" lastFinishedPulling="2026-05-25 01:14:50.161446438 +0000 UTC m=+740.589657291" observedRunningTime="2026-05-25 01:14:50.992146346 +0000 UTC m=+741.420357224" watchObservedRunningTime="2026-05-25 01:14:50.99321616 +0000 UTC m=+741.421427033"
May 25 01:14:55.944806 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:55.944760    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:14:55.958166 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:14:55.958140    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs"
May 25 01:15:01.992830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:01.992796    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7"
May 25 01:15:24.374160 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.374119    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fc9d4844c-tkpfc"]
May 25 01:15:24.377491 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.377467    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc9d4844c-tkpfc"
May 25 01:15:24.383650 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.383627    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc9d4844c-tkpfc"]
May 25 01:15:24.514648 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.514613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds9qv\" (UniqueName: \"kubernetes.io/projected/47b5531c-4353-4118-9f65-950dc32ea13a-kube-api-access-ds9qv\") pod \"authorino-7fc9d4844c-tkpfc\" (UID: \"47b5531c-4353-4118-9f65-950dc32ea13a\") " pod="kuadrant-system/authorino-7fc9d4844c-tkpfc"
May 25 01:15:24.514830 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.514697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47b5531c-4353-4118-9f65-950dc32ea13a-tls-cert\") pod \"authorino-7fc9d4844c-tkpfc\" (UID: \"47b5531c-4353-4118-9f65-950dc32ea13a\") " pod="kuadrant-system/authorino-7fc9d4844c-tkpfc"
May 25 01:15:24.615825 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.615784    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47b5531c-4353-4118-9f65-950dc32ea13a-tls-cert\") pod \"authorino-7fc9d4844c-tkpfc\" (UID: \"47b5531c-4353-4118-9f65-950dc32ea13a\") " pod="kuadrant-system/authorino-7fc9d4844c-tkpfc"
May 25 01:15:24.616029 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.615877    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ds9qv\" (UniqueName: \"kubernetes.io/projected/47b5531c-4353-4118-9f65-950dc32ea13a-kube-api-access-ds9qv\") pod \"authorino-7fc9d4844c-tkpfc\" (UID: \"47b5531c-4353-4118-9f65-950dc32ea13a\") " pod="kuadrant-system/authorino-7fc9d4844c-tkpfc"
May 25 01:15:24.618468 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.618443    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47b5531c-4353-4118-9f65-950dc32ea13a-tls-cert\") pod \"authorino-7fc9d4844c-tkpfc\" (UID: \"47b5531c-4353-4118-9f65-950dc32ea13a\") " pod="kuadrant-system/authorino-7fc9d4844c-tkpfc"
May 25 01:15:24.623696 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.623661    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds9qv\" (UniqueName: \"kubernetes.io/projected/47b5531c-4353-4118-9f65-950dc32ea13a-kube-api-access-ds9qv\") pod \"authorino-7fc9d4844c-tkpfc\" (UID: \"47b5531c-4353-4118-9f65-950dc32ea13a\") " pod="kuadrant-system/authorino-7fc9d4844c-tkpfc"
May 25 01:15:24.688083 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.688004    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc9d4844c-tkpfc"
May 25 01:15:24.826409 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:24.826381    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc9d4844c-tkpfc"]
May 25 01:15:24.827971 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:15:24.827945    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47b5531c_4353_4118_9f65_950dc32ea13a.slice/crio-d675cf7d246e9a5d8ac36e7159b6e762ec132e59db4a790cd4a7023cce5d9979 WatchSource:0}: Error finding container d675cf7d246e9a5d8ac36e7159b6e762ec132e59db4a790cd4a7023cce5d9979: Status 404 returned error can't find the container with id d675cf7d246e9a5d8ac36e7159b6e762ec132e59db4a790cd4a7023cce5d9979
May 25 01:15:25.114297 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:25.114259    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc9d4844c-tkpfc" event={"ID":"47b5531c-4353-4118-9f65-950dc32ea13a","Type":"ContainerStarted","Data":"d675cf7d246e9a5d8ac36e7159b6e762ec132e59db4a790cd4a7023cce5d9979"}
May 25 01:15:26.119929 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.119894    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc9d4844c-tkpfc" event={"ID":"47b5531c-4353-4118-9f65-950dc32ea13a","Type":"ContainerStarted","Data":"da0b4751f30e00c4b37f756a27120b6730c43492b56ba015ec570d9391f31210"}
May 25 01:15:26.135951 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.135880    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7fc9d4844c-tkpfc" podStartSLOduration=1.726958443 podStartE2EDuration="2.135864797s" podCreationTimestamp="2026-05-25 01:15:24 +0000 UTC" firstStartedPulling="2026-05-25 01:15:24.829402436 +0000 UTC m=+775.257613294" lastFinishedPulling="2026-05-25 01:15:25.238308793 +0000 UTC m=+775.666519648" observedRunningTime="2026-05-25 01:15:26.133531398 +0000 UTC m=+776.561742274" watchObservedRunningTime="2026-05-25 01:15:26.135864797 +0000 UTC m=+776.564075670"
May 25 01:15:26.162455 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.162417    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d8d4f8d54-5vm9l"]
May 25 01:15:26.162693 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.162665    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l" podUID="de147107-5dc6-4bb6-b738-a7ef5157e760" containerName="authorino" containerID="cri-o://f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213" gracePeriod=30
May 25 01:15:26.413082 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.413059    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:15:26.534476 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.534449    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de147107-5dc6-4bb6-b738-a7ef5157e760-tls-cert\") pod \"de147107-5dc6-4bb6-b738-a7ef5157e760\" (UID: \"de147107-5dc6-4bb6-b738-a7ef5157e760\") "
May 25 01:15:26.534655 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.534565    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pj5s\" (UniqueName: \"kubernetes.io/projected/de147107-5dc6-4bb6-b738-a7ef5157e760-kube-api-access-2pj5s\") pod \"de147107-5dc6-4bb6-b738-a7ef5157e760\" (UID: \"de147107-5dc6-4bb6-b738-a7ef5157e760\") "
May 25 01:15:26.537302 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.537272    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de147107-5dc6-4bb6-b738-a7ef5157e760-kube-api-access-2pj5s" (OuterVolumeSpecName: "kube-api-access-2pj5s") pod "de147107-5dc6-4bb6-b738-a7ef5157e760" (UID: "de147107-5dc6-4bb6-b738-a7ef5157e760"). InnerVolumeSpecName "kube-api-access-2pj5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:15:26.545902 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.545873    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de147107-5dc6-4bb6-b738-a7ef5157e760-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "de147107-5dc6-4bb6-b738-a7ef5157e760" (UID: "de147107-5dc6-4bb6-b738-a7ef5157e760"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:15:26.635495 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.635431    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de147107-5dc6-4bb6-b738-a7ef5157e760-tls-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:15:26.635495 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:26.635468    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pj5s\" (UniqueName: \"kubernetes.io/projected/de147107-5dc6-4bb6-b738-a7ef5157e760-kube-api-access-2pj5s\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:15:27.124725 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.124688    2560 generic.go:358] "Generic (PLEG): container finished" podID="de147107-5dc6-4bb6-b738-a7ef5157e760" containerID="f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213" exitCode=0
May 25 01:15:27.125150 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.124736    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l"
May 25 01:15:27.125150 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.124778    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l" event={"ID":"de147107-5dc6-4bb6-b738-a7ef5157e760","Type":"ContainerDied","Data":"f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213"}
May 25 01:15:27.125150 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.124806    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8d4f8d54-5vm9l" event={"ID":"de147107-5dc6-4bb6-b738-a7ef5157e760","Type":"ContainerDied","Data":"74ae0306a5c410373a87d0d5fc5ce53959633c0fb730092bc6c36f67ad26781d"}
May 25 01:15:27.125150 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.124821    2560 scope.go:117] "RemoveContainer" containerID="f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213"
May 25 01:15:27.133996 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.133975    2560 scope.go:117] "RemoveContainer" containerID="f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213"
May 25 01:15:27.134284 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:15:27.134265    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213\": container with ID starting with f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213 not found: ID does not exist" containerID="f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213"
May 25 01:15:27.134341 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.134295    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213"} err="failed to get container status \"f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213\": rpc error: code = NotFound desc = could not find container \"f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213\": container with ID starting with f24b13b0b6847bee3a50ba1fb5ec8b4190c884ae17be9990429cbccfddcbf213 not found: ID does not exist"
May 25 01:15:27.146605 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.146578    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d8d4f8d54-5vm9l"]
May 25 01:15:27.152313 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:27.152291    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d8d4f8d54-5vm9l"]
May 25 01:15:28.182707 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:15:28.182676    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de147107-5dc6-4bb6-b738-a7ef5157e760" path="/var/lib/kubelet/pods/de147107-5dc6-4bb6-b738-a7ef5157e760/volumes"
May 25 01:16:49.160289 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.160250    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-5jq27"]
May 25 01:16:49.160843 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.160513    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5dc4757f9c-5jq27" podUID="a4e69afe-a8f1-4c16-ad5f-ef1546e08e67" containerName="manager" containerID="cri-o://a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8" gracePeriod=30
May 25 01:16:49.406732 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.406708    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:16:49.471058 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.470961    2560 generic.go:358] "Generic (PLEG): container finished" podID="a4e69afe-a8f1-4c16-ad5f-ef1546e08e67" containerID="a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8" exitCode=0
May 25 01:16:49.471058 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.471033    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dc4757f9c-5jq27"
May 25 01:16:49.471257 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.471086    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dc4757f9c-5jq27" event={"ID":"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67","Type":"ContainerDied","Data":"a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8"}
May 25 01:16:49.471257 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.471125    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dc4757f9c-5jq27" event={"ID":"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67","Type":"ContainerDied","Data":"64ce9e5818603db374600da0fb3267bc28efee4089141f914e03d790356ba423"}
May 25 01:16:49.471257 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.471146    2560 scope.go:117] "RemoveContainer" containerID="a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8"
May 25 01:16:49.480110 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.480091    2560 scope.go:117] "RemoveContainer" containerID="a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8"
May 25 01:16:49.480382 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:16:49.480363    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8\": container with ID starting with a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8 not found: ID does not exist" containerID="a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8"
May 25 01:16:49.480446 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.480394    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8"} err="failed to get container status \"a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8\": rpc error: code = NotFound desc = could not find container \"a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8\": container with ID starting with a2ee984edfdd0458a8d2f05d54fc86a928e4176f2ca5ace1e98a811c4876d2f8 not found: ID does not exist"
May 25 01:16:49.519417 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.519387    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8b8w\" (UniqueName: \"kubernetes.io/projected/a4e69afe-a8f1-4c16-ad5f-ef1546e08e67-kube-api-access-b8b8w\") pod \"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67\" (UID: \"a4e69afe-a8f1-4c16-ad5f-ef1546e08e67\") "
May 25 01:16:49.521644 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.521623    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4e69afe-a8f1-4c16-ad5f-ef1546e08e67-kube-api-access-b8b8w" (OuterVolumeSpecName: "kube-api-access-b8b8w") pod "a4e69afe-a8f1-4c16-ad5f-ef1546e08e67" (UID: "a4e69afe-a8f1-4c16-ad5f-ef1546e08e67"). InnerVolumeSpecName "kube-api-access-b8b8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:16:49.620295 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.620257    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8b8w\" (UniqueName: \"kubernetes.io/projected/a4e69afe-a8f1-4c16-ad5f-ef1546e08e67-kube-api-access-b8b8w\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:16:49.793462 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.793433    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-5jq27"]
May 25 01:16:49.795857 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:49.795836    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-5jq27"]
May 25 01:16:50.183676 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.183638    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4e69afe-a8f1-4c16-ad5f-ef1546e08e67" path="/var/lib/kubelet/pods/a4e69afe-a8f1-4c16-ad5f-ef1546e08e67/volumes"
May 25 01:16:50.492610 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.492512    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-z85jq"]
May 25 01:16:50.493542 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.493513    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e69afe-a8f1-4c16-ad5f-ef1546e08e67" containerName="manager"
May 25 01:16:50.493542 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.493542    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e69afe-a8f1-4c16-ad5f-ef1546e08e67" containerName="manager"
May 25 01:16:50.493750 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.493574    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de147107-5dc6-4bb6-b738-a7ef5157e760" containerName="authorino"
May 25 01:16:50.493750 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.493583    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de147107-5dc6-4bb6-b738-a7ef5157e760" containerName="authorino"
May 25 01:16:50.493850 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.493794    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4e69afe-a8f1-4c16-ad5f-ef1546e08e67" containerName="manager"
May 25 01:16:50.493850 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.493816    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="de147107-5dc6-4bb6-b738-a7ef5157e760" containerName="authorino"
May 25 01:16:50.501275 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.501200    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dc4757f9c-z85jq"
May 25 01:16:50.504148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.504106    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 25 01:16:50.504366 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.504198    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-chf7f\""
May 25 01:16:50.506122 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.506100    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-z85jq"]
May 25 01:16:50.630294 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.630211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzzq\" (UniqueName: \"kubernetes.io/projected/d455e51c-2cba-469b-b630-f0c0fd0887b2-kube-api-access-cnzzq\") pod \"maas-controller-5dc4757f9c-z85jq\" (UID: \"d455e51c-2cba-469b-b630-f0c0fd0887b2\") " pod="opendatahub/maas-controller-5dc4757f9c-z85jq"
May 25 01:16:50.731064 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.731029    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzzq\" (UniqueName: \"kubernetes.io/projected/d455e51c-2cba-469b-b630-f0c0fd0887b2-kube-api-access-cnzzq\") pod \"maas-controller-5dc4757f9c-z85jq\" (UID: \"d455e51c-2cba-469b-b630-f0c0fd0887b2\") " pod="opendatahub/maas-controller-5dc4757f9c-z85jq"
May 25 01:16:50.739516 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.739486    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzzq\" (UniqueName: \"kubernetes.io/projected/d455e51c-2cba-469b-b630-f0c0fd0887b2-kube-api-access-cnzzq\") pod \"maas-controller-5dc4757f9c-z85jq\" (UID: \"d455e51c-2cba-469b-b630-f0c0fd0887b2\") " pod="opendatahub/maas-controller-5dc4757f9c-z85jq"
May 25 01:16:50.815666 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.815577    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dc4757f9c-z85jq"
May 25 01:16:50.952257 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:50.952211    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dc4757f9c-z85jq"]
May 25 01:16:50.953343 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:16:50.953315    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd455e51c_2cba_469b_b630_f0c0fd0887b2.slice/crio-1f9b86eec7c7cba15821ef6518404ad456cc1681c0b229edfd28404d81704d10 WatchSource:0}: Error finding container 1f9b86eec7c7cba15821ef6518404ad456cc1681c0b229edfd28404d81704d10: Status 404 returned error can't find the container with id 1f9b86eec7c7cba15821ef6518404ad456cc1681c0b229edfd28404d81704d10
May 25 01:16:51.482435 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:51.482378    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dc4757f9c-z85jq" event={"ID":"d455e51c-2cba-469b-b630-f0c0fd0887b2","Type":"ContainerStarted","Data":"44a254d51adba8d4875d7697e230f52333776f0d1bcfaeff909901e9ed9d9efb"}
May 25 01:16:51.482435 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:51.482436    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dc4757f9c-z85jq" event={"ID":"d455e51c-2cba-469b-b630-f0c0fd0887b2","Type":"ContainerStarted","Data":"1f9b86eec7c7cba15821ef6518404ad456cc1681c0b229edfd28404d81704d10"}
May 25 01:16:51.482825 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:51.482456    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5dc4757f9c-z85jq"
May 25 01:16:51.498148 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:16:51.498097    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5dc4757f9c-z85jq" podStartSLOduration=1.144101697 podStartE2EDuration="1.498082927s" podCreationTimestamp="2026-05-25 01:16:50 +0000 UTC" firstStartedPulling="2026-05-25 01:16:50.954660934 +0000 UTC m=+861.382871785" lastFinishedPulling="2026-05-25 01:16:51.30864216 +0000 UTC m=+861.736853015" observedRunningTime="2026-05-25 01:16:51.496986356 +0000 UTC m=+861.925197231" watchObservedRunningTime="2026-05-25 01:16:51.498082927 +0000 UTC m=+861.926293834"
May 25 01:17:02.492100 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:17:02.492072    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5dc4757f9c-z85jq"
May 25 01:17:30.159825 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:17:30.159735    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:17:30.160429 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:17:30.159982    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:17:30.163141 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:17:30.163121    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:17:30.163141 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:17:30.163132    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:22:30.195451 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:22:30.195419    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:22:30.196896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:22:30.196864    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:22:30.198167 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:22:30.198148    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:22:30.199737 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:22:30.199717    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:27:09.046995 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.046952    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"]
May 25 01:27:09.049718 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.047177    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r" podUID="f658a1d8-798c-4e0c-a260-aa4ebf0da1bd" containerName="manager" containerID="cri-o://d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240" gracePeriod=10
May 25 01:27:09.304426 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.304369    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:27:09.413039 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.413010    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsxrd\" (UniqueName: \"kubernetes.io/projected/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-kube-api-access-wsxrd\") pod \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\" (UID: \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\") "
May 25 01:27:09.413196 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.413092    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-extensions-socket-volume\") pod \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\" (UID: \"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd\") "
May 25 01:27:09.413479 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.413442    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f658a1d8-798c-4e0c-a260-aa4ebf0da1bd" (UID: "f658a1d8-798c-4e0c-a260-aa4ebf0da1bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:27:09.415238 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.415205    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-kube-api-access-wsxrd" (OuterVolumeSpecName: "kube-api-access-wsxrd") pod "f658a1d8-798c-4e0c-a260-aa4ebf0da1bd" (UID: "f658a1d8-798c-4e0c-a260-aa4ebf0da1bd"). InnerVolumeSpecName "kube-api-access-wsxrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:27:09.514588 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.514554    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-extensions-socket-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:27:09.514588 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.514583    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsxrd\" (UniqueName: \"kubernetes.io/projected/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd-kube-api-access-wsxrd\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
May 25 01:27:09.989953 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.989912    2560 generic.go:358] "Generic (PLEG): container finished" podID="f658a1d8-798c-4e0c-a260-aa4ebf0da1bd" containerID="d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240" exitCode=0
May 25 01:27:09.990176 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.989986    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"
May 25 01:27:09.990176 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.990007    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r" event={"ID":"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd","Type":"ContainerDied","Data":"d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240"}
May 25 01:27:09.990176 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.990056    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r" event={"ID":"f658a1d8-798c-4e0c-a260-aa4ebf0da1bd","Type":"ContainerDied","Data":"9a81a92f9bc8140e67d02ff9a2231e84c76e39c6c331a9a01a20527af859b9c6"}
May 25 01:27:09.990176 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.990078    2560 scope.go:117] "RemoveContainer" containerID="d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240"
May 25 01:27:09.999966 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:09.999942    2560 scope.go:117] "RemoveContainer" containerID="d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240"
May 25 01:27:10.000214 ip-10-0-133-121 kubenswrapper[2560]: E0525 01:27:10.000196    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240\": container with ID starting with d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240 not found: ID does not exist" containerID="d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240"
May 25 01:27:10.000310 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:10.000264    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240"} err="failed to get container status \"d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240\": rpc error: code = NotFound desc = could not find container \"d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240\": container with ID starting with d3569ffa59dfeb2a2a605cf8a81fa7a0b72f9b1b269acac8d0ceb7b23dfbf240 not found: ID does not exist"
May 25 01:27:10.014635 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:10.014609    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"]
May 25 01:27:10.018714 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:10.018683    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vd67r"]
May 25 01:27:10.184119 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:10.184086    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f658a1d8-798c-4e0c-a260-aa4ebf0da1bd" path="/var/lib/kubelet/pods/f658a1d8-798c-4e0c-a260-aa4ebf0da1bd/volumes"
May 25 01:27:30.232671 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:30.232641    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:27:30.237771 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:30.237749    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:27:30.239164 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:30.239142    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:27:30.240669 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:27:30.240642    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:28:15.094372 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.094287    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"]
May 25 01:28:15.094818 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.094685    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f658a1d8-798c-4e0c-a260-aa4ebf0da1bd" containerName="manager"
May 25 01:28:15.094818 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.094695    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f658a1d8-798c-4e0c-a260-aa4ebf0da1bd" containerName="manager"
May 25 01:28:15.094818 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.094756    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="f658a1d8-798c-4e0c-a260-aa4ebf0da1bd" containerName="manager"
May 25 01:28:15.097762 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.097747    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:15.100849 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.100833    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s7l95\""
May 25 01:28:15.116660 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.116622    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"]
May 25 01:28:15.217855 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.217801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp9cf\" (UniqueName: \"kubernetes.io/projected/078f5f07-da47-4f78-aff8-0bf030b81d44-kube-api-access-mp9cf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r98pr\" (UID: \"078f5f07-da47-4f78-aff8-0bf030b81d44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:15.218058 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.217884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/078f5f07-da47-4f78-aff8-0bf030b81d44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r98pr\" (UID: \"078f5f07-da47-4f78-aff8-0bf030b81d44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:15.319131 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.319093    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/078f5f07-da47-4f78-aff8-0bf030b81d44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r98pr\" (UID: \"078f5f07-da47-4f78-aff8-0bf030b81d44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:15.319335 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.319255    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mp9cf\" (UniqueName: \"kubernetes.io/projected/078f5f07-da47-4f78-aff8-0bf030b81d44-kube-api-access-mp9cf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r98pr\" (UID: \"078f5f07-da47-4f78-aff8-0bf030b81d44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:15.319546 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.319528    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/078f5f07-da47-4f78-aff8-0bf030b81d44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r98pr\" (UID: \"078f5f07-da47-4f78-aff8-0bf030b81d44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:15.336039 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.336007    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp9cf\" (UniqueName: \"kubernetes.io/projected/078f5f07-da47-4f78-aff8-0bf030b81d44-kube-api-access-mp9cf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r98pr\" (UID: \"078f5f07-da47-4f78-aff8-0bf030b81d44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:15.408981 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.408903    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:15.561642 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.561606    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"]
May 25 01:28:15.562181 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:28:15.562157    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078f5f07_da47_4f78_aff8_0bf030b81d44.slice/crio-2a42228ca23f2a04cfd5fd7d91a69a3267dbd11a0fb3ba4ed5aa0e5046ccd1e9 WatchSource:0}: Error finding container 2a42228ca23f2a04cfd5fd7d91a69a3267dbd11a0fb3ba4ed5aa0e5046ccd1e9: Status 404 returned error can't find the container with id 2a42228ca23f2a04cfd5fd7d91a69a3267dbd11a0fb3ba4ed5aa0e5046ccd1e9
May 25 01:28:15.564485 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:15.564467    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:28:16.255962 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:16.255921    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr" event={"ID":"078f5f07-da47-4f78-aff8-0bf030b81d44","Type":"ContainerStarted","Data":"ca8061c735f931d6f3678433471d23ef530d5e8eb7230ff9f7b024e3859b515e"}
May 25 01:28:16.255962 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:16.255961    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr" event={"ID":"078f5f07-da47-4f78-aff8-0bf030b81d44","Type":"ContainerStarted","Data":"2a42228ca23f2a04cfd5fd7d91a69a3267dbd11a0fb3ba4ed5aa0e5046ccd1e9"}
May 25 01:28:16.256440 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:16.256053    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:28:16.280652 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:16.280606    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr" podStartSLOduration=1.280593181 podStartE2EDuration="1.280593181s" podCreationTimestamp="2026-05-25 01:28:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:28:16.277604099 +0000 UTC m=+1546.705814973" watchObservedRunningTime="2026-05-25 01:28:16.280593181 +0000 UTC m=+1546.708804055"
May 25 01:28:27.263108 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:28:27.263073    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r98pr"
May 25 01:32:30.270315 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:32:30.270284    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:32:30.273293 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:32:30.273269    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:32:30.273444 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:32:30.273352    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:32:30.276161 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:32:30.276142    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:37:30.311600 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:30.311570    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:37:30.314186 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:30.312833    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:37:30.314389 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:30.314373    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:37:30.315322 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:30.315304    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:37:54.675974 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:54.675946    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc9d4844c-tkpfc_47b5531c-4353-4118-9f65-950dc32ea13a/authorino/0.log"
May 25 01:37:58.973132 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:58.973100    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5697844489-65mgs_b3d7ff77-5b2b-440b-b96f-416a1b32a9ad/maas-api/0.log"
May 25 01:37:59.304538 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:59.304459    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5dc4757f9c-z85jq_d455e51c-2cba-469b-b630-f0c0fd0887b2/manager/0.log"
May 25 01:37:59.623052 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:59.623027    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6588b9546d-scssq_617cf175-e776-4593-a5da-fc28c666cf2f/manager/0.log"
May 25 01:37:59.839493 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:37:59.839468    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-s56c8_bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5/postgres/0.log"
May 25 01:38:00.560270 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.560239    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg_62d297fb-3449-4575-ac94-de525cbf4008/util/0.log"
May 25 01:38:00.566370 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.566346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg_62d297fb-3449-4575-ac94-de525cbf4008/pull/0.log"
May 25 01:38:00.572302 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.572284    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg_62d297fb-3449-4575-ac94-de525cbf4008/extract/0.log"
May 25 01:38:00.679561 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.679535    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r_c2c0d296-7169-456e-8d5e-5d4ed72d5a9e/pull/0.log"
May 25 01:38:00.685028 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.685011    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r_c2c0d296-7169-456e-8d5e-5d4ed72d5a9e/extract/0.log"
May 25 01:38:00.690216 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.690198    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r_c2c0d296-7169-456e-8d5e-5d4ed72d5a9e/util/0.log"
May 25 01:38:00.799665 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.799643    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8_8a042dcd-eeae-4869-b988-5b14c9adbc63/util/0.log"
May 25 01:38:00.805596 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.805578    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8_8a042dcd-eeae-4869-b988-5b14c9adbc63/pull/0.log"
May 25 01:38:00.811353 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.811295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8_8a042dcd-eeae-4869-b988-5b14c9adbc63/extract/0.log"
May 25 01:38:00.913489 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.913465    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7_b27b1972-7740-47a1-a784-8761f4f6c24f/util/0.log"
May 25 01:38:00.918893 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.918878    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7_b27b1972-7740-47a1-a784-8761f4f6c24f/pull/0.log"
May 25 01:38:00.924352 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:00.924331    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7_b27b1972-7740-47a1-a784-8761f4f6c24f/extract/0.log"
May 25 01:38:01.031084 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:01.031063    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc9d4844c-tkpfc_47b5531c-4353-4118-9f65-950dc32ea13a/authorino/0.log"
May 25 01:38:01.463534 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:01.463505    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bk5jb_38e23db3-3ccb-4ab5-9c4c-5b89cad645b4/registry-server/0.log"
May 25 01:38:01.573745 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:01.573721    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-r98pr_078f5f07-da47-4f78-aff8-0bf030b81d44/manager/0.log"
May 25 01:38:02.113964 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:02.113937    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f86md5r_1d217c7c-106d-4693-abab-34c9843932b0/istio-proxy/0.log"
May 25 01:38:02.533759 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:02.533686    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-wkch7_826c9caa-8034-4d90-8ae1-063b4c1664b3/istio-proxy/0.log"
May 25 01:38:02.635728 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:02.635703    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-67gf9_02f0a436-9c1e-41d9-9c68-87d079750630/payload-processing/0.log"
May 25 01:38:03.178054 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:03.178027    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs_609aa2a8-2e64-4daf-9875-1a07a9447ccb/storage-initializer/0.log"
May 25 01:38:03.186657 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:03.186633    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-gsjhs_609aa2a8-2e64-4daf-9875-1a07a9447ccb/main/0.log"
May 25 01:38:03.506558 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:03.506485    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7_2528a319-5fee-4644-a623-deb3df0dbe23/storage-initializer/0.log"
May 25 01:38:03.512364 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:03.512346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fm9k7_2528a319-5fee-4644-a623-deb3df0dbe23/main/0.log"
May 25 01:38:10.359085 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:10.359053    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2z59s_cecc21eb-2753-4343-8511-6453a2b30417/global-pull-secret-syncer/0.log"
May 25 01:38:10.482216 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:10.482189    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gv5pb_8ae3a468-ebf5-441a-a232-e654bcb9c52d/konnectivity-agent/0.log"
May 25 01:38:10.563722 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:10.563697    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-121.ec2.internal_f6115103e00adc9377ba1c7fc9b87c19/haproxy/0.log"
May 25 01:38:14.221670 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.221637    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg_62d297fb-3449-4575-ac94-de525cbf4008/extract/0.log"
May 25 01:38:14.242883 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.242857    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg_62d297fb-3449-4575-ac94-de525cbf4008/util/0.log"
May 25 01:38:14.262795 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.262771    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd8zg_62d297fb-3449-4575-ac94-de525cbf4008/pull/0.log"
May 25 01:38:14.294063 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.294035    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r_c2c0d296-7169-456e-8d5e-5d4ed72d5a9e/extract/0.log"
May 25 01:38:14.312763 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.312740    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r_c2c0d296-7169-456e-8d5e-5d4ed72d5a9e/util/0.log"
May 25 01:38:14.331693 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.331673    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p287r_c2c0d296-7169-456e-8d5e-5d4ed72d5a9e/pull/0.log"
May 25 01:38:14.359095 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.359074    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8_8a042dcd-eeae-4869-b988-5b14c9adbc63/extract/0.log"
May 25 01:38:14.380441 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.380412    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8_8a042dcd-eeae-4869-b988-5b14c9adbc63/util/0.log"
May 25 01:38:14.401750 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.401725    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lk6q8_8a042dcd-eeae-4869-b988-5b14c9adbc63/pull/0.log"
May 25 01:38:14.431006 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.430984    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7_b27b1972-7740-47a1-a784-8761f4f6c24f/extract/0.log"
May 25 01:38:14.449872 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.449849    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7_b27b1972-7740-47a1-a784-8761f4f6c24f/util/0.log"
May 25 01:38:14.472526 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.472468    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dpvf7_b27b1972-7740-47a1-a784-8761f4f6c24f/pull/0.log"
May 25 01:38:14.681555 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.681525    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc9d4844c-tkpfc_47b5531c-4353-4118-9f65-950dc32ea13a/authorino/0.log"
May 25 01:38:14.795237 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.795145    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bk5jb_38e23db3-3ccb-4ab5-9c4c-5b89cad645b4/registry-server/0.log"
May 25 01:38:14.869262 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:14.869216    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-r98pr_078f5f07-da47-4f78-aff8-0bf030b81d44/manager/0.log"
May 25 01:38:16.594502 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.594466    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-2vsnp_cf761b57-8d4a-4cb0-a96d-c14b95d29ec0/kube-state-metrics/0.log"
May 25 01:38:16.618025 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.617995    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-2vsnp_cf761b57-8d4a-4cb0-a96d-c14b95d29ec0/kube-rbac-proxy-main/0.log"
May 25 01:38:16.637971 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.637947    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-2vsnp_cf761b57-8d4a-4cb0-a96d-c14b95d29ec0/kube-rbac-proxy-self/0.log"
May 25 01:38:16.664103 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.664081    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5ddf994cbc-zfhcr_4fac08c0-389c-4dec-9f11-f230523c2c6f/metrics-server/0.log"
May 25 01:38:16.688039 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.688021    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-wdgdb_98b4d31a-6c9e-4cb1-953f-3b25779af278/monitoring-plugin/0.log"
May 25 01:38:16.731416 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.731387    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-787h5_ccd0f0d7-c332-4918-bac1-f0afa00b2689/node-exporter/0.log"
May 25 01:38:16.760665 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.760640    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-787h5_ccd0f0d7-c332-4918-bac1-f0afa00b2689/kube-rbac-proxy/0.log"
May 25 01:38:16.781750 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.781713    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-787h5_ccd0f0d7-c332-4918-bac1-f0afa00b2689/init-textfile/0.log"
May 25 01:38:16.947294 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.947202    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-d2wvk_a57711ad-f4a9-4d82-810c-8288d5a2beee/kube-rbac-proxy-main/0.log"
May 25 01:38:16.969642 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.969616    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-d2wvk_a57711ad-f4a9-4d82-810c-8288d5a2beee/kube-rbac-proxy-self/0.log"
May 25 01:38:16.991172 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:16.991147    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-d2wvk_a57711ad-f4a9-4d82-810c-8288d5a2beee/openshift-state-metrics/0.log"
May 25 01:38:17.294559 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:17.294480    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b8b97fb-nxjvf_d8a483d6-1cfa-4f5c-8b10-7f9b05819acc/telemeter-client/0.log"
May 25 01:38:17.313530 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:17.313491    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b8b97fb-nxjvf_d8a483d6-1cfa-4f5c-8b10-7f9b05819acc/reload/0.log"
May 25 01:38:17.332679 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:17.332652    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b8b97fb-nxjvf_d8a483d6-1cfa-4f5c-8b10-7f9b05819acc/kube-rbac-proxy/0.log"
May 25 01:38:18.829685 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.829607    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"]
May 25 01:38:18.833422 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.833401    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.836788 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.836758    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5jj4g\"/\"default-dockercfg-mcntr\""
May 25 01:38:18.836992 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.836763    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jj4g\"/\"kube-root-ca.crt\""
May 25 01:38:18.837094 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.836822    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jj4g\"/\"openshift-service-ca.crt\""
May 25 01:38:18.842979 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.842957    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"]
May 25 01:38:18.898411 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.898381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-podres\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.898411 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.898421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-sys\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.898624 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.898469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbn8r\" (UniqueName: \"kubernetes.io/projected/b942a534-0d9a-4d99-94cd-8c7b230c4f17-kube-api-access-vbn8r\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.898624 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.898501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-lib-modules\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.898624 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.898528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-proc\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.999720 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999689    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-podres\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.999896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999730    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-sys\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.999896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999779    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbn8r\" (UniqueName: \"kubernetes.io/projected/b942a534-0d9a-4d99-94cd-8c7b230c4f17-kube-api-access-vbn8r\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.999896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999799    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-lib-modules\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.999896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999842    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-proc\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.999896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999867    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-podres\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:18.999896 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999886    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-sys\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:19.000098 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999934    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-proc\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:19.000098 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:18.999935    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b942a534-0d9a-4d99-94cd-8c7b230c4f17-lib-modules\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:19.008196 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.008173    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbn8r\" (UniqueName: \"kubernetes.io/projected/b942a534-0d9a-4d99-94cd-8c7b230c4f17-kube-api-access-vbn8r\") pod \"perf-node-gather-daemonset-qnjvk\" (UID: \"b942a534-0d9a-4d99-94cd-8c7b230c4f17\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:19.145315 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.145205    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:19.147515 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.146182    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/1.log"
May 25 01:38:19.153076 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.153048    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fsfz6_6e426a9f-f72d-47b0-af0f-7c81dcbc2ef4/console-operator/2.log"
May 25 01:38:19.282093 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.282060    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"]
May 25 01:38:19.283969 ip-10-0-133-121 kubenswrapper[2560]: W0525 01:38:19.283942    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb942a534_0d9a_4d99_94cd_8c7b230c4f17.slice/crio-0a0f2174aed01f17c30984d0d7aa5dd2a1770dad9cdc3900c8f8b67657f1397c WatchSource:0}: Error finding container 0a0f2174aed01f17c30984d0d7aa5dd2a1770dad9cdc3900c8f8b67657f1397c: Status 404 returned error can't find the container with id 0a0f2174aed01f17c30984d0d7aa5dd2a1770dad9cdc3900c8f8b67657f1397c
May 25 01:38:19.285881 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.285862    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:38:19.662611 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.662586    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f97c86858-59z7q_0fc5e053-5214-4cd1-8dcf-220482480363/console/0.log"
May 25 01:38:19.776581 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.776545    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk" event={"ID":"b942a534-0d9a-4d99-94cd-8c7b230c4f17","Type":"ContainerStarted","Data":"9ebb6d62f862da3a969fe4438ade838acf73a0ac1d2c5dea8e234e830c16e265"}
May 25 01:38:19.776581 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.776584    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk" event={"ID":"b942a534-0d9a-4d99-94cd-8c7b230c4f17","Type":"ContainerStarted","Data":"0a0f2174aed01f17c30984d0d7aa5dd2a1770dad9cdc3900c8f8b67657f1397c"}
May 25 01:38:19.776793 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.776606    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:19.792424 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:19.792376    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk" podStartSLOduration=1.792363034 podStartE2EDuration="1.792363034s" podCreationTimestamp="2026-05-25 01:38:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:38:19.790916532 +0000 UTC m=+2150.219127407" watchObservedRunningTime="2026-05-25 01:38:19.792363034 +0000 UTC m=+2150.220573907"
May 25 01:38:20.232432 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:20.232406    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-rts2f_15a2999c-5bb3-40f9-a41c-322cc5b01c57/volume-data-source-validator/0.log"
May 25 01:38:21.023130 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:21.023100    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26w8p_be1ea56e-4410-4a30-b795-29c06baaa915/dns/0.log"
May 25 01:38:21.042726 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:21.042686    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26w8p_be1ea56e-4410-4a30-b795-29c06baaa915/kube-rbac-proxy/0.log"
May 25 01:38:21.149761 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:21.149735    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4b6q_60d09b4f-ddbf-4925-85a8-bc1245a28498/dns-node-resolver/0.log"
May 25 01:38:21.648046 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:21.648013    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-cfb75474f-tc47l_dc00fe49-bca4-47cc-8522-37ea360511e3/registry/0.log"
May 25 01:38:21.690772 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:21.690743    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hfxhs_91718d6a-07eb-4323-9fe6-2bf204f74f71/node-ca/0.log"
May 25 01:38:22.525725 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:22.525699    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f86md5r_1d217c7c-106d-4693-abab-34c9843932b0/istio-proxy/0.log"
May 25 01:38:22.706197 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:22.706161    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-wkch7_826c9caa-8034-4d90-8ae1-063b4c1664b3/istio-proxy/0.log"
May 25 01:38:22.767046 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:22.767008    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-67gf9_02f0a436-9c1e-41d9-9c68-87d079750630/payload-processing/0.log"
May 25 01:38:23.352281 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:23.352258    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ncr46_d55dc3e2-2745-4fa4-9967-e88706dce19c/serve-healthcheck-canary/0.log"
May 25 01:38:23.784092 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:23.784007    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-rmjjk_451af408-e043-461b-b8c1-040f69caa390/insights-operator/0.log"
May 25 01:38:23.784544 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:23.784511    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-rmjjk_451af408-e043-461b-b8c1-040f69caa390/insights-operator/1.log"
May 25 01:38:23.802553 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:23.802532    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-grsvl_d2882aa8-e6e1-4bcf-98d0-15f86c779317/kube-rbac-proxy/0.log"
May 25 01:38:23.820956 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:23.820937    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-grsvl_d2882aa8-e6e1-4bcf-98d0-15f86c779317/exporter/0.log"
May 25 01:38:23.841071 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:23.841055    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-grsvl_d2882aa8-e6e1-4bcf-98d0-15f86c779317/extractor/0.log"
May 25 01:38:25.791015 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:25.790989    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-qnjvk"
May 25 01:38:25.809285 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:25.809262    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5697844489-65mgs_b3d7ff77-5b2b-440b-b96f-416a1b32a9ad/maas-api/0.log"
May 25 01:38:25.914646 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:25.914612    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5dc4757f9c-z85jq_d455e51c-2cba-469b-b630-f0c0fd0887b2/manager/0.log"
May 25 01:38:25.994187 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:25.994150    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6588b9546d-scssq_617cf175-e776-4593-a5da-fc28c666cf2f/manager/0.log"
May 25 01:38:26.053725 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:26.053647    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-s56c8_bcc32c03-d17b-4120-ad2f-f8b76bb7b4e5/postgres/0.log"
May 25 01:38:27.150265 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:27.150214    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8556845d74-9gcvj_f46f986d-7d1f-4e67-9a19-bb7c0f3c4c2c/manager/0.log"
May 25 01:38:33.086307 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.086278    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5rg4l_eef5509c-b268-45c9-a47b-7bfdfd3532e7/kube-multus/0.log"
May 25 01:38:33.448061 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.447972    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqpcz_eb55b0df-405e-4c3b-8e91-198a33549969/kube-multus-additional-cni-plugins/0.log"
May 25 01:38:33.466576 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.466550    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqpcz_eb55b0df-405e-4c3b-8e91-198a33549969/egress-router-binary-copy/0.log"
May 25 01:38:33.486647 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.486619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqpcz_eb55b0df-405e-4c3b-8e91-198a33549969/cni-plugins/0.log"
May 25 01:38:33.504789 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.504756    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqpcz_eb55b0df-405e-4c3b-8e91-198a33549969/bond-cni-plugin/0.log"
May 25 01:38:33.522779 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.522756    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqpcz_eb55b0df-405e-4c3b-8e91-198a33549969/routeoverride-cni/0.log"
May 25 01:38:33.541579 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.541557    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqpcz_eb55b0df-405e-4c3b-8e91-198a33549969/whereabouts-cni-bincopy/0.log"
May 25 01:38:33.559875 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.559858    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqpcz_eb55b0df-405e-4c3b-8e91-198a33549969/whereabouts-cni/0.log"
May 25 01:38:33.660397 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.660373    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zzn6w_c68b976f-c760-446d-a601-1d72941a0429/network-metrics-daemon/0.log"
May 25 01:38:33.681293 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:33.681268    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zzn6w_c68b976f-c760-446d-a601-1d72941a0429/kube-rbac-proxy/0.log"
May 25 01:38:34.997893 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:34.997861    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-controller/0.log"
May 25 01:38:35.013181 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:35.013161    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/0.log"
May 25 01:38:35.022939 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:35.022921    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovn-acl-logging/1.log"
May 25 01:38:35.040887 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:35.040871    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/kube-rbac-proxy-node/0.log"
May 25 01:38:35.063507 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:35.063483    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/kube-rbac-proxy-ovn-metrics/0.log"
May 25 01:38:35.083752 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:35.083733    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/northd/0.log"
May 25 01:38:35.101889 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:35.101870    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/nbdb/0.log"
May 25 01:38:35.120155 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:35.120138    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/sbdb/0.log"
May 25 01:38:35.217342 ip-10-0-133-121 kubenswrapper[2560]: I0525 01:38:35.217317    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rj8vk_5a8f190b-958a-439f-81c7-eb51e8e04200/ovnkube-controller/0.log"