May 28 03:14:24.205606 ip-10-0-135-231 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 03:14:24.205617 ip-10-0-135-231 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 03:14:24.205624 ip-10-0-135-231 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 03:14:24.205833 ip-10-0-135-231 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 03:14:34.287110 ip-10-0-135-231 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 03:14:34.287128 ip-10-0-135-231 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1a9a3290b393493db13987c524e10e4a --
May 28 03:16:51.064552 ip-10-0-135-231 systemd[1]: Starting Kubernetes Kubelet...
May 28 03:16:51.544779 ip-10-0-135-231 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 03:16:51.544779 ip-10-0-135-231 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 03:16:51.544779 ip-10-0-135-231 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 03:16:51.545418 ip-10-0-135-231 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 03:16:51.545418 ip-10-0-135-231 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 03:16:51.547182 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.547099    2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 03:16:51.551645 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551624    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 03:16:51.551645 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551643    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 03:16:51.551645 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551648    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 03:16:51.551645 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551651    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551655    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551658    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551661    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551663    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551666    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551669    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551672    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551674    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551677    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551679    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551682    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551684    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551686    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551689    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551691    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551694    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551697    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551699    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551701    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 03:16:51.551817 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551704    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551706    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551712    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551715    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551717    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551720    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551722    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551725    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551727    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551730    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551732    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551734    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551737    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551742    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551747    2575 feature_gate.go:328] unrecognized feature gate: Example
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551750    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551753    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551756    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551759    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 03:16:51.552338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551761    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551764    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551766    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551769    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551771    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551774    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551776    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551779    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551781    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551784    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551786    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551789    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551791    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551793    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551796    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551799    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551801    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551803    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551807    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551810    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 03:16:51.552784 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551813    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551816    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551818    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551821    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551823    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551826    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551829    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551832    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551835    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551837    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551840    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551843    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551845    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551848    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551850    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551859    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551864    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551866    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551869    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551872    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 03:16:51.553268 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551875    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551877    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551880    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.551882    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553566    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553574    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553578    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553581    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553585    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553587    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553590    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553593    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553597    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553608    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553611    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553614    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553617    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553619    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553622    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553625    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 03:16:51.553738 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553627    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553629    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553632    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553634    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553637    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553639    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553641    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553644    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553647    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553649    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553652    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553655    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553658    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553661    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553664    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553666    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553669    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553671    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553674    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553676    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 03:16:51.554329 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553678    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553682    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553684    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553687    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553690    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553694    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553697    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553699    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553702    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553705    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553708    2575 feature_gate.go:328] unrecognized feature gate: Example
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553710    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553713    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553716    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553718    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553721    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553724    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553726    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553729    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553732    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 03:16:51.554851 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553734    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553737    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553741    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553745    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553748    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553750    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553753    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553755    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553758    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553760    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553763    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553765    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553767    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553770    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553772    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553774    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553777    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553779    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553781    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 03:16:51.555338 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553784    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553787    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553789    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553792    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553794    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553797    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553799    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553802    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553804    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553806    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.553809    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553878    2575 flags.go:64] FLAG: --address="0.0.0.0"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553884    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553892    2575 flags.go:64] FLAG: --anonymous-auth="true"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553897    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553901    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553904    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553908    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553912    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553916    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553919    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 03:16:51.555791 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553922    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553925    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553928    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553931    2575 flags.go:64] FLAG: --cgroup-root=""
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553934    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553937    2575 flags.go:64] FLAG: --client-ca-file=""
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553939    2575 flags.go:64] FLAG: --cloud-config=""
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553942    2575 flags.go:64] FLAG: --cloud-provider="external"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553945    2575 flags.go:64] FLAG: --cluster-dns="[]"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553948    2575 flags.go:64] FLAG: --cluster-domain=""
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553952    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553955    2575 flags.go:64] FLAG: --config-dir=""
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553957    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553961    2575 flags.go:64] FLAG: --container-log-max-files="5"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553964    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553967    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553970    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553973    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553976    2575 flags.go:64] FLAG: --contention-profiling="false"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553979    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553982    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553985    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553988    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553992    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553995    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 03:16:51.556283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.553998    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554001    2575 flags.go:64] FLAG: --enable-load-reader="false"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554004    2575 flags.go:64] FLAG: --enable-server="true"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554008    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554012    2575 flags.go:64] FLAG: --event-burst="100"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554015    2575 flags.go:64] FLAG: --event-qps="50"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554018    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554021    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554024    2575 flags.go:64] FLAG: --eviction-hard=""
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554027    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554030    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554033    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554036    2575 flags.go:64] FLAG: --eviction-soft=""
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554038    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554041    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554044    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554046    2575 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554053    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554056    2575 flags.go:64] FLAG: --fail-swap-on="true"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554059    2575 flags.go:64] FLAG: --feature-gates=""
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554062    2575 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554065    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554068    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554071    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554074    2575 flags.go:64] FLAG: --healthz-port="10248"
May 28 03:16:51.556865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554077    2575 flags.go:64] FLAG: --help="false"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554080    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-135-231.ec2.internal"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554083    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554086    2575 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554088    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554092    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554095    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554098    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554101    2575 flags.go:64] FLAG: --image-service-endpoint=""
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554103    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554106    2575 flags.go:64] FLAG: --kube-api-burst="100"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554109    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554112    2575 flags.go:64] FLAG: --kube-api-qps="50"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554115    2575 flags.go:64] FLAG: --kube-reserved=""
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554117    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554120    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554123    2575 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554126    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554129    2575 flags.go:64] FLAG: --lock-file=""
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554131    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554134    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554137    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554142    2575 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 03:16:51.557507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554145    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554149    2575 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554151    2575 flags.go:64] FLAG: --logging-format="text"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554154    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554157    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554160    2575 flags.go:64] FLAG: --manifest-url=""
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554163    2575 flags.go:64] FLAG: --manifest-url-header=""
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554167    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554170    2575 flags.go:64] FLAG: --max-open-files="1000000"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554174    2575 flags.go:64] FLAG: --max-pods="110"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554177    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554180    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554183    2575 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554185    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554188    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554191    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554194    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554201    2575 flags.go:64] FLAG: --node-status-max-images="50"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554204    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554207    2575 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554210    2575 flags.go:64] FLAG: --pod-cidr=""
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554214    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554218    2575 flags.go:64] FLAG: --pod-manifest-path=""
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554221    2575 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 03:16:51.558051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554224    2575 flags.go:64] FLAG: --pods-per-core="0"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554227    2575 flags.go:64] FLAG: --port="10250"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554230    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554233    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-015d42de15559449f"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554236    2575 flags.go:64] FLAG: --qos-reserved=""
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554238    2575 flags.go:64] FLAG: --read-only-port="10255"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554256    2575 flags.go:64] FLAG: --register-node="true"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554260    2575 flags.go:64] FLAG: --register-schedulable="true"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554264    2575 flags.go:64] FLAG: --register-with-taints=""
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554267    2575 flags.go:64] FLAG: --registry-burst="10"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554272    2575 flags.go:64] FLAG: --registry-qps="5"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554275    2575 flags.go:64] FLAG: --reserved-cpus=""
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554277    2575 flags.go:64] FLAG: --reserved-memory=""
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554282    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554285    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554288    2575 flags.go:64] FLAG: --rotate-certificates="false"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554290    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554293    2575 flags.go:64] FLAG: --runonce="false"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554296    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554299    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554302    2575 flags.go:64] FLAG: --seccomp-default="false"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554304    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554307    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554310    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554313    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554316    2575 flags.go:64] FLAG: --storage-driver-password="root"
May 28 03:16:51.558626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554319    2575 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554321    2575 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554324    2575 flags.go:64] FLAG: --storage-driver-user="root"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554327    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554330    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554333    2575 flags.go:64] FLAG: --system-cgroups=""
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554336    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554341    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554344    2575 flags.go:64] FLAG: --tls-cert-file=""
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554347    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554350    2575 flags.go:64] FLAG: --tls-min-version=""
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554353    2575 flags.go:64] FLAG: --tls-private-key-file=""
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554356    2575 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554359    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554361    2575 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554364    2575 flags.go:64] FLAG: --v="2"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554369    2575 flags.go:64] FLAG: --version="false"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554373    2575 flags.go:64] FLAG: --vmodule=""
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554377    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554380    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554462    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554467    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554471    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 03:16:51.559225 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554474    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554477    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554480    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554483    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554485    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554488    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554492    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554495    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554498    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554501    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554504    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554507    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554510    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554513    2575 feature_gate.go:328] unrecognized feature gate: Example
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554516    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554519    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554521    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554524    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554526    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 03:16:51.559819 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554529    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554532    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554534    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554536    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554539    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554541    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554545    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554548    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554550    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554554    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554557    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554559    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554562    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554564    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554567    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554569    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554572    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554574    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554577    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554579    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 03:16:51.560336 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554582    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554584    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554587    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554589    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554592    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554595    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554597    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554600    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554603    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554605    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554608    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554610    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554613    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554615    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554618    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554620    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554623    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554625    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554629    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554631    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 03:16:51.560806 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554634    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554638    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554640    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554643    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554645    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554648    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554650    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554652    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554655    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554658    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554660    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554662    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554665    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554667    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554670    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554672    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554675    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554677    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554679    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554682    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 03:16:51.561307 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554685    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554687    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554690    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.554692    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.554697    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.561685    2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.561703    2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561749    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561754    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561758    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561761    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561765    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561767    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561770    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561773    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561775    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 03:16:51.561796 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561778    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561780    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561783    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561785    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561788    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561791    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561794    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561796    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561799    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561802    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561804    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561807    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561811    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561816    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561819    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561822    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561825    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561827    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561830    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 03:16:51.562182 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561832    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561835    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561838    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561841    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561843    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561846    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561850    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561852    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561855    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561858    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561860    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561863    2575 feature_gate.go:328] unrecognized feature gate: Example
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561865    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561867    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561870    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561873    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561876    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561879    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561881    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 03:16:51.562716 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561884    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561886    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561889    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561892    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561894    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561897    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561899    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561901    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561904    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561906    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561909    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561911    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561914    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561917    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561919    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561921    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561924    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561926    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561929    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561931    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 03:16:51.563171 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561934    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561936    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561939    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561941    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561944    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561946    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561948    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561951    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561954    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561956    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561959    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561961    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561963    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561966    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561968    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561971    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561973    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561976    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 03:16:51.563656 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.561978    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.561983    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562072    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562076    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562079    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562081    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562085    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562087    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562090    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562092    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562095    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562097    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562107    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562109    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562112    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 03:16:51.564082 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562114    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562117    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562120    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562123    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562126    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562129    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562132    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562134    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562137    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562139    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562142    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562146    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562149    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562152    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562154    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562157    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562160    2575 feature_gate.go:328] unrecognized feature gate: Example
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562162    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562165    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 03:16:51.564466 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562167    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562170    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562173    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562176    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562178    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562181    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562183    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562186    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562188    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562191    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562193    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562197    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562201    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562203    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562206    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562208    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562211    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562213    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562216    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562218    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 03:16:51.564917 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562221    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562223    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562225    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562228    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562230    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562232    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562235    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562237    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562254    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562258    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562260    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562263    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562265    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562268    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562270    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562273    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562275    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562278    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562280    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562283    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 03:16:51.565397 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562285    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562288    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562290    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562293    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562296    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562299    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562302    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562304    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562307    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562309    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562312    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562314    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562316    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:51.562319    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.562324    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 03:16:51.565868 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.563108    2575 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 03:16:51.566339 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.566288    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 03:16:51.567132 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.567120    2575 server.go:1019] "Starting client certificate rotation"
May 28 03:16:51.567233 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.567216    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 03:16:51.567288 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.567265    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 03:16:51.595861 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.595844    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 03:16:51.598543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.598520    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 03:16:51.608480 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.608463    2575 log.go:25] "Validated CRI v1 runtime API"
May 28 03:16:51.613929 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.613913    2575 log.go:25] "Validated CRI v1 image API"
May 28 03:16:51.618177 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.618161    2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 03:16:51.620662 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.620642    2575 fs.go:135] Filesystem UUIDs: map[35c7f101-edbb-44e0-8388-30db65555da8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c3913e50-9e24-4efb-9e36-e43d2d841838:/dev/nvme0n1p4]
May 28 03:16:51.620731 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.620661    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 03:16:51.624695 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.624596    2575 manager.go:217] Machine: {Timestamp:2026-05-28 03:16:51.624090174 +0000 UTC m=+0.433105769 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200635 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20fccbf54978d453b077e5cb181db3 SystemUUID:ec20fccb-f549-78d4-53b0-77e5cb181db3 BootID:1a9a3290-b393-493d-b139-87c524e10e4a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:79:75:26:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:79:75:26:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:e5:40:b0:f4:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 03:16:51.624695 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.624694    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 03:16:51.624811 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.624763    2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 03:16:51.627673 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.627647    2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 03:16:51.627799 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.627675    2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-231.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 03:16:51.627843 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.627809    2575 topology_manager.go:138] "Creating topology manager with none policy"
May 28 03:16:51.627843 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.627817    2575 container_manager_linux.go:306] "Creating device plugin manager"
May 28 03:16:51.627843 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.627825    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 03:16:51.629320 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.629309    2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 03:16:51.631327 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.631316    2575 state_mem.go:36] "Initialized new in-memory state store"
May 28 03:16:51.631443 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.631434    2575 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 03:16:51.634796 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.634787    2575 kubelet.go:491] "Attempting to sync node with API server"
May 28 03:16:51.634846 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.634800    2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 03:16:51.634846 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.634812    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 03:16:51.634846 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.634824    2575 kubelet.go:397] "Adding apiserver pod source"
May 28 03:16:51.634846 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.634833    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 03:16:51.636002 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.635990    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 03:16:51.636035 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.636008    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 03:16:51.639529 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.639514    2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 03:16:51.641401 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.641388    2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 03:16:51.642162 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642152    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642167    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642173    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642179    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642187    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642193    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642198    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642203    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642209    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 03:16:51.642228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642225    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 03:16:51.642473 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642261    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 03:16:51.642473 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642423    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 03:16:51.642564 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642553    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 03:16:51.642595 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642584    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 03:16:51.642629 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.642594    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 03:16:51.645544 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.645531    2575 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 03:16:51.645595 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.645569    2575 server.go:1295] "Started kubelet"
May 28 03:16:51.645710 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.645673    2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 03:16:51.645764 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.645678    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 03:16:51.645764 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.645722    2575 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 03:16:51.646324 ip-10-0-135-231 systemd[1]: Started Kubernetes Kubelet.
May 28 03:16:51.646833 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.646803    2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 03:16:51.648960 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.648947    2575 server.go:317] "Adding debug handlers to kubelet server"
May 28 03:16:51.654033 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654017    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 03:16:51.654130 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654034    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 03:16:51.654219 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654203    2575 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 03:16:51.654295 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654221    2575 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 03:16:51.654341 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654311    2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 03:16:51.654559 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654414    2575 reconstruct.go:97] "Volume reconstruction finished"
May 28 03:16:51.654559 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654427    2575 reconciler.go:26] "Reconciler: start to sync state"
May 28 03:16:51.654746 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654574    2575 factory.go:55] Registering systemd factory
May 28 03:16:51.654746 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654587    2575 factory.go:223] Registration of the systemd container factory successfully
May 28 03:16:51.654908 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654895    2575 factory.go:153] Registering CRI-O factory
May 28 03:16:51.654908 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654908    2575 factory.go:223] Registration of the crio container factory successfully
May 28 03:16:51.654966 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654940    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 03:16:51.654966 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654957    2575 factory.go:103] Registering Raw factory
May 28 03:16:51.655048 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654975    2575 manager.go:1196] Started watching for new ooms in manager
May 28 03:16:51.655048 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.654985    2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-231.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 03:16:51.655048 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.654999    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:51.655166 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.655143    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 03:16:51.655512 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.655494    2575 manager.go:319] Starting recovery of all containers
May 28 03:16:51.655512 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.655497    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 03:16:51.655955 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.655039    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-231.ec2.internal.18b39c5f7b46d403  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-231.ec2.internal,UID:ip-10-0-135-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-231.ec2.internal,},FirstTimestamp:2026-05-28 03:16:51.645543427 +0000 UTC m=+0.454559023,LastTimestamp:2026-05-28 03:16:51.645543427 +0000 UTC m=+0.454559023,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-231.ec2.internal,}"
May 28 03:16:51.656059 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.656042    2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 03:16:51.662019 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.661986    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 03:16:51.662116 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.662055    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 03:16:51.662317 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.662292    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 03:16:51.665546 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.665418    2575 manager.go:324] Recovery completed
May 28 03:16:51.669844 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.669828    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 03:16:51.672417 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.672319    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
May 28 03:16:51.672417 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.672356    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
May 28 03:16:51.672417 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.672371    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
May 28 03:16:51.672889 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.672867    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 03:16:51.672889 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.672883    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 03:16:51.672987 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.672900    2575 state_mem.go:36] "Initialized new in-memory state store"
May 28 03:16:51.675315 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.675295    2575 policy_none.go:49] "None policy: Start"
May 28 03:16:51.675315 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.675311    2575 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 03:16:51.675407 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.675322    2575 state_mem.go:35] "Initializing new in-memory state store"
May 28 03:16:51.680448 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.680385    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-231.ec2.internal.18b39c5f7cdfaeb6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-231.ec2.internal,UID:ip-10-0-135-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-231.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-231.ec2.internal,},FirstTimestamp:2026-05-28 03:16:51.672338102 +0000 UTC m=+0.481353699,LastTimestamp:2026-05-28 03:16:51.672338102 +0000 UTC m=+0.481353699,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-231.ec2.internal,}"
May 28 03:16:51.687870 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.687814    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-231.ec2.internal.18b39c5f7ce0107b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-231.ec2.internal,UID:ip-10-0-135-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-231.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-231.ec2.internal,},FirstTimestamp:2026-05-28 03:16:51.672363131 +0000 UTC m=+0.481378727,LastTimestamp:2026-05-28 03:16:51.672363131 +0000 UTC m=+0.481378727,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-231.ec2.internal,}"
May 28 03:16:51.693301 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.693228    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-231.ec2.internal.18b39c5f7ce04703  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-231.ec2.internal,UID:ip-10-0-135-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-231.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-231.ec2.internal,},FirstTimestamp:2026-05-28 03:16:51.672377091 +0000 UTC m=+0.481392687,LastTimestamp:2026-05-28 03:16:51.672377091 +0000 UTC m=+0.481392687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-231.ec2.internal,}"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.714740    2575 manager.go:341] "Starting Device Plugin manager"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.714764    2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.714774    2575 server.go:85] "Starting device plugin registration server"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.715179    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.715219    2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.715430    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.715511    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.715520    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 03:16:51.717358 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.717029    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 03:16:51.717841 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.717114    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:51.721486 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.721416    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-231.ec2.internal.18b39c5f7fa2c33c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-231.ec2.internal,UID:ip-10-0-135-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-135-231.ec2.internal,},FirstTimestamp:2026-05-28 03:16:51.718677308 +0000 UTC m=+0.527692895,LastTimestamp:2026-05-28 03:16:51.718677308 +0000 UTC m=+0.527692895,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-231.ec2.internal,}"
May 28 03:16:51.744178 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.744152    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 03:16:51.744237 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.744185    2575 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 03:16:51.744237 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.744199    2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 03:16:51.744237 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.744204    2575 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 03:16:51.744391 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.744234    2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 03:16:51.752345 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.752327    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n94wv"
May 28 03:16:51.768034 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.768007    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
May 28 03:16:51.770442 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.770427    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n94wv"
May 28 03:16:51.816305 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.816268    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 03:16:51.817031 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.817018    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
May 28 03:16:51.817098 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.817047    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
May 28 03:16:51.817098 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.817062    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
May 28 03:16:51.817098 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.817089    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-231.ec2.internal"
May 28 03:16:51.842313 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.842298    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-231.ec2.internal"
May 28 03:16:51.842402 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.842316    2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-231.ec2.internal\": node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:51.845292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.845276    2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"]
May 28 03:16:51.845345 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.845335    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 03:16:51.846019 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.846007    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
May 28 03:16:51.846065 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.846030    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
May 28 03:16:51.846065 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.846040    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
May 28 03:16:51.847417 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.847406    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 03:16:51.847567 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.847552    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.847622 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.847587    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 03:16:51.848030 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.848016    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
May 28 03:16:51.848089 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.848043    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
May 28 03:16:51.848089 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.848021    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
May 28 03:16:51.848089 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.848080    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
May 28 03:16:51.848171 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.848092    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
May 28 03:16:51.848171 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.848056    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
May 28 03:16:51.849256 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.849231    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.849303 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.849270    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 03:16:51.849884 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.849869    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
May 28 03:16:51.849968 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.849895    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
May 28 03:16:51.849968 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.849904    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
May 28 03:16:51.855549 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.855527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da623cf4961b94d1fdb8d13cf889b129-config\") pod \"kube-apiserver-proxy-ip-10-0-135-231.ec2.internal\" (UID: \"da623cf4961b94d1fdb8d13cf889b129\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.855621 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.855554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8213c702d51259d488238456bba2c43c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"8213c702d51259d488238456bba2c43c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.855621 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.855570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8213c702d51259d488238456bba2c43c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"8213c702d51259d488238456bba2c43c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.877745 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.877730    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-231.ec2.internal\" not found" node="ip-10-0-135-231.ec2.internal"
May 28 03:16:51.882098 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.882083    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-231.ec2.internal\" not found" node="ip-10-0-135-231.ec2.internal"
May 28 03:16:51.915043 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:51.915025    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:51.955952 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.955929    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8213c702d51259d488238456bba2c43c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"8213c702d51259d488238456bba2c43c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.956037 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.955955    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da623cf4961b94d1fdb8d13cf889b129-config\") pod \"kube-apiserver-proxy-ip-10-0-135-231.ec2.internal\" (UID: \"da623cf4961b94d1fdb8d13cf889b129\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.956037 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.955974    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8213c702d51259d488238456bba2c43c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"8213c702d51259d488238456bba2c43c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.956037 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.956025    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8213c702d51259d488238456bba2c43c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"8213c702d51259d488238456bba2c43c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.956136 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.956034    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da623cf4961b94d1fdb8d13cf889b129-config\") pod \"kube-apiserver-proxy-ip-10-0-135-231.ec2.internal\" (UID: \"da623cf4961b94d1fdb8d13cf889b129\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
May 28 03:16:51.956136 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:51.956027    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8213c702d51259d488238456bba2c43c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"8213c702d51259d488238456bba2c43c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:52.015532 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.015512    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.116552 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.116476    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.180408 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.180385    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:52.185178 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.185160    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
May 28 03:16:52.217344 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.217319    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.318070 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.318030    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.419066 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.419003    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.519613 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.519562    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.566976 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.566950    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 03:16:52.620286 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.620254    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.654633 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.654610    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 03:16:52.661865 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:52.661836    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8213c702d51259d488238456bba2c43c.slice/crio-e9ed1e0571c9b18359ba7abd94aea8f97c0e7cf0783d47ac86a6a17603250275 WatchSource:0}: Error finding container e9ed1e0571c9b18359ba7abd94aea8f97c0e7cf0783d47ac86a6a17603250275: Status 404 returned error can't find the container with id e9ed1e0571c9b18359ba7abd94aea8f97c0e7cf0783d47ac86a6a17603250275
May 28 03:16:52.662065 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:52.662043    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda623cf4961b94d1fdb8d13cf889b129.slice/crio-2d53e2e731fceafe6ff21092d50322a934c6c845d4ba049a1754fd16078e80c2 WatchSource:0}: Error finding container 2d53e2e731fceafe6ff21092d50322a934c6c845d4ba049a1754fd16078e80c2: Status 404 returned error can't find the container with id 2d53e2e731fceafe6ff21092d50322a934c6c845d4ba049a1754fd16078e80c2
May 28 03:16:52.665979 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.665966    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 03:16:52.707778 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.707708    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 03:16:52.720789 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.720768    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.746637 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.746591    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" event={"ID":"8213c702d51259d488238456bba2c43c","Type":"ContainerStarted","Data":"e9ed1e0571c9b18359ba7abd94aea8f97c0e7cf0783d47ac86a6a17603250275"}
May 28 03:16:52.747467 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.747444    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal" event={"ID":"da623cf4961b94d1fdb8d13cf889b129","Type":"ContainerStarted","Data":"2d53e2e731fceafe6ff21092d50322a934c6c845d4ba049a1754fd16078e80c2"}
May 28 03:16:52.771930 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.771898    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 03:11:51 +0000 UTC" deadline="2027-12-06 10:12:46.906886849 +0000 UTC"
May 28 03:16:52.771930 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.771927    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13374h55m54.134964043s"
May 28 03:16:52.821083 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.821056    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.894582 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.894558    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5b5rn"
May 28 03:16:52.911916 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.911890    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5b5rn"
May 28 03:16:52.921295 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:52.921278    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:52.939647 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:52.939630    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 03:16:53.022189 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.022110    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:53.038341 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.038310    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 03:16:53.123057 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.122996    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:53.204577 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.204550    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 03:16:53.223407 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.223383    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
May 28 03:16:53.231907 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.231882    2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 03:16:53.254789 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.254768    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
May 28 03:16:53.271403 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.271381    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 03:16:53.272699 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.272629    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
May 28 03:16:53.299103 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.299083    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 03:16:53.636439 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.636379    2575 apiserver.go:52] "Watching apiserver"
May 28 03:16:53.648843 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.648821    2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 03:16:53.650446 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.650155    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-28gl6","kube-system/konnectivity-agent-x8d4x","kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal","openshift-dns/node-resolver-7vdkz","openshift-image-registry/node-ca-gnkmn","openshift-network-diagnostics/network-check-target-7x4wf","openshift-ovn-kubernetes/ovnkube-node-967gw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd","openshift-cluster-node-tuning-operator/tuned-h2zvm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal","openshift-multus/multus-additional-cni-plugins-5k4fz","openshift-multus/multus-qbmnf","openshift-multus/network-metrics-daemon-zrh6v"]
May 28 03:16:53.652653 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.652635    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.653902 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.653884    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:16:53.655661 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.655370    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:53.655661 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.655463    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:16:53.657929 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.657901    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.659784 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.659768    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.661119 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.661100    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:53.661203 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.661162    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:16:53.662294 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.662278    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.663708 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.663690    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.665143 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665123    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.665474 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4b60b80-1cc7-437f-910f-87f958f240fd-konnectivity-ca\") pod \"konnectivity-agent-x8d4x\" (UID: \"c4b60b80-1cc7-437f-910f-87f958f240fd\") " pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:16:53.665474 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:53.665620 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8qvr\" (UniqueName: \"kubernetes.io/projected/ce717d11-92f8-498b-a97e-2112e10126e4-kube-api-access-x8qvr\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:53.665620 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86a80d64-1c89-4ccf-b555-01bd5a93a69a-host-slash\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.665620 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665609    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 03:16:53.665760 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4b60b80-1cc7-437f-910f-87f958f240fd-agent-certs\") pod \"konnectivity-agent-x8d4x\" (UID: \"c4b60b80-1cc7-437f-910f-87f958f240fd\") " pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:16:53.665760 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665684    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 03:16:53.665760 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665615    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 03:16:53.665760 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86a80d64-1c89-4ccf-b555-01bd5a93a69a-iptables-alerter-script\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.665932 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.665756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4kvj\" (UniqueName: \"kubernetes.io/projected/86a80d64-1c89-4ccf-b555-01bd5a93a69a-kube-api-access-p4kvj\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.666519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.666387    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 03:16:53.666519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.666444    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 03:16:53.666519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.666448    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 03:16:53.666519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.666480    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-px2hd\""
May 28 03:16:53.666750 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.666693    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 03:16:53.666800 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.666762    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xw529\""
May 28 03:16:53.666800 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.666788    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.667300 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.667281    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 03:16:53.667394 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.667358    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 03:16:53.667449 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.667392    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 03:16:53.667528 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.667507    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 03:16:53.668067 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.668047    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.673225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.673209    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 03:16:53.674038 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.674021    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 03:16:53.674038 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.674030    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5cj67\""
May 28 03:16:53.674274 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.674180    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pvh9f\""
May 28 03:16:53.675058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.675040    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 03:16:53.690484 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.690464    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 03:16:53.690562 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.690482    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 03:16:53.690612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.690560    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 03:16:53.690670 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.690635    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 03:16:53.690718 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.690670    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 03:16:53.690798 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.690781    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 03:16:53.690871 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.690853    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 03:16:53.690963 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.690881    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 03:16:53.691140 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691115    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lnw94\""
May 28 03:16:53.691284 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691267    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 03:16:53.691356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691291    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 03:16:53.691356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691303    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 03:16:53.691528 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691512    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 03:16:53.691608 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691558    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sz447\""
May 28 03:16:53.691663 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691647    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rfj8z\""
May 28 03:16:53.691785 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691767    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-95ml4\""
May 28 03:16:53.691853 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.691813    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w86zq\""
May 28 03:16:53.692597 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.692582    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 03:16:53.755666 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.755643    2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 03:16:53.766121 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-kubernetes\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.766273 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-k8s-cni-cncf-io\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.766273 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-etc-kubernetes\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.766273 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a33c77e1-ff1e-44d0-b195-4c6935500e52-host\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.766273 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766264    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4kvj\" (UniqueName: \"kubernetes.io/projected/86a80d64-1c89-4ccf-b555-01bd5a93a69a-kube-api-access-p4kvj\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.766482 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766307    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4b60b80-1cc7-437f-910f-87f958f240fd-konnectivity-ca\") pod \"konnectivity-agent-x8d4x\" (UID: \"c4b60b80-1cc7-437f-910f-87f958f240fd\") " pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:16:53.766482 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766335    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8qvr\" (UniqueName: \"kubernetes.io/projected/ce717d11-92f8-498b-a97e-2112e10126e4-kube-api-access-x8qvr\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:53.766482 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.766482 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.766482 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-socket-dir-parent\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.766482 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-tuned\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovnkube-script-lib\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-cnibin\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-os-release\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-registration-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-etc-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-systemd\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.766739 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-run\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-lib-modules\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-ovn\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28n4q\" (UniqueName: \"kubernetes.io/projected/42005029-cee3-4b35-95c2-cfe92bdaa774-kube-api-access-28n4q\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766892    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4b60b80-1cc7-437f-910f-87f958f240fd-konnectivity-ca\") pod \"konnectivity-agent-x8d4x\" (UID: \"c4b60b80-1cc7-437f-910f-87f958f240fd\") " pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-host\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766938    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovnkube-config\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.766971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.767056 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.767032    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-cni-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.767103    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:16:54.267082348 +0000 UTC m=+3.076097945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767175    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4b60b80-1cc7-437f-910f-87f958f240fd-agent-certs\") pod \"konnectivity-agent-x8d4x\" (UID: \"c4b60b80-1cc7-437f-910f-87f958f240fd\") " pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysctl-conf\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-var-lib-kubelet\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-cni-bin\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-hostroot\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-kubelet\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5xq8\" (UniqueName: \"kubernetes.io/projected/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-kube-api-access-q5xq8\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-socket-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.767412 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-system-cni-dir\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767437    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86a80d64-1c89-4ccf-b555-01bd5a93a69a-host-slash\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-sys\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767484    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86a80d64-1c89-4ccf-b555-01bd5a93a69a-host-slash\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-systemd-units\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767534    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-systemd\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-cni-bin\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-cnibin\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-tmp\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysctl-d\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4842\" (UniqueName: \"kubernetes.io/projected/4b447b66-ea57-463f-b96c-860f0778ffec-kube-api-access-p4842\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-slash\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767810    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-cni-binary-copy\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9nsf\" (UniqueName: \"kubernetes.io/projected/805b37cd-8d3c-461c-91af-031e41196836-kube-api-access-n9nsf\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42005029-cee3-4b35-95c2-cfe92bdaa774-cni-binary-copy\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.767878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-multus-certs\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-sys-fs\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysconfig\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-run-netns\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.767989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-cni-netd\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-env-overrides\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-cni-multus\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zmh6\" (UniqueName: \"kubernetes.io/projected/a33c77e1-ff1e-44d0-b195-4c6935500e52-kube-api-access-5zmh6\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-var-lib-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-node-log\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovn-node-metrics-cert\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-device-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9306d75d-c142-4179-a7f5-4a85d5a21651-tmp-dir\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5582w\" (UniqueName: \"kubernetes.io/projected/9306d75d-c142-4179-a7f5-4a85d5a21651-kube-api-access-5582w\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-netns\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.768543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7dn6\" (UniqueName: \"kubernetes.io/projected/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-kube-api-access-h7dn6\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768225    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86a80d64-1c89-4ccf-b555-01bd5a93a69a-iptables-alerter-script\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-system-cni-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-modprobe-d\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-log-socket\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9306d75d-c142-4179-a7f5-4a85d5a21651-hosts-file\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-conf-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-os-release\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-kubelet\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768635    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-daemon-config\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a33c77e1-ff1e-44d0-b195-4c6935500e52-serviceca\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.769043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.768722    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86a80d64-1c89-4ccf-b555-01bd5a93a69a-iptables-alerter-script\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.770609 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.770594    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4b60b80-1cc7-437f-910f-87f958f240fd-agent-certs\") pod \"konnectivity-agent-x8d4x\" (UID: \"c4b60b80-1cc7-437f-910f-87f958f240fd\") " pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:16:53.783721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.783697    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4kvj\" (UniqueName: \"kubernetes.io/projected/86a80d64-1c89-4ccf-b555-01bd5a93a69a-kube-api-access-p4kvj\") pod \"iptables-alerter-28gl6\" (UID: \"86a80d64-1c89-4ccf-b555-01bd5a93a69a\") " pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.785865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.785115    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8qvr\" (UniqueName: \"kubernetes.io/projected/ce717d11-92f8-498b-a97e-2112e10126e4-kube-api-access-x8qvr\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:53.869583 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869550    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovn-node-metrics-cert\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.869744 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869596    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-device-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.869744 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869664    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-device-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.869744 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869715    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9306d75d-c142-4179-a7f5-4a85d5a21651-tmp-dir\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.869925 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869757    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5582w\" (UniqueName: \"kubernetes.io/projected/9306d75d-c142-4179-a7f5-4a85d5a21651-kube-api-access-5582w\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.869925 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869778    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-netns\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.869925 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869803    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7dn6\" (UniqueName: \"kubernetes.io/projected/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-kube-api-access-h7dn6\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.869925 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869829    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-system-cni-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.869925 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869853    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-modprobe-d\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.869925 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869872    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-netns\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.869925 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869877    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-log-socket\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869914    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-log-socket\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869933    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869983    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9306d75d-c142-4179-a7f5-4a85d5a21651-hosts-file\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.869993    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-system-cni-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870008    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-conf-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870035    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870038    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9306d75d-c142-4179-a7f5-4a85d5a21651-hosts-file\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870050    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870058    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-os-release\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870055    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-modprobe-d\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870078    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-conf-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870082    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-kubelet\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870075    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9306d75d-c142-4179-a7f5-4a85d5a21651-tmp-dir\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870109    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870115    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-daemon-config\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870112    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-os-release\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870153    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a33c77e1-ff1e-44d0-b195-4c6935500e52-serviceca\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.870224 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-kubelet\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870201    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-kubernetes\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870314    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-kubernetes\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870316    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-k8s-cni-cncf-io\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870366    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-k8s-cni-cncf-io\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870379    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-etc-kubernetes\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870407    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a33c77e1-ff1e-44d0-b195-4c6935500e52-host\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870411    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-etc-kubernetes\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870435    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870483    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870507    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-socket-dir-parent\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870523    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a33c77e1-ff1e-44d0-b195-4c6935500e52-host\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870532    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-tuned\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870532    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870571    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovnkube-script-lib\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870574    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a33c77e1-ff1e-44d0-b195-4c6935500e52-serviceca\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870596    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-cnibin\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870618    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-os-release\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.871876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870641    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-registration-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870642    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-socket-dir-parent\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870670    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870691    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-cnibin\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870707    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-os-release\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870639    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870695    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-etc-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870736    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-etc-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870751    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870781    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-systemd\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870782    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-registration-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870804    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-run\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870828    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-lib-modules\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870860    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-ovn\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870889    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28n4q\" (UniqueName: \"kubernetes.io/projected/42005029-cee3-4b35-95c2-cfe92bdaa774-kube-api-access-28n4q\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870913    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-host\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870949    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovnkube-config\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870971    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-systemd\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.872674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871114    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-run\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871196    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovnkube-script-lib\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-lib-modules\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.870972    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871281    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-cni-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871287    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-host\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871309    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysctl-conf\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871333    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-var-lib-kubelet\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871358    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-cni-bin\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871382    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-hostroot\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871386    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871412    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-var-lib-kubelet\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871409    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-kubelet\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871455    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-kubelet\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871457    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-cni-dir\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871461    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5xq8\" (UniqueName: \"kubernetes.io/projected/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-kube-api-access-q5xq8\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871531    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-socket-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.873427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871538    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-hostroot\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871557    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-system-cni-dir\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871584    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-sys\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871587    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovnkube-config\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871599    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysctl-conf\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871500    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-cni-bin\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871357    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42005029-cee3-4b35-95c2-cfe92bdaa774-multus-daemon-config\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871609    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-systemd-units\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871656    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-sys\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871660    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-ovn\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871659    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-systemd\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871693    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-systemd-units\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871702    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-cni-bin\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871715    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-socket-dir\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871722    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-systemd\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871728    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-cnibin\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871693    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-system-cni-dir\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871735    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-cni-bin\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871751    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-tmp\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871769    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-cnibin\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871773    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysctl-d\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871797    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4842\" (UniqueName: \"kubernetes.io/projected/4b447b66-ea57-463f-b96c-860f0778ffec-kube-api-access-p4842\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871791    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805b37cd-8d3c-461c-91af-031e41196836-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871832    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-slash\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871860    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871883    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-cni-binary-copy\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871907    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9nsf\" (UniqueName: \"kubernetes.io/projected/805b37cd-8d3c-461c-91af-031e41196836-kube-api-access-n9nsf\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871914    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysctl-d\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871934    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42005029-cee3-4b35-95c2-cfe92bdaa774-cni-binary-copy\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871959    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-multus-certs\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871964    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-run-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871982    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-sys-fs\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.871999    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-slash\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872011    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysconfig\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872036    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-run-netns\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.874682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872076    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-cni-netd\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872103    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-env-overrides\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872122    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b447b66-ea57-463f-b96c-860f0778ffec-sys-fs\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872127    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872168    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-cni-multus\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872204    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zmh6\" (UniqueName: \"kubernetes.io/projected/a33c77e1-ff1e-44d0-b195-4c6935500e52-kube-api-access-5zmh6\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872228    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-var-lib-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872273    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-node-log\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872297    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-ovn-node-metrics-cert\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872350    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-run-multus-certs\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872356    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-node-log\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872402    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-var-lib-openvswitch\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872406    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42005029-cee3-4b35-95c2-cfe92bdaa774-host-var-lib-cni-multus\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872471    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42005029-cee3-4b35-95c2-cfe92bdaa774-cni-binary-copy\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872535    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-run-netns\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872557    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-host-cni-netd\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872573    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.875361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872582    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-sysconfig\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.875957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.872808    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805b37cd-8d3c-461c-91af-031e41196836-cni-binary-copy\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.875957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.873940    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-tmp\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.875957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.873955    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-env-overrides\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.875957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.874268    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-etc-tuned\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.900028 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.899980    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4842\" (UniqueName: \"kubernetes.io/projected/4b447b66-ea57-463f-b96c-860f0778ffec-kube-api-access-p4842\") pod \"aws-ebs-csi-driver-node-fd8kd\" (UID: \"4b447b66-ea57-463f-b96c-860f0778ffec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:53.900141 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.900122    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7dn6\" (UniqueName: \"kubernetes.io/projected/b2e4e84a-ec78-4a99-bcb6-a0df39f4355e-kube-api-access-h7dn6\") pod \"tuned-h2zvm\" (UID: \"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e\") " pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:53.900318 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.900297    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5xq8\" (UniqueName: \"kubernetes.io/projected/a0f3b5fb-111e-4ab5-a883-8abb2b7874f3-kube-api-access-q5xq8\") pod \"ovnkube-node-967gw\" (UID: \"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.901124 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.901102    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9nsf\" (UniqueName: \"kubernetes.io/projected/805b37cd-8d3c-461c-91af-031e41196836-kube-api-access-n9nsf\") pod \"multus-additional-cni-plugins-5k4fz\" (UID: \"805b37cd-8d3c-461c-91af-031e41196836\") " pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:53.902461 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.902444    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5582w\" (UniqueName: \"kubernetes.io/projected/9306d75d-c142-4179-a7f5-4a85d5a21651-kube-api-access-5582w\") pod \"node-resolver-7vdkz\" (UID: \"9306d75d-c142-4179-a7f5-4a85d5a21651\") " pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:53.904548 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.904526    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zmh6\" (UniqueName: \"kubernetes.io/projected/a33c77e1-ff1e-44d0-b195-4c6935500e52-kube-api-access-5zmh6\") pod \"node-ca-gnkmn\" (UID: \"a33c77e1-ff1e-44d0-b195-4c6935500e52\") " pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.904635 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.904554    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 03:16:53.904635 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.904577    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 03:16:53.904635 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.904590    2575 projected.go:194] Error preparing data for projected volume kube-api-access-g5hg9 for pod openshift-network-diagnostics/network-check-target-7x4wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:16:53.904755 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:53.904657    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9 podName:88ca0e72-afe9-4265-b011-6f3765550b07 nodeName:}" failed. No retries permitted until 2026-05-28 03:16:54.404639826 +0000 UTC m=+3.213655429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g5hg9" (UniqueName: "kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9") pod "network-check-target-7x4wf" (UID: "88ca0e72-afe9-4265-b011-6f3765550b07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:16:53.905754 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.905736    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28n4q\" (UniqueName: \"kubernetes.io/projected/42005029-cee3-4b35-95c2-cfe92bdaa774-kube-api-access-28n4q\") pod \"multus-qbmnf\" (UID: \"42005029-cee3-4b35-95c2-cfe92bdaa774\") " pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.912541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.912518    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 03:11:52 +0000 UTC" deadline="2027-11-02 06:22:22.871426925 +0000 UTC"
May 28 03:16:53.912541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.912541    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12555h5m28.958889001s"
May 28 03:16:53.965381 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.965351    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-28gl6"
May 28 03:16:53.972141 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.972117    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:16:53.978684 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.978664    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbmnf"
May 28 03:16:53.984388 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.984371    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:16:53.989458 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.989438    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gnkmn"
May 28 03:16:53.996142 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:53.996125    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd"
May 28 03:16:54.002687 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.002669    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h2zvm"
May 28 03:16:54.009604 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.009578    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5k4fz"
May 28 03:16:54.016022 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.016003    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7vdkz"
May 28 03:16:54.125507 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.125475    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b447b66_ea57_463f_b96c_860f0778ffec.slice/crio-5ad3b1b402553fd16b5ad9b3ab790e23c6f5fac145714daf7c19482f15fa23c7 WatchSource:0}: Error finding container 5ad3b1b402553fd16b5ad9b3ab790e23c6f5fac145714daf7c19482f15fa23c7: Status 404 returned error can't find the container with id 5ad3b1b402553fd16b5ad9b3ab790e23c6f5fac145714daf7c19482f15fa23c7
May 28 03:16:54.126923 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.126822    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b60b80_1cc7_437f_910f_87f958f240fd.slice/crio-c6235edcfc2ff86bdb4acf93d583acf862bc6d1554b7765d82cd0d873bac2a28 WatchSource:0}: Error finding container c6235edcfc2ff86bdb4acf93d583acf862bc6d1554b7765d82cd0d873bac2a28: Status 404 returned error can't find the container with id c6235edcfc2ff86bdb4acf93d583acf862bc6d1554b7765d82cd0d873bac2a28
May 28 03:16:54.127621 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.127594    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42005029_cee3_4b35_95c2_cfe92bdaa774.slice/crio-b7197be8cebe26881907f0be68104e66426ec37454b13abfb513e86ffbfafa82 WatchSource:0}: Error finding container b7197be8cebe26881907f0be68104e66426ec37454b13abfb513e86ffbfafa82: Status 404 returned error can't find the container with id b7197be8cebe26881907f0be68104e66426ec37454b13abfb513e86ffbfafa82
May 28 03:16:54.130910 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.130891    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9306d75d_c142_4179_a7f5_4a85d5a21651.slice/crio-f4890280ec48c3f4320f6308a6fdf47d47688d46dd5abd12fe5c15637e9c3cc8 WatchSource:0}: Error finding container f4890280ec48c3f4320f6308a6fdf47d47688d46dd5abd12fe5c15637e9c3cc8: Status 404 returned error can't find the container with id f4890280ec48c3f4320f6308a6fdf47d47688d46dd5abd12fe5c15637e9c3cc8
May 28 03:16:54.132490 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.132473    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a80d64_1c89_4ccf_b555_01bd5a93a69a.slice/crio-8d5a391777f1de4ae67e22a151f687e633a2f05b208601d1528fdf61f2c96c89 WatchSource:0}: Error finding container 8d5a391777f1de4ae67e22a151f687e633a2f05b208601d1528fdf61f2c96c89: Status 404 returned error can't find the container with id 8d5a391777f1de4ae67e22a151f687e633a2f05b208601d1528fdf61f2c96c89
May 28 03:16:54.133427 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.133405    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e4e84a_ec78_4a99_bcb6_a0df39f4355e.slice/crio-55f65eb6e94af17f8b61156002d498ecd8f47573927a6830d02ee2d973cb80c1 WatchSource:0}: Error finding container 55f65eb6e94af17f8b61156002d498ecd8f47573927a6830d02ee2d973cb80c1: Status 404 returned error can't find the container with id 55f65eb6e94af17f8b61156002d498ecd8f47573927a6830d02ee2d973cb80c1
May 28 03:16:54.134547 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.134524    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33c77e1_ff1e_44d0_b195_4c6935500e52.slice/crio-329d036250badc5883e7e7565920076d9d0933fed32068dc7c0633de4f87a8b7 WatchSource:0}: Error finding container 329d036250badc5883e7e7565920076d9d0933fed32068dc7c0633de4f87a8b7: Status 404 returned error can't find the container with id 329d036250badc5883e7e7565920076d9d0933fed32068dc7c0633de4f87a8b7
May 28 03:16:54.135637 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.135616    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f3b5fb_111e_4ab5_a883_8abb2b7874f3.slice/crio-bb1a9995359f62fff9448be92299b805035f56c27d1cf1a15ba523f506f8b4d7 WatchSource:0}: Error finding container bb1a9995359f62fff9448be92299b805035f56c27d1cf1a15ba523f506f8b4d7: Status 404 returned error can't find the container with id bb1a9995359f62fff9448be92299b805035f56c27d1cf1a15ba523f506f8b4d7
May 28 03:16:54.137456 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:16:54.137386    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805b37cd_8d3c_461c_91af_031e41196836.slice/crio-20f3fb06f8b29f2baaa8ecaaf581e693cbb64d41b9dcddfe5c319ad9a999cfce WatchSource:0}: Error finding container 20f3fb06f8b29f2baaa8ecaaf581e693cbb64d41b9dcddfe5c319ad9a999cfce: Status 404 returned error can't find the container with id 20f3fb06f8b29f2baaa8ecaaf581e693cbb64d41b9dcddfe5c319ad9a999cfce
May 28 03:16:54.274990 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.274855    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:54.274990 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:54.274986    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:16:54.275146 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:54.275038    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:16:55.275025001 +0000 UTC m=+4.084040585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:16:54.475813 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.475777    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:54.475966 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:54.475925    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 03:16:54.475966 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:54.475942    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 03:16:54.475966 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:54.475954    2575 projected.go:194] Error preparing data for projected volume kube-api-access-g5hg9 for pod openshift-network-diagnostics/network-check-target-7x4wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:16:54.476132 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:54.476017    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9 podName:88ca0e72-afe9-4265-b011-6f3765550b07 nodeName:}" failed. No retries permitted until 2026-05-28 03:16:55.475999202 +0000 UTC m=+4.285014802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5hg9" (UniqueName: "kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9") pod "network-check-target-7x4wf" (UID: "88ca0e72-afe9-4265-b011-6f3765550b07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:16:54.757518 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.757412    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal" event={"ID":"da623cf4961b94d1fdb8d13cf889b129","Type":"ContainerStarted","Data":"3f1e838801ed20a2b20694dca5ec296d4a4028c812153a8452bbfa2a7924e402"}
May 28 03:16:54.763749 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.763690    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"bb1a9995359f62fff9448be92299b805035f56c27d1cf1a15ba523f506f8b4d7"}
May 28 03:16:54.773568 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.773543    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h2zvm" event={"ID":"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e","Type":"ContainerStarted","Data":"55f65eb6e94af17f8b61156002d498ecd8f47573927a6830d02ee2d973cb80c1"}
May 28 03:16:54.779956 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.779933    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7vdkz" event={"ID":"9306d75d-c142-4179-a7f5-4a85d5a21651","Type":"ContainerStarted","Data":"f4890280ec48c3f4320f6308a6fdf47d47688d46dd5abd12fe5c15637e9c3cc8"}
May 28 03:16:54.781941 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.781893    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbmnf" event={"ID":"42005029-cee3-4b35-95c2-cfe92bdaa774","Type":"ContainerStarted","Data":"b7197be8cebe26881907f0be68104e66426ec37454b13abfb513e86ffbfafa82"}
May 28 03:16:54.794374 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.794349    2575 generic.go:358] "Generic (PLEG): container finished" podID="8213c702d51259d488238456bba2c43c" containerID="7d0f704968f652a35fe75048d4e1dbfd1db214ffab0091c09e88e938928c277a" exitCode=0
May 28 03:16:54.794535 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.794435    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" event={"ID":"8213c702d51259d488238456bba2c43c","Type":"ContainerDied","Data":"7d0f704968f652a35fe75048d4e1dbfd1db214ffab0091c09e88e938928c277a"}
May 28 03:16:54.812117 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.812081    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerStarted","Data":"20f3fb06f8b29f2baaa8ecaaf581e693cbb64d41b9dcddfe5c319ad9a999cfce"}
May 28 03:16:54.826274 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.825644    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal" podStartSLOduration=1.8256260100000001 podStartE2EDuration="1.82562601s" podCreationTimestamp="2026-05-28 03:16:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:16:54.779496981 +0000 UTC m=+3.588512587" watchObservedRunningTime="2026-05-28 03:16:54.82562601 +0000 UTC m=+3.634641616"
May 28 03:16:54.827272 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.827235    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gnkmn" event={"ID":"a33c77e1-ff1e-44d0-b195-4c6935500e52","Type":"ContainerStarted","Data":"329d036250badc5883e7e7565920076d9d0933fed32068dc7c0633de4f87a8b7"}
May 28 03:16:54.835156 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.835093    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-28gl6" event={"ID":"86a80d64-1c89-4ccf-b555-01bd5a93a69a","Type":"ContainerStarted","Data":"8d5a391777f1de4ae67e22a151f687e633a2f05b208601d1528fdf61f2c96c89"}
May 28 03:16:54.845946 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.845914    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8d4x" event={"ID":"c4b60b80-1cc7-437f-910f-87f958f240fd","Type":"ContainerStarted","Data":"c6235edcfc2ff86bdb4acf93d583acf862bc6d1554b7765d82cd0d873bac2a28"}
May 28 03:16:54.853773 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.853680    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd" event={"ID":"4b447b66-ea57-463f-b96c-860f0778ffec","Type":"ContainerStarted","Data":"5ad3b1b402553fd16b5ad9b3ab790e23c6f5fac145714daf7c19482f15fa23c7"}
May 28 03:16:54.913000 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.912942    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 03:11:52 +0000 UTC" deadline="2028-01-28 01:49:27.553262125 +0000 UTC"
May 28 03:16:54.913000 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:54.912974    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14638h32m32.640291398s"
May 28 03:16:55.283575 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:55.283464    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:55.283724 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:55.283678    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:16:55.283778 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:55.283743    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:16:57.283724172 +0000 UTC m=+6.092739759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:16:55.485527 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:55.485492    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:55.485755 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:55.485689    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 03:16:55.485755 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:55.485711    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 03:16:55.485755 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:55.485724    2575 projected.go:194] Error preparing data for projected volume kube-api-access-g5hg9 for pod openshift-network-diagnostics/network-check-target-7x4wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:16:55.485914 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:55.485781    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9 podName:88ca0e72-afe9-4265-b011-6f3765550b07 nodeName:}" failed. No retries permitted until 2026-05-28 03:16:57.48576496 +0000 UTC m=+6.294780559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5hg9" (UniqueName: "kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9") pod "network-check-target-7x4wf" (UID: "88ca0e72-afe9-4265-b011-6f3765550b07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:16:55.745526 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:55.745450    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:55.745526 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:55.745472    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:55.745743 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:55.745597    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:16:55.746030 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:55.746004    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:16:55.870007 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:55.869972    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" event={"ID":"8213c702d51259d488238456bba2c43c","Type":"ContainerStarted","Data":"a2081b5a3aed9a6ba6560212ba1700aada0a04db79f6464c3862ab3b9d206519"}
May 28 03:16:57.302994 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:57.302956    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:57.303464 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:57.303127    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:16:57.303464 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:57.303195    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:01.30317642 +0000 UTC m=+10.112192008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:16:57.505455 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:57.504841    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:57.505455 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:57.505021    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 03:16:57.505455 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:57.505038    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 03:16:57.505455 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:57.505050    2575 projected.go:194] Error preparing data for projected volume kube-api-access-g5hg9 for pod openshift-network-diagnostics/network-check-target-7x4wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:16:57.505455 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:57.505105    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9 podName:88ca0e72-afe9-4265-b011-6f3765550b07 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:01.505087274 +0000 UTC m=+10.314102862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5hg9" (UniqueName: "kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9") pod "network-check-target-7x4wf" (UID: "88ca0e72-afe9-4265-b011-6f3765550b07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:16:57.746084 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:57.746012    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:57.746227 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:57.746140    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:16:57.746227 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:57.746197    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:57.746363 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:57.746345    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:16:59.745086 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:59.744616    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:16:59.745086 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:16:59.744650    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:16:59.745086 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:59.744795    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:16:59.745086 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:16:59.744890    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:01.337754 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:01.337678    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:01.338208 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:01.337810    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:17:01.338208 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:01.337876    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:09.33785923 +0000 UTC m=+18.146874824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:17:01.539762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:01.539669    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:01.539911 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:01.539897    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 03:17:01.539978 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:01.539923    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 03:17:01.539978 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:01.539936    2575 projected.go:194] Error preparing data for projected volume kube-api-access-g5hg9 for pod openshift-network-diagnostics/network-check-target-7x4wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:17:01.540046 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:01.539996    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9 podName:88ca0e72-afe9-4265-b011-6f3765550b07 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:09.53997709 +0000 UTC m=+18.348992677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5hg9" (UniqueName: "kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9") pod "network-check-target-7x4wf" (UID: "88ca0e72-afe9-4265-b011-6f3765550b07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:17:01.745890 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:01.745822    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:01.746032 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:01.745936    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:01.746032 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:01.745994    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:01.746144 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:01.746092    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:03.744657 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:03.744629    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:03.744998 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:03.744639    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:03.744998 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:03.744717    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:03.744998 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:03.744827    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:05.744674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:05.744618    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:05.745112 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:05.744751    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:05.745112 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:05.744828    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:05.745112 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:05.744925    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:07.744527 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:07.744494    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:07.745024 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:07.744494    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:07.745024 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:07.744621    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:07.745024 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:07.744692    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:09.401634 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:09.401596    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:09.402116 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:09.401731    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:17:09.402116 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:09.401807    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:25.401786104 +0000 UTC m=+34.210801688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:17:09.603810 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:09.603777    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:09.603987 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:09.603956    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 03:17:09.603987 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:09.603975    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 03:17:09.603987 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:09.603986    2575 projected.go:194] Error preparing data for projected volume kube-api-access-g5hg9 for pod openshift-network-diagnostics/network-check-target-7x4wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:17:09.604104 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:09.604052    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9 podName:88ca0e72-afe9-4265-b011-6f3765550b07 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:25.604032921 +0000 UTC m=+34.413048507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5hg9" (UniqueName: "kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9") pod "network-check-target-7x4wf" (UID: "88ca0e72-afe9-4265-b011-6f3765550b07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:17:09.745068 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:09.744997    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:09.745217 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:09.745103    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:09.745217 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:09.745146    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:09.745355 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:09.745239    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:11.746109 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.746082    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:11.746449 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:11.746207    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:11.746449 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.746270    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:11.746449 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:11.746370    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:11.895707 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.895473    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerStarted","Data":"953a08cea36fa5e85ab42ec86926fb7195cae938772999f62aa87a74aabb601a"}
May 28 03:17:11.898592 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.898566    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gnkmn" event={"ID":"a33c77e1-ff1e-44d0-b195-4c6935500e52","Type":"ContainerStarted","Data":"631e38d1de5d9b883eadf81d8c8f0c04abe906e7dbc1b4424adfb89fb8caecfd"}
May 28 03:17:11.899797 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.899775    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8d4x" event={"ID":"c4b60b80-1cc7-437f-910f-87f958f240fd","Type":"ContainerStarted","Data":"6a0a5a14d653d799a38dc634db8c63b02e405afae0e7de200a38124331e00bff"}
May 28 03:17:11.900964 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.900946    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd" event={"ID":"4b447b66-ea57-463f-b96c-860f0778ffec","Type":"ContainerStarted","Data":"1f3a4557a4b2f61dc2ed7853eb47f9d43e9e372149678dce7dfd2fbe253f6190"}
May 28 03:17:11.950742 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.950675    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" podStartSLOduration=18.950658496 podStartE2EDuration="18.950658496s" podCreationTimestamp="2026-05-28 03:16:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:16:55.894381839 +0000 UTC m=+4.703397445" watchObservedRunningTime="2026-05-28 03:17:11.950658496 +0000 UTC m=+20.759674103"
May 28 03:17:11.969662 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.969600    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x8d4x" podStartSLOduration=3.445958086 podStartE2EDuration="20.969582375s" podCreationTimestamp="2026-05-28 03:16:51 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.128405127 +0000 UTC m=+2.937420724" lastFinishedPulling="2026-05-28 03:17:11.65202942 +0000 UTC m=+20.461045013" observedRunningTime="2026-05-28 03:17:11.969031772 +0000 UTC m=+20.778047377" watchObservedRunningTime="2026-05-28 03:17:11.969582375 +0000 UTC m=+20.778597977"
May 28 03:17:11.999888 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:11.999715    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gnkmn" podStartSLOduration=10.200085706 podStartE2EDuration="19.999695379s" podCreationTimestamp="2026-05-28 03:16:52 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.137089813 +0000 UTC m=+2.946105412" lastFinishedPulling="2026-05-28 03:17:03.936699485 +0000 UTC m=+12.745715085" observedRunningTime="2026-05-28 03:17:11.999498641 +0000 UTC m=+20.808514252" watchObservedRunningTime="2026-05-28 03:17:11.999695379 +0000 UTC m=+20.808710985"
May 28 03:17:12.904602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.904426    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"46d9c356c25443ba0ae05fcbd2ad63fc30e5ec23f309c01a25604317c4f03286"}
May 28 03:17:12.905136 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.904608    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"74fff35e07cdd03c9a6fc13bf1e1f54eca5e6ac468552ebb2462fac13f6c90a6"}
May 28 03:17:12.905136 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.904628    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"edec42accb14968ca360e6f03f87b19767ef7e13b2b208d5a92e2ecc7abb77e7"}
May 28 03:17:12.905136 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.904640    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"ee67565e2be73806f13f6e5c77c932ea3cc69cb65fef899804464f3339efba62"}
May 28 03:17:12.905136 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.904653    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"43f7c1767e237d77233a7f27d901320e2e7bf1c4c31cf6b93a658b40c1f00f5f"}
May 28 03:17:12.905136 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.904664    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"3a85039e5409826e1ded9aeeb2058d152c4b2fe24a1202fdc60c18ed354d3f50"}
May 28 03:17:12.905624 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.905600    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h2zvm" event={"ID":"b2e4e84a-ec78-4a99-bcb6-a0df39f4355e","Type":"ContainerStarted","Data":"d4728f05140335d4f31cab82d192d69a1861986fb3e7fbccfac7aff6c56e61ea"}
May 28 03:17:12.906674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.906656    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7vdkz" event={"ID":"9306d75d-c142-4179-a7f5-4a85d5a21651","Type":"ContainerStarted","Data":"4c49216078f8deba8df2cab8c22344389ca964d955388b48287865af3bfdc63c"}
May 28 03:17:12.907795 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.907775    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbmnf" event={"ID":"42005029-cee3-4b35-95c2-cfe92bdaa774","Type":"ContainerStarted","Data":"47a344d6b263244684cdcd674b7a099a76f123f2d8654e7851b1600445f225e1"}
May 28 03:17:12.908822 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.908800    2575 generic.go:358] "Generic (PLEG): container finished" podID="805b37cd-8d3c-461c-91af-031e41196836" containerID="953a08cea36fa5e85ab42ec86926fb7195cae938772999f62aa87a74aabb601a" exitCode=0
May 28 03:17:12.908903 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.908864    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerDied","Data":"953a08cea36fa5e85ab42ec86926fb7195cae938772999f62aa87a74aabb601a"}
May 28 03:17:12.909993 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.909972    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-28gl6" event={"ID":"86a80d64-1c89-4ccf-b555-01bd5a93a69a","Type":"ContainerStarted","Data":"bc3c80191eec6b55a1da9910dd7b389aa61c88ee43335f9e8bd0ea3bfa76872c"}
May 28 03:17:12.930195 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.930159    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h2zvm" podStartSLOduration=3.41215738 podStartE2EDuration="20.930147899s" podCreationTimestamp="2026-05-28 03:16:52 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.135159056 +0000 UTC m=+2.944174648" lastFinishedPulling="2026-05-28 03:17:11.653149577 +0000 UTC m=+20.462165167" observedRunningTime="2026-05-28 03:17:12.929946303 +0000 UTC m=+21.738961909" watchObservedRunningTime="2026-05-28 03:17:12.930147899 +0000 UTC m=+21.739163503"
May 28 03:17:12.970312 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:12.970278    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-7vdkz" podStartSLOduration=3.450678695 podStartE2EDuration="20.970267212s" podCreationTimestamp="2026-05-28 03:16:52 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.132465939 +0000 UTC m=+2.941481527" lastFinishedPulling="2026-05-28 03:17:11.652054442 +0000 UTC m=+20.461070044" observedRunningTime="2026-05-28 03:17:12.969642031 +0000 UTC m=+21.778657638" watchObservedRunningTime="2026-05-28 03:17:12.970267212 +0000 UTC m=+21.779282813"
May 28 03:17:13.060314 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.060272    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qbmnf" podStartSLOduration=4.222083645 podStartE2EDuration="22.060259318s" podCreationTimestamp="2026-05-28 03:16:51 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.130024821 +0000 UTC m=+2.939040420" lastFinishedPulling="2026-05-28 03:17:11.968200507 +0000 UTC m=+20.777216093" observedRunningTime="2026-05-28 03:17:13.05998035 +0000 UTC m=+21.868995967" watchObservedRunningTime="2026-05-28 03:17:13.060259318 +0000 UTC m=+21.869274921"
May 28 03:17:13.060405 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.060385    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-28gl6" podStartSLOduration=4.54239189 podStartE2EDuration="22.06038104s" podCreationTimestamp="2026-05-28 03:16:51 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.134362381 +0000 UTC m=+2.943377965" lastFinishedPulling="2026-05-28 03:17:11.652351521 +0000 UTC m=+20.461367115" observedRunningTime="2026-05-28 03:17:13.005674229 +0000 UTC m=+21.814689833" watchObservedRunningTime="2026-05-28 03:17:13.06038104 +0000 UTC m=+21.869396644"
May 28 03:17:13.066165 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.066144    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 03:17:13.727936 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.727824    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T03:17:13.066161354Z","UUID":"e2ee12bd-7228-4c65-b6e5-5189fde84352","Handler":null,"Name":"","Endpoint":""}
May 28 03:17:13.729546 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.729528    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 03:17:13.729546 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.729552    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 03:17:13.745272 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.745223    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:13.745395 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.745239    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:13.745395 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:13.745360    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:13.745504 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:13.745444    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:13.913352 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:13.913307    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd" event={"ID":"4b447b66-ea57-463f-b96c-860f0778ffec","Type":"ContainerStarted","Data":"37f25fff4a90341715a9458e12e47fd388494e57103d7fb08c1039cb63c42628"}
May 28 03:17:14.918290 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:14.918236    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"9378593a0e3f770fb0d024440907a294626ce931388656fca1c7691f7d3ed6ba"}
May 28 03:17:14.920099 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:14.920069    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd" event={"ID":"4b447b66-ea57-463f-b96c-860f0778ffec","Type":"ContainerStarted","Data":"bd5bf401b6339b3067ea28a89257303228c94dd332fb861b2092f3b88f35602b"}
May 28 03:17:15.349613 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:15.349531    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:17:15.350040 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:15.350017    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:17:15.383014 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:15.382971    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd8kd" podStartSLOduration=3.42178861 podStartE2EDuration="23.382955676s" podCreationTimestamp="2026-05-28 03:16:52 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.127605205 +0000 UTC m=+2.936620788" lastFinishedPulling="2026-05-28 03:17:14.088772268 +0000 UTC m=+22.897787854" observedRunningTime="2026-05-28 03:17:14.946540905 +0000 UTC m=+23.755556509" watchObservedRunningTime="2026-05-28 03:17:15.382955676 +0000 UTC m=+24.191971281"
May 28 03:17:15.745399 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:15.745142    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:15.745569 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:15.745179    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:15.745569 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:15.745503    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:15.745569 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:15.745533    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:15.922191 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:15.922158    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:17:15.922632 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:15.922456    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x8d4x"
May 28 03:17:17.747484 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:17.747465    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:17.748052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:17.747465    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:17.748052 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:17.747553    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:17.748052 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:17.747614    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:17.930397 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:17.930367    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" event={"ID":"a0f3b5fb-111e-4ab5-a883-8abb2b7874f3","Type":"ContainerStarted","Data":"61ece92cd02209c2bb061ae2b8bb867db948503fa980cc41744245b6c66c6875"}
May 28 03:17:17.930522 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:17.930502    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:17:17.930577 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:17.930537    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:17:17.930577 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:17.930551    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:17:17.949087 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:17.949057    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:17:17.949737 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:17.949470    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:17:18.068215 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:18.068029    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-967gw" podStartSLOduration=8.516057605 podStartE2EDuration="26.067995902s" podCreationTimestamp="2026-05-28 03:16:52 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.138054707 +0000 UTC m=+2.947070305" lastFinishedPulling="2026-05-28 03:17:11.689993002 +0000 UTC m=+20.499008602" observedRunningTime="2026-05-28 03:17:18.019263488 +0000 UTC m=+26.828279083" watchObservedRunningTime="2026-05-28 03:17:18.067995902 +0000 UTC m=+26.877011515"
May 28 03:17:18.935848 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:18.935809    2575 generic.go:358] "Generic (PLEG): container finished" podID="805b37cd-8d3c-461c-91af-031e41196836" containerID="0c4fed6292cb91231836e23cc4df4999724f442d0becea3198bd52d21da0fd93" exitCode=0
May 28 03:17:18.937592 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:18.937551    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerDied","Data":"0c4fed6292cb91231836e23cc4df4999724f442d0becea3198bd52d21da0fd93"}
May 28 03:17:19.660906 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:19.660876    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrh6v"]
May 28 03:17:19.661062 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:19.661002    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:19.661110 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:19.661089    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:19.667626 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:19.667601    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7x4wf"]
May 28 03:17:19.667757 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:19.667710    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:19.667831 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:19.667801    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:20.940762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:20.940728    2575 generic.go:358] "Generic (PLEG): container finished" podID="805b37cd-8d3c-461c-91af-031e41196836" containerID="21ab2c4369f05e67d95c240a271becc4ddcb0368ea1597d97797ecf948c36fa0" exitCode=0
May 28 03:17:20.941062 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:20.940776    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerDied","Data":"21ab2c4369f05e67d95c240a271becc4ddcb0368ea1597d97797ecf948c36fa0"}
May 28 03:17:21.747790 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:21.747760    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:21.747939 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:21.747771    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:21.747939 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:21.747839    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:21.748013 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:21.747959    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:22.946588 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:22.946409    2575 generic.go:358] "Generic (PLEG): container finished" podID="805b37cd-8d3c-461c-91af-031e41196836" containerID="8b7fbf184e7bad250aa9a5aa06f8d6893e624f5358f29d991a53b8876fcbce0f" exitCode=0
May 28 03:17:22.946588 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:22.946491    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerDied","Data":"8b7fbf184e7bad250aa9a5aa06f8d6893e624f5358f29d991a53b8876fcbce0f"}
May 28 03:17:23.745309 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:23.745281    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:23.745466 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:23.745396    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x4wf" podUID="88ca0e72-afe9-4265-b011-6f3765550b07"
May 28 03:17:23.745529 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:23.745480    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:23.745616 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:23.745596    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:17:24.534021 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.533995    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeReady"
May 28 03:17:24.534444 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.534109    2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 03:17:24.668126 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.668085    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nn7gp"]
May 28 03:17:24.680084 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.680060    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.690725 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.690705    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zcw8f"]
May 28 03:17:24.704100 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.704081    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 03:17:24.704323 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.704305    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krlmb\""
May 28 03:17:24.705448 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.705430    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nn7gp"]
May 28 03:17:24.705560 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.705537    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:24.706618 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.706494    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 03:17:24.725414 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.725397    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 03:17:24.725502 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.725466    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 03:17:24.725586 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.725574    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vsmkp\""
May 28 03:17:24.725814 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.725801    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 03:17:24.734622 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.734595    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcw8f"]
May 28 03:17:24.809259 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.809222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq2x6\" (UniqueName: \"kubernetes.io/projected/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-kube-api-access-jq2x6\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:24.809395 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.809266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.809395 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.809291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gw7\" (UniqueName: \"kubernetes.io/projected/042509a8-7606-4966-b8cd-f7c1385d7133-kube-api-access-29gw7\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.809395 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.809359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/042509a8-7606-4966-b8cd-f7c1385d7133-config-volume\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.809532 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.809393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:24.809532 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.809462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042509a8-7606-4966-b8cd-f7c1385d7133-tmp-dir\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.910478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.910455    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/042509a8-7606-4966-b8cd-f7c1385d7133-config-volume\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.910644 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.910483    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:24.910644 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.910527    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042509a8-7606-4966-b8cd-f7c1385d7133-tmp-dir\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.910644 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:24.910609    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 03:17:24.910644 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.910637    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq2x6\" (UniqueName: \"kubernetes.io/projected/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-kube-api-access-jq2x6\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:24.910844 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:24.910680    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert podName:f68961e5-5c22-4c5f-8c04-de41cd10e8e1 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:25.410660098 +0000 UTC m=+34.219675681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert") pod "ingress-canary-zcw8f" (UID: "f68961e5-5c22-4c5f-8c04-de41cd10e8e1") : secret "canary-serving-cert" not found
May 28 03:17:24.910844 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.910699    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.910844 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.910733    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29gw7\" (UniqueName: \"kubernetes.io/projected/042509a8-7606-4966-b8cd-f7c1385d7133-kube-api-access-29gw7\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.910844 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.910769    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042509a8-7606-4966-b8cd-f7c1385d7133-tmp-dir\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.911049 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:24.910844    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 03:17:24.911049 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:24.910883    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls podName:042509a8-7606-4966-b8cd-f7c1385d7133 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:25.410871454 +0000 UTC m=+34.219887042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls") pod "dns-default-nn7gp" (UID: "042509a8-7606-4966-b8cd-f7c1385d7133") : secret "dns-default-metrics-tls" not found
May 28 03:17:24.911049 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.911030    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/042509a8-7606-4966-b8cd-f7c1385d7133-config-volume\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.929076 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.929025    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gw7\" (UniqueName: \"kubernetes.io/projected/042509a8-7606-4966-b8cd-f7c1385d7133-kube-api-access-29gw7\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:24.929201 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:24.929096    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq2x6\" (UniqueName: \"kubernetes.io/projected/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-kube-api-access-jq2x6\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:25.414507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.414432    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:25.414507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.414479    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:25.414744 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.414562    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 03:17:25.414744 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.414567    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 03:17:25.414744 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.414612    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert podName:f68961e5-5c22-4c5f-8c04-de41cd10e8e1 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:26.414598958 +0000 UTC m=+35.223614541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert") pod "ingress-canary-zcw8f" (UID: "f68961e5-5c22-4c5f-8c04-de41cd10e8e1") : secret "canary-serving-cert" not found
May 28 03:17:25.414744 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.414629    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:25.414744 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.414652    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls podName:042509a8-7606-4966-b8cd-f7c1385d7133 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:26.414638943 +0000 UTC m=+35.223654531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls") pod "dns-default-nn7gp" (UID: "042509a8-7606-4966-b8cd-f7c1385d7133") : secret "dns-default-metrics-tls" not found
May 28 03:17:25.414744 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.414699    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:17:25.414744 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.414724    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:57.414717786 +0000 UTC m=+66.223733370 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 03:17:25.617191 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.617152    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:25.617890 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.617329    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 03:17:25.617890 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.617356    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 03:17:25.617890 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.617369    2575 projected.go:194] Error preparing data for projected volume kube-api-access-g5hg9 for pod openshift-network-diagnostics/network-check-target-7x4wf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:17:25.617890 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:25.617441    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9 podName:88ca0e72-afe9-4265-b011-6f3765550b07 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:57.617421403 +0000 UTC m=+66.426436990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g5hg9" (UniqueName: "kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9") pod "network-check-target-7x4wf" (UID: "88ca0e72-afe9-4265-b011-6f3765550b07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 03:17:25.747182 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.747155    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:25.747349 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.747163    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:25.752396 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.752375    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 03:17:25.752576 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.752559    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pw92t\""
May 28 03:17:25.752643 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.752630    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 03:17:25.753756 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.753741    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 03:17:25.753863 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:25.753848    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzb4w\""
May 28 03:17:26.422366 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:26.422332    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:26.422559 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:26.422378    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:26.422559 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:26.422490    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 03:17:26.422559 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:26.422496    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 03:17:26.422559 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:26.422544    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert podName:f68961e5-5c22-4c5f-8c04-de41cd10e8e1 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:28.422528495 +0000 UTC m=+37.231544100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert") pod "ingress-canary-zcw8f" (UID: "f68961e5-5c22-4c5f-8c04-de41cd10e8e1") : secret "canary-serving-cert" not found
May 28 03:17:26.422559 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:26.422557    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls podName:042509a8-7606-4966-b8cd-f7c1385d7133 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:28.422551121 +0000 UTC m=+37.231566704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls") pod "dns-default-nn7gp" (UID: "042509a8-7606-4966-b8cd-f7c1385d7133") : secret "dns-default-metrics-tls" not found
May 28 03:17:28.435235 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:28.435203    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:28.435832 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:28.435272    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:28.435832 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:28.435392    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 03:17:28.435832 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:28.435472    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls podName:042509a8-7606-4966-b8cd-f7c1385d7133 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:32.435450873 +0000 UTC m=+41.244466473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls") pod "dns-default-nn7gp" (UID: "042509a8-7606-4966-b8cd-f7c1385d7133") : secret "dns-default-metrics-tls" not found
May 28 03:17:28.435832 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:28.435398    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 03:17:28.435832 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:28.435544    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert podName:f68961e5-5c22-4c5f-8c04-de41cd10e8e1 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:32.435529 +0000 UTC m=+41.244544598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert") pod "ingress-canary-zcw8f" (UID: "f68961e5-5c22-4c5f-8c04-de41cd10e8e1") : secret "canary-serving-cert" not found
May 28 03:17:29.963453 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:29.963420    2575 generic.go:358] "Generic (PLEG): container finished" podID="805b37cd-8d3c-461c-91af-031e41196836" containerID="74528d7d3affcbc6436acfe4e572f8444ac78d6c36b702681b5b4cd3f644c6ab" exitCode=0
May 28 03:17:29.963747 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:29.963469    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerDied","Data":"74528d7d3affcbc6436acfe4e572f8444ac78d6c36b702681b5b4cd3f644c6ab"}
May 28 03:17:30.967048 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:30.967016    2575 generic.go:358] "Generic (PLEG): container finished" podID="805b37cd-8d3c-461c-91af-031e41196836" containerID="8070c4e1a882944b142e9f82fdf9c8ee2fd0f45814de2296869a09751cea5720" exitCode=0
May 28 03:17:30.967506 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:30.967072    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerDied","Data":"8070c4e1a882944b142e9f82fdf9c8ee2fd0f45814de2296869a09751cea5720"}
May 28 03:17:31.971416 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:31.971381    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" event={"ID":"805b37cd-8d3c-461c-91af-031e41196836","Type":"ContainerStarted","Data":"36729e800f7022213399c06c8c4829b42026fc89a0a0bb87cf797a60656622bb"}
May 28 03:17:32.014671 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:32.014600    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5k4fz" podStartSLOduration=4.512215101 podStartE2EDuration="40.014584781s" podCreationTimestamp="2026-05-28 03:16:52 +0000 UTC" firstStartedPulling="2026-05-28 03:16:54.142467197 +0000 UTC m=+2.951482794" lastFinishedPulling="2026-05-28 03:17:29.644836887 +0000 UTC m=+38.453852474" observedRunningTime="2026-05-28 03:17:32.014383605 +0000 UTC m=+40.823399209" watchObservedRunningTime="2026-05-28 03:17:32.014584781 +0000 UTC m=+40.823600388"
May 28 03:17:32.462534 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:32.462502    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:32.462708 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:32.462549    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:32.462708 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:32.462629    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 03:17:32.462708 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:32.462654    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 03:17:32.462708 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:32.462679    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert podName:f68961e5-5c22-4c5f-8c04-de41cd10e8e1 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:40.46266499 +0000 UTC m=+49.271680573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert") pod "ingress-canary-zcw8f" (UID: "f68961e5-5c22-4c5f-8c04-de41cd10e8e1") : secret "canary-serving-cert" not found
May 28 03:17:32.462859 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:32.462711    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls podName:042509a8-7606-4966-b8cd-f7c1385d7133 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:40.462694621 +0000 UTC m=+49.271710218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls") pod "dns-default-nn7gp" (UID: "042509a8-7606-4966-b8cd-f7c1385d7133") : secret "dns-default-metrics-tls" not found
May 28 03:17:40.521775 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:40.521736    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:40.522190 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:40.521794    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:40.522190 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:40.521864    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 03:17:40.522190 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:40.521882    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 03:17:40.522190 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:40.521923    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert podName:f68961e5-5c22-4c5f-8c04-de41cd10e8e1 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:56.521908513 +0000 UTC m=+65.330924096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert") pod "ingress-canary-zcw8f" (UID: "f68961e5-5c22-4c5f-8c04-de41cd10e8e1") : secret "canary-serving-cert" not found
May 28 03:17:40.522190 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:40.521937    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls podName:042509a8-7606-4966-b8cd-f7c1385d7133 nodeName:}" failed. No retries permitted until 2026-05-28 03:17:56.52193133 +0000 UTC m=+65.330946913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls") pod "dns-default-nn7gp" (UID: "042509a8-7606-4966-b8cd-f7c1385d7133") : secret "dns-default-metrics-tls" not found
May 28 03:17:49.960784 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:49.960756    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-967gw"
May 28 03:17:56.524554 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:56.524500    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:17:56.524949 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:56.524576    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:17:56.524949 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:56.524659    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 03:17:56.524949 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:56.524660    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 03:17:56.524949 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:56.524720    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert podName:f68961e5-5c22-4c5f-8c04-de41cd10e8e1 nodeName:}" failed. No retries permitted until 2026-05-28 03:18:28.52470659 +0000 UTC m=+97.333722174 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert") pod "ingress-canary-zcw8f" (UID: "f68961e5-5c22-4c5f-8c04-de41cd10e8e1") : secret "canary-serving-cert" not found
May 28 03:17:56.524949 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:56.524734    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls podName:042509a8-7606-4966-b8cd-f7c1385d7133 nodeName:}" failed. No retries permitted until 2026-05-28 03:18:28.52472681 +0000 UTC m=+97.333742392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls") pod "dns-default-nn7gp" (UID: "042509a8-7606-4966-b8cd-f7c1385d7133") : secret "dns-default-metrics-tls" not found
May 28 03:17:57.431854 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:57.431811    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:17:57.434930 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:57.434916    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 03:17:57.442478 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:57.442464    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 03:17:57.442519 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:17:57.442509    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:01.442495842 +0000 UTC m=+130.251511425 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : secret "metrics-daemon-secret" not found
May 28 03:17:57.633853 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:57.633817    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:57.637301 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:57.637285    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 03:17:57.646941 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:57.646925    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 03:17:57.657063 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:57.657032    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5hg9\" (UniqueName: \"kubernetes.io/projected/88ca0e72-afe9-4265-b011-6f3765550b07-kube-api-access-g5hg9\") pod \"network-check-target-7x4wf\" (UID: \"88ca0e72-afe9-4265-b011-6f3765550b07\") " pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:57.859769 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:57.859705    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pw92t\""
May 28 03:17:57.867353 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:57.867337    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:17:58.004320 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:58.004292    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7x4wf"]
May 28 03:17:58.007766 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:17:58.007739    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ca0e72_afe9_4265_b011_6f3765550b07.slice/crio-50b4f5be9a88664821e5ce6994fc3a15684946ee4e1996a4013c5fb7002a507f WatchSource:0}: Error finding container 50b4f5be9a88664821e5ce6994fc3a15684946ee4e1996a4013c5fb7002a507f: Status 404 returned error can't find the container with id 50b4f5be9a88664821e5ce6994fc3a15684946ee4e1996a4013c5fb7002a507f
May 28 03:17:58.015778 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:17:58.015758    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7x4wf" event={"ID":"88ca0e72-afe9-4265-b011-6f3765550b07","Type":"ContainerStarted","Data":"50b4f5be9a88664821e5ce6994fc3a15684946ee4e1996a4013c5fb7002a507f"}
May 28 03:18:01.023041 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:18:01.023014    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7x4wf" event={"ID":"88ca0e72-afe9-4265-b011-6f3765550b07","Type":"ContainerStarted","Data":"3c6cef66e21f610d21a0623e6be426b3c71b9aebf848cd03af93c5e1de4c6449"}
May 28 03:18:01.023405 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:18:01.023147    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:18:01.040442 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:18:01.040300    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7x4wf" podStartSLOduration=66.589324926 podStartE2EDuration="1m9.040286817s" podCreationTimestamp="2026-05-28 03:16:52 +0000 UTC" firstStartedPulling="2026-05-28 03:17:58.009477339 +0000 UTC m=+66.818492926" lastFinishedPulling="2026-05-28 03:18:00.460439234 +0000 UTC m=+69.269454817" observedRunningTime="2026-05-28 03:18:01.04001918 +0000 UTC m=+69.849034785" watchObservedRunningTime="2026-05-28 03:18:01.040286817 +0000 UTC m=+69.849302421"
May 28 03:18:28.538429 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:18:28.538393    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:18:28.538939 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:18:28.538448    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:18:28.538939 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:18:28.538532    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 03:18:28.538939 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:18:28.538567    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 03:18:28.538939 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:18:28.538591    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls podName:042509a8-7606-4966-b8cd-f7c1385d7133 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:32.538576592 +0000 UTC m=+161.347592175 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls") pod "dns-default-nn7gp" (UID: "042509a8-7606-4966-b8cd-f7c1385d7133") : secret "dns-default-metrics-tls" not found
May 28 03:18:28.538939 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:18:28.538624    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert podName:f68961e5-5c22-4c5f-8c04-de41cd10e8e1 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:32.538609581 +0000 UTC m=+161.347625165 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert") pod "ingress-canary-zcw8f" (UID: "f68961e5-5c22-4c5f-8c04-de41cd10e8e1") : secret "canary-serving-cert" not found
May 28 03:18:32.026983 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:18:32.026952    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7x4wf"
May 28 03:19:01.444807 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:01.444761    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:19:01.445302 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:01.444910    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 03:19:01.445302 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:01.444980    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs podName:ce717d11-92f8-498b-a97e-2112e10126e4 nodeName:}" failed. No retries permitted until 2026-05-28 03:21:03.444965564 +0000 UTC m=+252.253981148 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs") pod "network-metrics-daemon-zrh6v" (UID: "ce717d11-92f8-498b-a97e-2112e10126e4") : secret "metrics-daemon-secret" not found
May 28 03:19:10.396030 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.395996    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d"]
May 28 03:19:10.397798 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.397780    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d"
May 28 03:19:10.400582 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.400559    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 28 03:19:10.401770 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.401756    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x7jx8\""
May 28 03:19:10.402086 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.402061    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 28 03:19:10.407398 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.407377    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d"]
May 28 03:19:10.501844 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.501813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf7p2\" (UniqueName: \"kubernetes.io/projected/23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49-kube-api-access-jf7p2\") pod \"volume-data-source-validator-5cf8c89d64-s769d\" (UID: \"23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d"
May 28 03:19:10.520467 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.520443    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7hpnb"]
May 28 03:19:10.522121 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.522105    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"]
May 28 03:19:10.522287 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.522269    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.523998 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.523982    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d5f966876-bmt5s"]
May 28 03:19:10.524141 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.524125    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.525771 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.525754    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.527233 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.527216    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 03:19:10.527340 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.527270    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 03:19:10.528658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.528644    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cxn2b\""
May 28 03:19:10.528768 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.528703    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 28 03:19:10.529560 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.529544    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 03:19:10.532504 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.532488    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 28 03:19:10.532904 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.532889    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 28 03:19:10.533148 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.533129    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 03:19:10.533275 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.533185    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c4kbx\""
May 28 03:19:10.536053 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.536026    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 28 03:19:10.536221 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.536202    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 28 03:19:10.536325 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.536314    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 28 03:19:10.536519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.536449    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 28 03:19:10.536519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.536457    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 28 03:19:10.536644 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.536543    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vzthf\""
May 28 03:19:10.536741 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.536727    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 03:19:10.536953 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.536941    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 03:19:10.541821 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.541729    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7hpnb"]
May 28 03:19:10.544323 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.544304    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 28 03:19:10.555084 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.555066    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"]
May 28 03:19:10.560373 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.560354    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d5f966876-bmt5s"]
May 28 03:19:10.602590 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-snapshots\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.602686 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.602686 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-tmp\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.602686 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.602788 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602691    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jf7p2\" (UniqueName: \"kubernetes.io/projected/23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49-kube-api-access-jf7p2\") pod \"volume-data-source-validator-5cf8c89d64-s769d\" (UID: \"23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d"
May 28 03:19:10.602788 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.602788 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-serving-cert\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.602788 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-stats-auth\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.603036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.603036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-default-certificate\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.603036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.603036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks5fk\" (UniqueName: \"kubernetes.io/projected/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-kube-api-access-ks5fk\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.603036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdkc4\" (UniqueName: \"kubernetes.io/projected/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-kube-api-access-wdkc4\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.603036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.602977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwwn4\" (UniqueName: \"kubernetes.io/projected/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-kube-api-access-fwwn4\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.603036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.603027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.612775 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.612757    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf7p2\" (UniqueName: \"kubernetes.io/projected/23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49-kube-api-access-jf7p2\") pod \"volume-data-source-validator-5cf8c89d64-s769d\" (UID: \"23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d"
May 28 03:19:10.614983 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.614963    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"]
May 28 03:19:10.616757 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.616741    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.619492 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.619476    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 28 03:19:10.619863 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.619846    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 28 03:19:10.620097 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.620078    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qnhrw\""
May 28 03:19:10.620181 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.620166    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 28 03:19:10.620230 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.620167    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 28 03:19:10.627547 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.627528    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"]
May 28 03:19:10.703521 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703495    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.703655 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703535    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-snapshots\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.703655 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703557    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.703655 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhqfm\" (UniqueName: \"kubernetes.io/projected/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-kube-api-access-dhqfm\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.703655 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703626    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-tmp\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.703862 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703655    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.703862 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:10.703664    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 03:19:10.703862 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703684    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.703862 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:10.703728    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:11.203711759 +0000 UTC m=+140.012727343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : secret "router-metrics-certs-default" not found
May 28 03:19:10.703862 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:10.703773    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 03:19:10.703862 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-config\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.703862 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:10.703829    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls podName:2c8c4829-9d2a-49d1-8911-35d7eaa9f31f nodeName:}" failed. No retries permitted until 2026-05-28 03:19:11.203811988 +0000 UTC m=+140.012827577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-trb59" (UID: "2c8c4829-9d2a-49d1-8911-35d7eaa9f31f") : secret "cluster-monitoring-operator-tls" not found
May 28 03:19:10.703862 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703848    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-serving-cert\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:10.703864    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:11.203847789 +0000 UTC m=+140.012863394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : configmap references non-existent config key: service-ca.crt
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703935    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-stats-auth\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.703987    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704015    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-default-certificate\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704038    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704059    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ks5fk\" (UniqueName: \"kubernetes.io/projected/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-kube-api-access-ks5fk\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704083    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704102    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-tmp\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704116    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdkc4\" (UniqueName: \"kubernetes.io/projected/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-kube-api-access-wdkc4\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704144    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwwn4\" (UniqueName: \"kubernetes.io/projected/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-kube-api-access-fwwn4\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.704336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704179    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-snapshots\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.704928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704781    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.704928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.704804    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.706314 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.706295    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-stats-auth\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.706418 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.706399    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-serving-cert\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.706485 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.706472    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-default-certificate\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.707208 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.707190    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d"
May 28 03:19:10.742909 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.742881    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"]
May 28 03:19:10.745516 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.745499    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.749098 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.749005    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 28 03:19:10.749389 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.749359    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 28 03:19:10.749521 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.749465    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fhlbw\""
May 28 03:19:10.749748 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.749684    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 28 03:19:10.749988 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.749917    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 28 03:19:10.752972 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.752403    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwwn4\" (UniqueName: \"kubernetes.io/projected/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-kube-api-access-fwwn4\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:10.752972 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.752846    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdkc4\" (UniqueName: \"kubernetes.io/projected/bd10b71d-52e4-4b82-adc7-e6af5ce4ef94-kube-api-access-wdkc4\") pod \"insights-operator-78bdfb888c-7hpnb\" (UID: \"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94\") " pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.752972 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.752850    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks5fk\" (UniqueName: \"kubernetes.io/projected/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-kube-api-access-ks5fk\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:10.763812 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.763581    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"]
May 28 03:19:10.804839 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.804812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/267909e0-ca12-4d64-b905-932d7abfab53-serving-cert\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.804947 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.804872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/267909e0-ca12-4d64-b905-932d7abfab53-config\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.804947 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.804912    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhqfm\" (UniqueName: \"kubernetes.io/projected/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-kube-api-access-dhqfm\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.805014 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.804962    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-config\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.805014 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.804979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq822\" (UniqueName: \"kubernetes.io/projected/267909e0-ca12-4d64-b905-932d7abfab53-kube-api-access-jq822\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.805084 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.805030    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.805493 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.805471    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-config\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.807027 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.807006    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.812757 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.812737    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhqfm\" (UniqueName: \"kubernetes.io/projected/797d1fdc-5aa3-48cb-9e36-27c72b6c1b75-kube-api-access-dhqfm\") pod \"kube-storage-version-migrator-operator-565644f49-q5vw5\" (UID: \"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.824887 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.824868    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d"]
May 28 03:19:10.827834 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:10.827811    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d5fcf8_ecbb_44f8_86ed_e9d0be4a5e49.slice/crio-2753f50418362e29de732eda43dd05492aeaf162932921fc4b3e216279c820ac WatchSource:0}: Error finding container 2753f50418362e29de732eda43dd05492aeaf162932921fc4b3e216279c820ac: Status 404 returned error can't find the container with id 2753f50418362e29de732eda43dd05492aeaf162932921fc4b3e216279c820ac
May 28 03:19:10.832930 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.832915    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7hpnb"
May 28 03:19:10.905629 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.905557    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/267909e0-ca12-4d64-b905-932d7abfab53-config\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.905920 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.905666    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq822\" (UniqueName: \"kubernetes.io/projected/267909e0-ca12-4d64-b905-932d7abfab53-kube-api-access-jq822\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.905920 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.905745    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/267909e0-ca12-4d64-b905-932d7abfab53-serving-cert\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.906633 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.906300    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/267909e0-ca12-4d64-b905-932d7abfab53-config\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.908397 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.908375    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/267909e0-ca12-4d64-b905-932d7abfab53-serving-cert\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.914773 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.914743    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq822\" (UniqueName: \"kubernetes.io/projected/267909e0-ca12-4d64-b905-932d7abfab53-kube-api-access-jq822\") pod \"service-ca-operator-57b5b68b8-wnk92\" (UID: \"267909e0-ca12-4d64-b905-932d7abfab53\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:10.924712 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.924693    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"
May 28 03:19:10.954157 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:10.954098    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7hpnb"]
May 28 03:19:10.957102 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:10.957079    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd10b71d_52e4_4b82_adc7_e6af5ce4ef94.slice/crio-e4021867423bbca98f644eec222349e17df697269e0d7ad8fba49d0ceb143f4f WatchSource:0}: Error finding container e4021867423bbca98f644eec222349e17df697269e0d7ad8fba49d0ceb143f4f: Status 404 returned error can't find the container with id e4021867423bbca98f644eec222349e17df697269e0d7ad8fba49d0ceb143f4f
May 28 03:19:11.043024 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.042992    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5"]
May 28 03:19:11.045578 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:11.045553    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod797d1fdc_5aa3_48cb_9e36_27c72b6c1b75.slice/crio-60e0a7ab9c50db77d1f25db6a13ccc5d5c656188c0cfa8b767c84003e830ce42 WatchSource:0}: Error finding container 60e0a7ab9c50db77d1f25db6a13ccc5d5c656188c0cfa8b767c84003e830ce42: Status 404 returned error can't find the container with id 60e0a7ab9c50db77d1f25db6a13ccc5d5c656188c0cfa8b767c84003e830ce42
May 28 03:19:11.065301 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.065279    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"
May 28 03:19:11.145206 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.145174    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5" event={"ID":"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75","Type":"ContainerStarted","Data":"60e0a7ab9c50db77d1f25db6a13ccc5d5c656188c0cfa8b767c84003e830ce42"}
May 28 03:19:11.146297 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.146267    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d" event={"ID":"23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49","Type":"ContainerStarted","Data":"2753f50418362e29de732eda43dd05492aeaf162932921fc4b3e216279c820ac"}
May 28 03:19:11.147280 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.147255    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7hpnb" event={"ID":"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94","Type":"ContainerStarted","Data":"e4021867423bbca98f644eec222349e17df697269e0d7ad8fba49d0ceb143f4f"}
May 28 03:19:11.180210 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.180188    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92"]
May 28 03:19:11.182334 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:11.182309    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267909e0_ca12_4d64_b905_932d7abfab53.slice/crio-42393c085519c547fce264441775558c50b41e3c535fccb9dcc866f499348b77 WatchSource:0}: Error finding container 42393c085519c547fce264441775558c50b41e3c535fccb9dcc866f499348b77: Status 404 returned error can't find the container with id 42393c085519c547fce264441775558c50b41e3c535fccb9dcc866f499348b77
May 28 03:19:11.208645 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.208594    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:11.208645 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.208632    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:11.208777 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.208653    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:11.208777 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:11.208739    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 03:19:11.208777 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:11.208756    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 03:19:11.208903 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:11.208766    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:12.208749458 +0000 UTC m=+141.017765042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : configmap references non-existent config key: service-ca.crt
May 28 03:19:11.208903 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:11.208822    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls podName:2c8c4829-9d2a-49d1-8911-35d7eaa9f31f nodeName:}" failed. No retries permitted until 2026-05-28 03:19:12.208802901 +0000 UTC m=+141.017818495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-trb59" (UID: "2c8c4829-9d2a-49d1-8911-35d7eaa9f31f") : secret "cluster-monitoring-operator-tls" not found
May 28 03:19:11.208903 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:11.208839    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:12.208828615 +0000 UTC m=+141.017844203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : secret "router-metrics-certs-default" not found
May 28 03:19:11.577883 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.577798    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6"]
May 28 03:19:11.579983 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.579955    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6"
May 28 03:19:11.583033 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.583009    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-prl7z\""
May 28 03:19:11.596698 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.595027    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6"]
May 28 03:19:11.713133 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.713080    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69rzx\" (UniqueName: \"kubernetes.io/projected/7928ddf5-5967-4a97-a4ed-78b5a524bcc1-kube-api-access-69rzx\") pod \"network-check-source-7f44b6dd87-xn5b6\" (UID: \"7928ddf5-5967-4a97-a4ed-78b5a524bcc1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6"
May 28 03:19:11.814361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.814322    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69rzx\" (UniqueName: \"kubernetes.io/projected/7928ddf5-5967-4a97-a4ed-78b5a524bcc1-kube-api-access-69rzx\") pod \"network-check-source-7f44b6dd87-xn5b6\" (UID: \"7928ddf5-5967-4a97-a4ed-78b5a524bcc1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6"
May 28 03:19:11.823634 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.823602    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69rzx\" (UniqueName: \"kubernetes.io/projected/7928ddf5-5967-4a97-a4ed-78b5a524bcc1-kube-api-access-69rzx\") pod \"network-check-source-7f44b6dd87-xn5b6\" (UID: \"7928ddf5-5967-4a97-a4ed-78b5a524bcc1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6"
May 28 03:19:11.892614 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:11.892527    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6"
May 28 03:19:12.054605 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:12.054572    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6"]
May 28 03:19:12.151590 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:12.151513    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92" event={"ID":"267909e0-ca12-4d64-b905-932d7abfab53","Type":"ContainerStarted","Data":"42393c085519c547fce264441775558c50b41e3c535fccb9dcc866f499348b77"}
May 28 03:19:12.219904 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:12.219859    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:12.220053 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:12.219925    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:12.220053 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:12.219959    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:12.220219 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:12.220108    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 03:19:12.220219 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:12.220121    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:14.220096906 +0000 UTC m=+143.029112510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : configmap references non-existent config key: service-ca.crt
May 28 03:19:12.220219 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:12.220164    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls podName:2c8c4829-9d2a-49d1-8911-35d7eaa9f31f nodeName:}" failed. No retries permitted until 2026-05-28 03:19:14.220146539 +0000 UTC m=+143.029162123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-trb59" (UID: "2c8c4829-9d2a-49d1-8911-35d7eaa9f31f") : secret "cluster-monitoring-operator-tls" not found
May 28 03:19:12.220219 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:12.220193    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 03:19:12.220449 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:12.220261    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:14.22022931 +0000 UTC m=+143.029244912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : secret "router-metrics-certs-default" not found
May 28 03:19:12.442623 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:12.442585    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7928ddf5_5967_4a97_a4ed_78b5a524bcc1.slice/crio-7f26c824e9a1caa427715ea356fa1b110296d6e0a45de313f2159e711b0dd517 WatchSource:0}: Error finding container 7f26c824e9a1caa427715ea356fa1b110296d6e0a45de313f2159e711b0dd517: Status 404 returned error can't find the container with id 7f26c824e9a1caa427715ea356fa1b110296d6e0a45de313f2159e711b0dd517
May 28 03:19:13.154792 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:13.154751    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6" event={"ID":"7928ddf5-5967-4a97-a4ed-78b5a524bcc1","Type":"ContainerStarted","Data":"7f26c824e9a1caa427715ea356fa1b110296d6e0a45de313f2159e711b0dd517"}
May 28 03:19:14.158708 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.158443    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5" event={"ID":"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75","Type":"ContainerStarted","Data":"ee3d9245b60bd70b32c180ca122c61240bd53b6286cc56576c8120875d0dec16"}
May 28 03:19:14.160158 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.160110    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d" event={"ID":"23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49","Type":"ContainerStarted","Data":"ad4c298e1b1922f2ec4e0cb62a21c5ae6dcaa43e154c5509915a928efdf3b4b9"}
May 28 03:19:14.161566 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.161454    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7hpnb" event={"ID":"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94","Type":"ContainerStarted","Data":"39e2022aac190499dd57379b44c575f7c40ca85766851325c29b0af230b42f04"}
May 28 03:19:14.162999 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.162962    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6" event={"ID":"7928ddf5-5967-4a97-a4ed-78b5a524bcc1","Type":"ContainerStarted","Data":"777fb9ea94f3683b6aca1fbcad141c66bc209bf897bdba4c4197c96d87c65852"}
May 28 03:19:14.178674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.178562    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5" podStartSLOduration=1.776017932 podStartE2EDuration="4.1785478s" podCreationTimestamp="2026-05-28 03:19:10 +0000 UTC" firstStartedPulling="2026-05-28 03:19:11.04730956 +0000 UTC m=+139.856325144" lastFinishedPulling="2026-05-28 03:19:13.449839417 +0000 UTC m=+142.258855012" observedRunningTime="2026-05-28 03:19:14.176284591 +0000 UTC m=+142.985300193" watchObservedRunningTime="2026-05-28 03:19:14.1785478 +0000 UTC m=+142.987563408"
May 28 03:19:14.195121 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.195006    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-xn5b6" podStartSLOduration=3.194992116 podStartE2EDuration="3.194992116s" podCreationTimestamp="2026-05-28 03:19:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:19:14.193790378 +0000 UTC m=+143.002805979" watchObservedRunningTime="2026-05-28 03:19:14.194992116 +0000 UTC m=+143.004007724"
May 28 03:19:14.209072 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.208993    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-s769d" podStartSLOduration=1.5959269919999999 podStartE2EDuration="4.208977469s" podCreationTimestamp="2026-05-28 03:19:10 +0000 UTC" firstStartedPulling="2026-05-28 03:19:10.829505739 +0000 UTC m=+139.638521323" lastFinishedPulling="2026-05-28 03:19:13.442556215 +0000 UTC m=+142.251571800" observedRunningTime="2026-05-28 03:19:14.207545058 +0000 UTC m=+143.016560665" watchObservedRunningTime="2026-05-28 03:19:14.208977469 +0000 UTC m=+143.017993076"
May 28 03:19:14.227112 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.226497    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-7hpnb" podStartSLOduration=1.7345627879999999 podStartE2EDuration="4.226481794s" podCreationTimestamp="2026-05-28 03:19:10 +0000 UTC" firstStartedPulling="2026-05-28 03:19:10.959435229 +0000 UTC m=+139.768450816" lastFinishedPulling="2026-05-28 03:19:13.451354225 +0000 UTC m=+142.260369822" observedRunningTime="2026-05-28 03:19:14.225689529 +0000 UTC m=+143.034705136" watchObservedRunningTime="2026-05-28 03:19:14.226481794 +0000 UTC m=+143.035497403"
May 28 03:19:14.237279 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.237136    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:14.237279 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.237195    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:14.237441 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:14.237337    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 03:19:14.237441 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:14.237400    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls podName:2c8c4829-9d2a-49d1-8911-35d7eaa9f31f nodeName:}" failed. No retries permitted until 2026-05-28 03:19:18.237382292 +0000 UTC m=+147.046397884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-trb59" (UID: "2c8c4829-9d2a-49d1-8911-35d7eaa9f31f") : secret "cluster-monitoring-operator-tls" not found
May 28 03:19:14.237441 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:14.237416    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:18.237407308 +0000 UTC m=+147.046422899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : configmap references non-existent config key: service-ca.crt
May 28 03:19:14.238587 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:14.237855    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:14.238587 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:14.238502    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 03:19:14.238587 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:14.238546    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:18.238530618 +0000 UTC m=+147.047546208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : secret "router-metrics-certs-default" not found
May 28 03:19:15.167080 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:15.167040    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92" event={"ID":"267909e0-ca12-4d64-b905-932d7abfab53","Type":"ContainerStarted","Data":"57576e8d55d42d6dc5b7108ce8131212529b99a4dccde499f996ebde61987b78"}
May 28 03:19:15.185044 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:15.184997    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92" podStartSLOduration=1.96105939 podStartE2EDuration="5.184979543s" podCreationTimestamp="2026-05-28 03:19:10 +0000 UTC" firstStartedPulling="2026-05-28 03:19:11.184115523 +0000 UTC m=+139.993131110" lastFinishedPulling="2026-05-28 03:19:14.408035679 +0000 UTC m=+143.217051263" observedRunningTime="2026-05-28 03:19:15.18421281 +0000 UTC m=+143.993228429" watchObservedRunningTime="2026-05-28 03:19:15.184979543 +0000 UTC m=+143.993995154"
May 28 03:19:16.078437 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.078405    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7"]
May 28 03:19:16.083406 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.083375    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7"
May 28 03:19:16.086271 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.086232    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k7gmx\""
May 28 03:19:16.087448 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.087423    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 28 03:19:16.087533 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.087428    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 28 03:19:16.095210 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.095187    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7"]
May 28 03:19:16.153528 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.153500    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nxzd\" (UniqueName: \"kubernetes.io/projected/f5c867ec-5254-4d45-bec2-57bf61202682-kube-api-access-5nxzd\") pod \"migrator-b985f5d89-r9sj7\" (UID: \"f5c867ec-5254-4d45-bec2-57bf61202682\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7"
May 28 03:19:16.254260 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.254213    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nxzd\" (UniqueName: \"kubernetes.io/projected/f5c867ec-5254-4d45-bec2-57bf61202682-kube-api-access-5nxzd\") pod \"migrator-b985f5d89-r9sj7\" (UID: \"f5c867ec-5254-4d45-bec2-57bf61202682\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7"
May 28 03:19:16.267274 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.267227    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nxzd\" (UniqueName: \"kubernetes.io/projected/f5c867ec-5254-4d45-bec2-57bf61202682-kube-api-access-5nxzd\") pod \"migrator-b985f5d89-r9sj7\" (UID: \"f5c867ec-5254-4d45-bec2-57bf61202682\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7"
May 28 03:19:16.392491 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.392419    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7"
May 28 03:19:16.513553 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.513524    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7"]
May 28 03:19:16.516232 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:16.516206    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c867ec_5254_4d45_bec2_57bf61202682.slice/crio-bdbaa6233a31108daa495f5d1caf6827877d173d1e93127f11fbca5a06adb175 WatchSource:0}: Error finding container bdbaa6233a31108daa495f5d1caf6827877d173d1e93127f11fbca5a06adb175: Status 404 returned error can't find the container with id bdbaa6233a31108daa495f5d1caf6827877d173d1e93127f11fbca5a06adb175
May 28 03:19:16.845898 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:16.845874    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vdkz_9306d75d-c142-4179-a7f5-4a85d5a21651/dns-node-resolver/0.log"
May 28 03:19:17.172893 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:17.172852    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7" event={"ID":"f5c867ec-5254-4d45-bec2-57bf61202682","Type":"ContainerStarted","Data":"bdbaa6233a31108daa495f5d1caf6827877d173d1e93127f11fbca5a06adb175"}
May 28 03:19:17.645531 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:17.645467    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gnkmn_a33c77e1-ff1e-44d0-b195-4c6935500e52/node-ca/0.log"
May 28 03:19:18.271955 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:18.271928    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:18.272062 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:18.271969    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:18.272062 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:18.272001    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:18.272140 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:18.272102    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 03:19:18.272140 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:18.272101    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:26.272079927 +0000 UTC m=+155.081095528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : configmap references non-existent config key: service-ca.crt
May 28 03:19:18.272140 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:18.272132    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 03:19:18.272271 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:18.272149    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls podName:2c8c4829-9d2a-49d1-8911-35d7eaa9f31f nodeName:}" failed. No retries permitted until 2026-05-28 03:19:26.27213434 +0000 UTC m=+155.081149927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-trb59" (UID: "2c8c4829-9d2a-49d1-8911-35d7eaa9f31f") : secret "cluster-monitoring-operator-tls" not found
May 28 03:19:18.272271 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:18.272178    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:26.272163844 +0000 UTC m=+155.081179442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : secret "router-metrics-certs-default" not found
May 28 03:19:19.179793 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:19.179759    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7" event={"ID":"f5c867ec-5254-4d45-bec2-57bf61202682","Type":"ContainerStarted","Data":"37ea80773a3950166f372c841539f0d8d860ceb45f5e7205c8ef9094ebdadd9b"}
May 28 03:19:19.179793 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:19.179795    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7" event={"ID":"f5c867ec-5254-4d45-bec2-57bf61202682","Type":"ContainerStarted","Data":"eeefc21467a368c6f5dee8f4e10bc4fee59b645670b417920c6c1c80a558350f"}
May 28 03:19:26.329507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:26.329472    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:26.329913 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:26.329519    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:26.329913 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:26.329542    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:26.329913 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:26.329629    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 03:19:26.329913 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:26.329633    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 03:19:26.329913 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:26.329677    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls podName:2c8c4829-9d2a-49d1-8911-35d7eaa9f31f nodeName:}" failed. No retries permitted until 2026-05-28 03:19:42.329664631 +0000 UTC m=+171.138680214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-trb59" (UID: "2c8c4829-9d2a-49d1-8911-35d7eaa9f31f") : secret "cluster-monitoring-operator-tls" not found
May 28 03:19:26.329913 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:26.329690    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:42.329684247 +0000 UTC m=+171.138699831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : secret "router-metrics-certs-default" not found
May 28 03:19:26.329913 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:26.329700    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle podName:dd0e16eb-b462-4bcd-9a50-25cd8fd20630 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:42.329694483 +0000 UTC m=+171.138710067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle") pod "router-default-5d5f966876-bmt5s" (UID: "dd0e16eb-b462-4bcd-9a50-25cd8fd20630") : configmap references non-existent config key: service-ca.crt
May 28 03:19:27.691140 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:27.691092    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nn7gp" podUID="042509a8-7606-4966-b8cd-f7c1385d7133"
May 28 03:19:27.715254 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:27.715219    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-zcw8f" podUID="f68961e5-5c22-4c5f-8c04-de41cd10e8e1"
May 28 03:19:28.202605 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:28.202576    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:19:28.202762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:28.202638    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nn7gp"
May 28 03:19:28.760858 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:28.760815    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zrh6v" podUID="ce717d11-92f8-498b-a97e-2112e10126e4"
May 28 03:19:32.579288 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.579228    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:19:32.579668 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.579318    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:19:32.581520 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.581496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/042509a8-7606-4966-b8cd-f7c1385d7133-metrics-tls\") pod \"dns-default-nn7gp\" (UID: \"042509a8-7606-4966-b8cd-f7c1385d7133\") " pod="openshift-dns/dns-default-nn7gp"
May 28 03:19:32.581654 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.581633    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f68961e5-5c22-4c5f-8c04-de41cd10e8e1-cert\") pod \"ingress-canary-zcw8f\" (UID: \"f68961e5-5c22-4c5f-8c04-de41cd10e8e1\") " pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:19:32.706302 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.706274    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vsmkp\""
May 28 03:19:32.707491 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.707474    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krlmb\""
May 28 03:19:32.713654 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.713637    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nn7gp"
May 28 03:19:32.713715 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.713692    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcw8f"
May 28 03:19:32.844169 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.844082    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-r9sj7" podStartSLOduration=15.234822104 podStartE2EDuration="16.84406638s" podCreationTimestamp="2026-05-28 03:19:16 +0000 UTC" firstStartedPulling="2026-05-28 03:19:16.518517826 +0000 UTC m=+145.327533409" lastFinishedPulling="2026-05-28 03:19:18.127762101 +0000 UTC m=+146.936777685" observedRunningTime="2026-05-28 03:19:19.203003803 +0000 UTC m=+148.012019408" watchObservedRunningTime="2026-05-28 03:19:32.84406638 +0000 UTC m=+161.653081986"
May 28 03:19:32.844326 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.844203    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcw8f"]
May 28 03:19:32.846735 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:32.846711    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68961e5_5c22_4c5f_8c04_de41cd10e8e1.slice/crio-9b07fb91bf405912bb9e1849399365efed9324075531f6ed67fd27ada478f58c WatchSource:0}: Error finding container 9b07fb91bf405912bb9e1849399365efed9324075531f6ed67fd27ada478f58c: Status 404 returned error can't find the container with id 9b07fb91bf405912bb9e1849399365efed9324075531f6ed67fd27ada478f58c
May 28 03:19:32.861877 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:32.861855    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nn7gp"]
May 28 03:19:32.864119 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:32.864098    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042509a8_7606_4966_b8cd_f7c1385d7133.slice/crio-bc8525519ddec8199e884882adbe341b10e01359e1b716b1e5a9a1ee2270313a WatchSource:0}: Error finding container bc8525519ddec8199e884882adbe341b10e01359e1b716b1e5a9a1ee2270313a: Status 404 returned error can't find the container with id bc8525519ddec8199e884882adbe341b10e01359e1b716b1e5a9a1ee2270313a
May 28 03:19:33.215503 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:33.215467    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nn7gp" event={"ID":"042509a8-7606-4966-b8cd-f7c1385d7133","Type":"ContainerStarted","Data":"bc8525519ddec8199e884882adbe341b10e01359e1b716b1e5a9a1ee2270313a"}
May 28 03:19:33.216344 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:33.216322    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcw8f" event={"ID":"f68961e5-5c22-4c5f-8c04-de41cd10e8e1","Type":"ContainerStarted","Data":"9b07fb91bf405912bb9e1849399365efed9324075531f6ed67fd27ada478f58c"}
May 28 03:19:35.223668 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:35.223629    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcw8f" event={"ID":"f68961e5-5c22-4c5f-8c04-de41cd10e8e1","Type":"ContainerStarted","Data":"a6cf1bd67b3cec70815a0a2215a2f5956db75e69760a0fe7226e4ce39494818c"}
May 28 03:19:35.225257 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:35.225225    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nn7gp" event={"ID":"042509a8-7606-4966-b8cd-f7c1385d7133","Type":"ContainerStarted","Data":"2b5faf42dddddce833743e1675960dd496708c9a5d4aac65e82a2a573f14efee"}
May 28 03:19:35.225357 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:35.225267    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nn7gp" event={"ID":"042509a8-7606-4966-b8cd-f7c1385d7133","Type":"ContainerStarted","Data":"36d926de36c40c150f1492d4099dc2d93233c27897556d7e9e9c3e6e65cb943b"}
May 28 03:19:35.225402 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:35.225366    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nn7gp"
May 28 03:19:35.240776 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:35.240735    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zcw8f" podStartSLOduration=129.356082707 podStartE2EDuration="2m11.240724734s" podCreationTimestamp="2026-05-28 03:17:24 +0000 UTC" firstStartedPulling="2026-05-28 03:19:32.84855556 +0000 UTC m=+161.657571144" lastFinishedPulling="2026-05-28 03:19:34.733197586 +0000 UTC m=+163.542213171" observedRunningTime="2026-05-28 03:19:35.240059882 +0000 UTC m=+164.049075537" watchObservedRunningTime="2026-05-28 03:19:35.240724734 +0000 UTC m=+164.049740337"
May 28 03:19:35.258410 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:35.258370    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nn7gp" podStartSLOduration=129.914970963 podStartE2EDuration="2m11.25835687s" podCreationTimestamp="2026-05-28 03:17:24 +0000 UTC" firstStartedPulling="2026-05-28 03:19:32.865816783 +0000 UTC m=+161.674832367" lastFinishedPulling="2026-05-28 03:19:34.209202687 +0000 UTC m=+163.018218274" observedRunningTime="2026-05-28 03:19:35.257849525 +0000 UTC m=+164.066865131" watchObservedRunningTime="2026-05-28 03:19:35.25835687 +0000 UTC m=+164.067372475"
May 28 03:19:40.950700 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:40.950618    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4f2dr"]
May 28 03:19:40.953842 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:40.953821    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:40.957827 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:40.957807    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 03:19:40.958704 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:40.958684    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkttp\""
May 28 03:19:40.959813 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:40.959791    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 03:19:40.971324 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:40.971299    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4f2dr"]
May 28 03:19:41.046226 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.046193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/330a701c-1d95-4913-8e7b-766b2e127d7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.046378 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.046285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/330a701c-1d95-4913-8e7b-766b2e127d7e-crio-socket\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.046378 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.046347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/330a701c-1d95-4913-8e7b-766b2e127d7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.046456 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.046434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntm4c\" (UniqueName: \"kubernetes.io/projected/330a701c-1d95-4913-8e7b-766b2e127d7e-kube-api-access-ntm4c\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.046491 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.046483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/330a701c-1d95-4913-8e7b-766b2e127d7e-data-volume\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.147326 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.147296    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntm4c\" (UniqueName: \"kubernetes.io/projected/330a701c-1d95-4913-8e7b-766b2e127d7e-kube-api-access-ntm4c\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.147326 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.147328    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/330a701c-1d95-4913-8e7b-766b2e127d7e-data-volume\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.147487 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.147354    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/330a701c-1d95-4913-8e7b-766b2e127d7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.147487 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.147376    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/330a701c-1d95-4913-8e7b-766b2e127d7e-crio-socket\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.147550 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.147514    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/330a701c-1d95-4913-8e7b-766b2e127d7e-crio-socket\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.147601 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.147563    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/330a701c-1d95-4913-8e7b-766b2e127d7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.147703 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.147683    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/330a701c-1d95-4913-8e7b-766b2e127d7e-data-volume\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.147964 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.147945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/330a701c-1d95-4913-8e7b-766b2e127d7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.149687 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.149667    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/330a701c-1d95-4913-8e7b-766b2e127d7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.171752 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.171726    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntm4c\" (UniqueName: \"kubernetes.io/projected/330a701c-1d95-4913-8e7b-766b2e127d7e-kube-api-access-ntm4c\") pod \"insights-runtime-extractor-4f2dr\" (UID: \"330a701c-1d95-4913-8e7b-766b2e127d7e\") " pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.262623 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.262560    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4f2dr"
May 28 03:19:41.408400 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:41.408364    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4f2dr"]
May 28 03:19:41.411346 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:41.411318    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330a701c_1d95_4913_8e7b_766b2e127d7e.slice/crio-2f4e3e3d9418167a489b33ac32de3b29b674c88945f842b3087145df91ac5760 WatchSource:0}: Error finding container 2f4e3e3d9418167a489b33ac32de3b29b674c88945f842b3087145df91ac5760: Status 404 returned error can't find the container with id 2f4e3e3d9418167a489b33ac32de3b29b674c88945f842b3087145df91ac5760
May 28 03:19:42.245498 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.245470    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4f2dr" event={"ID":"330a701c-1d95-4913-8e7b-766b2e127d7e","Type":"ContainerStarted","Data":"b014026b32ae3e43a6f967f5b3fccbb31f7621dc7a5572ac8884e384619538dc"}
May 28 03:19:42.245806 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.245503    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4f2dr" event={"ID":"330a701c-1d95-4913-8e7b-766b2e127d7e","Type":"ContainerStarted","Data":"6f173cf44f425e4311bc7218fa94ef610f76f7b287700998736a1254e888f56c"}
May 28 03:19:42.245806 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.245512    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4f2dr" event={"ID":"330a701c-1d95-4913-8e7b-766b2e127d7e","Type":"ContainerStarted","Data":"2f4e3e3d9418167a489b33ac32de3b29b674c88945f842b3087145df91ac5760"}
May 28 03:19:42.357938 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.357864    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:42.357938 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.357909    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:42.357938 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.357928    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:42.358526 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.358504    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-service-ca-bundle\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:42.360162 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.360143    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e16eb-b462-4bcd-9a50-25cd8fd20630-metrics-certs\") pod \"router-default-5d5f966876-bmt5s\" (UID: \"dd0e16eb-b462-4bcd-9a50-25cd8fd20630\") " pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:42.360225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.360205    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c8c4829-9d2a-49d1-8911-35d7eaa9f31f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-trb59\" (UID: \"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:42.638857 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.638780    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"
May 28 03:19:42.644718 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.644485    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:42.744683 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.744653    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:19:42.769330 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.769303    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59"]
May 28 03:19:42.772946 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:42.772911    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8c4829_9d2a_49d1_8911_35d7eaa9f31f.slice/crio-7666b3e3c0d467a060cdab93d6935c756d830526b2993e2100a629f6e5695f27 WatchSource:0}: Error finding container 7666b3e3c0d467a060cdab93d6935c756d830526b2993e2100a629f6e5695f27: Status 404 returned error can't find the container with id 7666b3e3c0d467a060cdab93d6935c756d830526b2993e2100a629f6e5695f27
May 28 03:19:42.788989 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:42.788968    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d5f966876-bmt5s"]
May 28 03:19:42.791074 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:42.791049    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0e16eb_b462_4bcd_9a50_25cd8fd20630.slice/crio-426bf01f0f26c6c88d0d706666e6772a1101ce2a27022736872b33a71b818956 WatchSource:0}: Error finding container 426bf01f0f26c6c88d0d706666e6772a1101ce2a27022736872b33a71b818956: Status 404 returned error can't find the container with id 426bf01f0f26c6c88d0d706666e6772a1101ce2a27022736872b33a71b818956
May 28 03:19:43.253352 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:43.253308    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d5f966876-bmt5s" event={"ID":"dd0e16eb-b462-4bcd-9a50-25cd8fd20630","Type":"ContainerStarted","Data":"2b4e97b23a9c585bc829656a2d980e8b0e107442af468a52628603a8a828c54a"}
May 28 03:19:43.253352 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:43.253354    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d5f966876-bmt5s" event={"ID":"dd0e16eb-b462-4bcd-9a50-25cd8fd20630","Type":"ContainerStarted","Data":"426bf01f0f26c6c88d0d706666e6772a1101ce2a27022736872b33a71b818956"}
May 28 03:19:43.254499 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:43.254466    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59" event={"ID":"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f","Type":"ContainerStarted","Data":"7666b3e3c0d467a060cdab93d6935c756d830526b2993e2100a629f6e5695f27"}
May 28 03:19:43.275114 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:43.275075    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5d5f966876-bmt5s" podStartSLOduration=33.275064481 podStartE2EDuration="33.275064481s" podCreationTimestamp="2026-05-28 03:19:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:19:43.273291418 +0000 UTC m=+172.082307025" watchObservedRunningTime="2026-05-28 03:19:43.275064481 +0000 UTC m=+172.084080086"
May 28 03:19:43.645714 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:43.645640    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:43.648434 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:43.648410    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:44.259141 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:44.259099    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4f2dr" event={"ID":"330a701c-1d95-4913-8e7b-766b2e127d7e","Type":"ContainerStarted","Data":"1e03750a143386b78e68f6bccc3e3cc006b6b3e55aa2fdd2b66607c1a34c72ea"}
May 28 03:19:44.259617 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:44.259387    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:44.260800 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:44.260778    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d5f966876-bmt5s"
May 28 03:19:44.279799 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:44.279729    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4f2dr" podStartSLOduration=1.7223396100000001 podStartE2EDuration="4.279715227s" podCreationTimestamp="2026-05-28 03:19:40 +0000 UTC" firstStartedPulling="2026-05-28 03:19:41.461450116 +0000 UTC m=+170.270465707" lastFinishedPulling="2026-05-28 03:19:44.018825741 +0000 UTC m=+172.827841324" observedRunningTime="2026-05-28 03:19:44.278203011 +0000 UTC m=+173.087218616" watchObservedRunningTime="2026-05-28 03:19:44.279715227 +0000 UTC m=+173.088730834"
May 28 03:19:45.028534 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.028500    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"]
May 28 03:19:45.030788 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.030769    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"
May 28 03:19:45.034495 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.034472    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 03:19:45.034623 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.034519    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qhr64\""
May 28 03:19:45.037640 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.037611    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"]
May 28 03:19:45.077892 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.077867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bc7ce473-061b-487d-836f-ff3b36ec7554-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gltcn\" (UID: \"bc7ce473-061b-487d-836f-ff3b36ec7554\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"
May 28 03:19:45.178217 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.178188    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bc7ce473-061b-487d-836f-ff3b36ec7554-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gltcn\" (UID: \"bc7ce473-061b-487d-836f-ff3b36ec7554\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"
May 28 03:19:45.178353 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:45.178334    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 28 03:19:45.178417 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:45.178395    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc7ce473-061b-487d-836f-ff3b36ec7554-tls-certificates podName:bc7ce473-061b-487d-836f-ff3b36ec7554 nodeName:}" failed. No retries permitted until 2026-05-28 03:19:45.67838093 +0000 UTC m=+174.487396514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/bc7ce473-061b-487d-836f-ff3b36ec7554-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-gltcn" (UID: "bc7ce473-061b-487d-836f-ff3b36ec7554") : secret "prometheus-operator-admission-webhook-tls" not found
May 28 03:19:45.229746 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.229719    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nn7gp"
May 28 03:19:45.263542 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.263510    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59" event={"ID":"2c8c4829-9d2a-49d1-8911-35d7eaa9f31f","Type":"ContainerStarted","Data":"7de6ce0d359c10753de90873d78771675f0f1b1cac5be4783ce13285600606c0"}
May 28 03:19:45.283476 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.283393    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-trb59" podStartSLOduration=33.521898599 podStartE2EDuration="35.283376315s" podCreationTimestamp="2026-05-28 03:19:10 +0000 UTC" firstStartedPulling="2026-05-28 03:19:42.774850558 +0000 UTC m=+171.583866142" lastFinishedPulling="2026-05-28 03:19:44.536328273 +0000 UTC m=+173.345343858" observedRunningTime="2026-05-28 03:19:45.282200936 +0000 UTC m=+174.091216542" watchObservedRunningTime="2026-05-28 03:19:45.283376315 +0000 UTC m=+174.092391923"
May 28 03:19:45.681785 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.681763    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bc7ce473-061b-487d-836f-ff3b36ec7554-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gltcn\" (UID: \"bc7ce473-061b-487d-836f-ff3b36ec7554\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"
May 28 03:19:45.684110 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.684092    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bc7ce473-061b-487d-836f-ff3b36ec7554-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gltcn\" (UID: \"bc7ce473-061b-487d-836f-ff3b36ec7554\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"
May 28 03:19:45.939912 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:45.939824    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"
May 28 03:19:46.064328 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:46.060375    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"]
May 28 03:19:46.267216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:46.267121    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn" event={"ID":"bc7ce473-061b-487d-836f-ff3b36ec7554","Type":"ContainerStarted","Data":"a827930d10fd8b26dbf7758d629684c6259840a8ebaa66895395b393005bb9c7"}
May 28 03:19:48.273526 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:48.273491    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn" event={"ID":"bc7ce473-061b-487d-836f-ff3b36ec7554","Type":"ContainerStarted","Data":"e2dd24a70ce68f805064e008d74ce3e6a3f426859be68e8eb67274a1c404c567"}
May 28 03:19:48.273957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:48.273727    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"
May 28 03:19:48.278147 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:48.278121    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn"
May 28 03:19:48.291496 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:48.291457    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gltcn" podStartSLOduration=2.123260866 podStartE2EDuration="3.291443484s" podCreationTimestamp="2026-05-28 03:19:45 +0000 UTC" firstStartedPulling="2026-05-28 03:19:46.06589534 +0000 UTC m=+174.874910938" lastFinishedPulling="2026-05-28 03:19:47.23407797 +0000 UTC m=+176.043093556" observedRunningTime="2026-05-28 03:19:48.290836217 +0000 UTC m=+177.099851823" watchObservedRunningTime="2026-05-28 03:19:48.291443484 +0000 UTC m=+177.100459110"
May 28 03:19:49.952105 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.952067    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c9bdbff6-dlk55"]
May 28 03:19:49.954559 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.954540    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:49.957497 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.957469    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 03:19:49.957629 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.957522    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 03:19:49.957629 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.957592    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 03:19:49.958903 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.958881    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 03:19:49.959029 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.958886    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-prlcr\""
May 28 03:19:49.959029 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.958924    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 03:19:49.959029 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.959007    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 03:19:49.959197 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.959185    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 03:19:49.964057 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:49.964038    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c9bdbff6-dlk55"]
May 28 03:19:50.012962 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.012932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6zhm\" (UniqueName: \"kubernetes.io/projected/221d0ea4-95cf-4627-ad0f-696fac17ed1a-kube-api-access-c6zhm\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.013102 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.013001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-serving-cert\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.013102 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.013042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-oauth-config\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.013102 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.013078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-oauth-serving-cert\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.013203 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.013112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-config\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.013203 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.013130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-service-ca\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.113556 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.113520    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-serving-cert\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.113556 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.113556    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-oauth-config\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.113764 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.113578    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-oauth-serving-cert\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.113818 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.113776    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-config\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.113818 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.113807    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-service-ca\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.113975 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.113940    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6zhm\" (UniqueName: \"kubernetes.io/projected/221d0ea4-95cf-4627-ad0f-696fac17ed1a-kube-api-access-c6zhm\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.114418 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.114396    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-oauth-serving-cert\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.114519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.114495    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-config\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.114572 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.114532    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-service-ca\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.115967 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.115944    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-oauth-config\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.116052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.116022    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-serving-cert\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.123694 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.123672    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6zhm\" (UniqueName: \"kubernetes.io/projected/221d0ea4-95cf-4627-ad0f-696fac17ed1a-kube-api-access-c6zhm\") pod \"console-59c9bdbff6-dlk55\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") " pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.264565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.264466    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:19:50.394083 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:50.394061    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c9bdbff6-dlk55"]
May 28 03:19:50.396502 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:50.396470    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221d0ea4_95cf_4627_ad0f_696fac17ed1a.slice/crio-f9e62b29f8072e4c7164caed1766a1066fbe7b8226d087e6320c15aa364e4e16 WatchSource:0}: Error finding container f9e62b29f8072e4c7164caed1766a1066fbe7b8226d087e6320c15aa364e4e16: Status 404 returned error can't find the container with id f9e62b29f8072e4c7164caed1766a1066fbe7b8226d087e6320c15aa364e4e16
May 28 03:19:51.285390 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:51.285357    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c9bdbff6-dlk55" event={"ID":"221d0ea4-95cf-4627-ad0f-696fac17ed1a","Type":"ContainerStarted","Data":"f9e62b29f8072e4c7164caed1766a1066fbe7b8226d087e6320c15aa364e4e16"}
May 28 03:19:53.499112 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.499077    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"]
May 28 03:19:53.504636 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.504615    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.509002 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.508978    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 03:19:53.511616 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.511592    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 03:19:53.511616 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.511610    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wsfzt\""
May 28 03:19:53.511782 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.511697    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 03:19:53.512204 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.511905    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 03:19:53.526745 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.526713    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"]
May 28 03:19:53.540562 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.540537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.540684 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.540585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.540684 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.540657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.540807 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.540726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.540807 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.540764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcdqp\" (UniqueName: \"kubernetes.io/projected/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-api-access-jcdqp\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.540807 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.540791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.551129 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.551106    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n9d4w"]
May 28 03:19:53.553586 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.553569    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.562946 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.562880    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 03:19:53.562946 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.562934    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7qxsc\""
May 28 03:19:53.563239 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.563184    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 03:19:53.563239 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.563183    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 03:19:53.641407 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641384    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.641504 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.641504 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641443    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.641599 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641582    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.641658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-wtmp\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.641718 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641679    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.641718 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-textfile\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.641821 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-sys\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.641821 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-tls\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.641821 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641783    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.641970 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-root\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.641970 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641918    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcdqp\" (UniqueName: \"kubernetes.io/projected/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-api-access-jcdqp\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.641970 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-metrics-client-ca\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.641970 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh8nh\" (UniqueName: \"kubernetes.io/projected/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-kube-api-access-nh8nh\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.642166 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.641986    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.642166 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.642028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.642300 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.642210    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.642300 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.642227    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.644188 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.644165    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.644300 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.644277    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.657947 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.657926    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcdqp\" (UniqueName: \"kubernetes.io/projected/b62ae1aa-9d65-45b7-9fd1-af3aa1688956-kube-api-access-jcdqp\") pod \"kube-state-metrics-54fd6bc5c4-c9s9z\" (UID: \"b62ae1aa-9d65-45b7-9fd1-af3aa1688956\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.743425 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743388    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-wtmp\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743425 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743430    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-textfile\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743448    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-sys\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743493    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-sys\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743514    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-tls\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743555    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-root\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743583    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-wtmp\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743588    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-metrics-client-ca\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743658 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743644    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8nh\" (UniqueName: \"kubernetes.io/projected/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-kube-api-access-nh8nh\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743975 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743675    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-root\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743975 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743708    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743975 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743765    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.743975 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.743782    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-textfile\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.744218 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.744197    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-metrics-client-ca\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.744276 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.744237    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.745857 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.745831    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-tls\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.746035 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.746013    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.754206 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.754157    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh8nh\" (UniqueName: \"kubernetes.io/projected/c05d391c-7d3c-429a-9e5a-e8d1ba481e46-kube-api-access-nh8nh\") pod \"node-exporter-n9d4w\" (UID: \"c05d391c-7d3c-429a-9e5a-e8d1ba481e46\") " pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.815176 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.815137    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"
May 28 03:19:53.864686 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.864650    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9d4w"
May 28 03:19:53.875356 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:53.875321    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05d391c_7d3c_429a_9e5a_e8d1ba481e46.slice/crio-4223b2ca46857c7c5160645b5faf196598908abea60cdf50c3d71df3c321e4a6 WatchSource:0}: Error finding container 4223b2ca46857c7c5160645b5faf196598908abea60cdf50c3d71df3c321e4a6: Status 404 returned error can't find the container with id 4223b2ca46857c7c5160645b5faf196598908abea60cdf50c3d71df3c321e4a6
May 28 03:19:53.947448 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:53.947417    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z"]
May 28 03:19:53.950727 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:53.950698    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62ae1aa_9d65_45b7_9fd1_af3aa1688956.slice/crio-44c6f45ecc8701ae0df44beb1bb5c2294610992f681326ef760f28a7a300c61c WatchSource:0}: Error finding container 44c6f45ecc8701ae0df44beb1bb5c2294610992f681326ef760f28a7a300c61c: Status 404 returned error can't find the container with id 44c6f45ecc8701ae0df44beb1bb5c2294610992f681326ef760f28a7a300c61c
May 28 03:19:54.295132 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.295096    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c9bdbff6-dlk55" event={"ID":"221d0ea4-95cf-4627-ad0f-696fac17ed1a","Type":"ContainerStarted","Data":"50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d"}
May 28 03:19:54.296264 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.296218    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9d4w" event={"ID":"c05d391c-7d3c-429a-9e5a-e8d1ba481e46","Type":"ContainerStarted","Data":"4223b2ca46857c7c5160645b5faf196598908abea60cdf50c3d71df3c321e4a6"}
May 28 03:19:54.297425 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.297404    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z" event={"ID":"b62ae1aa-9d65-45b7-9fd1-af3aa1688956","Type":"ContainerStarted","Data":"44c6f45ecc8701ae0df44beb1bb5c2294610992f681326ef760f28a7a300c61c"}
May 28 03:19:54.313323 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.313282    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59c9bdbff6-dlk55" podStartSLOduration=2.078240195 podStartE2EDuration="5.313270434s" podCreationTimestamp="2026-05-28 03:19:49 +0000 UTC" firstStartedPulling="2026-05-28 03:19:50.398298677 +0000 UTC m=+179.207314261" lastFinishedPulling="2026-05-28 03:19:53.633328913 +0000 UTC m=+182.442344500" observedRunningTime="2026-05-28 03:19:54.312067894 +0000 UTC m=+183.121083501" watchObservedRunningTime="2026-05-28 03:19:54.313270434 +0000 UTC m=+183.122286037"
May 28 03:19:54.588832 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.588744    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:19:54.594056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.594029    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.597160 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597061    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 03:19:54.597160 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597086    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 03:19:54.597381 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597238    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 03:19:54.597381 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597324    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 03:19:54.597504 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597487    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 03:19:54.597561 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597551    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ww5dn\""
May 28 03:19:54.597635 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597569    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 03:19:54.597804 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597777    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 03:19:54.597884 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597859    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 03:19:54.597884 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.597871    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 03:19:54.603015 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.602995    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:19:54.650972 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.650901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.650972 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.650958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651169 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.650985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651169 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651020    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651169 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651169 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651169 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-out\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651169 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvbc4\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-kube-api-access-qvbc4\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.651483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.651465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-web-config\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.752772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752735    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.752942 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752784    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbc4\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-kube-api-access-qvbc4\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.752942 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752821    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.752942 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752849    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.752942 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752865    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.752942 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752884    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-web-config\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.752942 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752916    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.753237 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752964    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.753237 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.752993    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.753237 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.753033    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.753237 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.753054    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.753237 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:54.753117    2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 28 03:19:54.753237 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:54.753186    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls podName:8ce085a1-f9f0-4b79-ae8f-725eb200bc6a nodeName:}" failed. No retries permitted until 2026-05-28 03:19:55.253164642 +0000 UTC m=+184.062180245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a") : secret "alertmanager-main-tls" not found
May 28 03:19:54.753583 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.753437    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.753583 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.753521    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-out\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.754731 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.753985    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.754731 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.754272    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.754731 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.754379    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.756811 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.756785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.756901 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.756862    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-web-config\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.757103 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.757070    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.757888 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.757619    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-out\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.757888 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.757816    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.758119 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.758078    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.758578 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.758555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.758944 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.758922    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:54.761831 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:54.761812    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvbc4\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-kube-api-access-qvbc4\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:55.259005 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:55.258963    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:55.259183 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:55.259122    2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 28 03:19:55.259227 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:19:55.259188    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls podName:8ce085a1-f9f0-4b79-ae8f-725eb200bc6a nodeName:}" failed. No retries permitted until 2026-05-28 03:19:56.259170333 +0000 UTC m=+185.068185930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a") : secret "alertmanager-main-tls" not found
May 28 03:19:55.302578 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:55.302542    2575 generic.go:358] "Generic (PLEG): container finished" podID="c05d391c-7d3c-429a-9e5a-e8d1ba481e46" containerID="9e36266ffdb0bccffb0846f6234ea05093b1b879bae45ce9339166e418f50f91" exitCode=0
May 28 03:19:55.302735 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:55.302637    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9d4w" event={"ID":"c05d391c-7d3c-429a-9e5a-e8d1ba481e46","Type":"ContainerDied","Data":"9e36266ffdb0bccffb0846f6234ea05093b1b879bae45ce9339166e418f50f91"}
May 28 03:19:56.266047 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.266016    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:56.268388 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.268346    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:56.307111 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.307084    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9d4w" event={"ID":"c05d391c-7d3c-429a-9e5a-e8d1ba481e46","Type":"ContainerStarted","Data":"b09871d4f49c37f62f212d987e9fba54eb53b3bb55551278825c9b18cc119049"}
May 28 03:19:56.307293 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.307119    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9d4w" event={"ID":"c05d391c-7d3c-429a-9e5a-e8d1ba481e46","Type":"ContainerStarted","Data":"1348660d58ec36f199fe8f3d4546d06ead6460d84874f3f4543175b38afb8f9c"}
May 28 03:19:56.308804 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.308776    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z" event={"ID":"b62ae1aa-9d65-45b7-9fd1-af3aa1688956","Type":"ContainerStarted","Data":"72cff43170b6197a25369879f1fa929f93fdbd97f3ec81507f286885e4505bec"}
May 28 03:19:56.308804 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.308803    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z" event={"ID":"b62ae1aa-9d65-45b7-9fd1-af3aa1688956","Type":"ContainerStarted","Data":"f282ff49701221ef8c90adb0d6fa9cf1d3df1e9846d01a64b15db819d2590146"}
May 28 03:19:56.308946 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.308815    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z" event={"ID":"b62ae1aa-9d65-45b7-9fd1-af3aa1688956","Type":"ContainerStarted","Data":"36dba2c2bfbd51b3bfc3b17104971698460f3b7e732ec2a1ee3902697d54920c"}
May 28 03:19:56.350602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.350555    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n9d4w" podStartSLOduration=2.384144807 podStartE2EDuration="3.3505428s" podCreationTimestamp="2026-05-28 03:19:53 +0000 UTC" firstStartedPulling="2026-05-28 03:19:53.877830221 +0000 UTC m=+182.686845811" lastFinishedPulling="2026-05-28 03:19:54.844228208 +0000 UTC m=+183.653243804" observedRunningTime="2026-05-28 03:19:56.347039369 +0000 UTC m=+185.156054975" watchObservedRunningTime="2026-05-28 03:19:56.3505428 +0000 UTC m=+185.159558426"
May 28 03:19:56.406314 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.406282    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 03:19:56.553137 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.552992    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-c9s9z" podStartSLOduration=2.143316752 podStartE2EDuration="3.552972552s" podCreationTimestamp="2026-05-28 03:19:53 +0000 UTC" firstStartedPulling="2026-05-28 03:19:53.952494752 +0000 UTC m=+182.761510335" lastFinishedPulling="2026-05-28 03:19:55.362150542 +0000 UTC m=+184.171166135" observedRunningTime="2026-05-28 03:19:56.372543961 +0000 UTC m=+185.181559572" watchObservedRunningTime="2026-05-28 03:19:56.552972552 +0000 UTC m=+185.361988168"
May 28 03:19:56.554400 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:56.554376    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:19:56.558321 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:56.558292    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce085a1_f9f0_4b79_ae8f_725eb200bc6a.slice/crio-44abc713937f3541b40c96eee77eed3c8d639bae9c0ea5d8b7ee3e43e5aa506f WatchSource:0}: Error finding container 44abc713937f3541b40c96eee77eed3c8d639bae9c0ea5d8b7ee3e43e5aa506f: Status 404 returned error can't find the container with id 44abc713937f3541b40c96eee77eed3c8d639bae9c0ea5d8b7ee3e43e5aa506f
May 28 03:19:57.313383 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.313299    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerStarted","Data":"44abc713937f3541b40c96eee77eed3c8d639bae9c0ea5d8b7ee3e43e5aa506f"}
May 28 03:19:57.959021 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.958990    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5447bdddcc-zjh67"]
May 28 03:19:57.961496 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.961478    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:57.966572 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.966547    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 03:19:57.967864 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.967834    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-64sp3f61bu5ds\""
May 28 03:19:57.967976 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.967955    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 03:19:57.968104 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.968083    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-st7kb\""
May 28 03:19:57.968192 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.968083    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 03:19:57.968192 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.968147    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 03:19:57.973177 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:57.973156    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5447bdddcc-zjh67"]
May 28 03:19:58.082474 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.082443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsks6\" (UniqueName: \"kubernetes.io/projected/862db339-675b-49db-b27c-822e3a267797-kube-api-access-rsks6\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.082587 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.082491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-client-ca-bundle\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.082587 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.082544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/862db339-675b-49db-b27c-822e3a267797-audit-log\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.082587 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.082562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/862db339-675b-49db-b27c-822e3a267797-metrics-server-audit-profiles\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.082725 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.082589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-secret-metrics-server-client-certs\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.082725 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.082633    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-secret-metrics-server-tls\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.082725 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.082651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/862db339-675b-49db-b27c-822e3a267797-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.182965 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.182930    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-secret-metrics-server-tls\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.183107 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.182971    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/862db339-675b-49db-b27c-822e3a267797-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.183107 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.183018    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsks6\" (UniqueName: \"kubernetes.io/projected/862db339-675b-49db-b27c-822e3a267797-kube-api-access-rsks6\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.183107 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.183066    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-client-ca-bundle\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.183272 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.183114    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/862db339-675b-49db-b27c-822e3a267797-audit-log\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.183272 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.183142    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/862db339-675b-49db-b27c-822e3a267797-metrics-server-audit-profiles\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.183272 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.183173    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-secret-metrics-server-client-certs\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.183574 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.183546    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/862db339-675b-49db-b27c-822e3a267797-audit-log\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.183840 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.183818    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/862db339-675b-49db-b27c-822e3a267797-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.184303 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.184280    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/862db339-675b-49db-b27c-822e3a267797-metrics-server-audit-profiles\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.185842 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.185821    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-secret-metrics-server-tls\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.185842 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.185826    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-client-ca-bundle\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.185957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.185871    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/862db339-675b-49db-b27c-822e3a267797-secret-metrics-server-client-certs\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.198644 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.198616    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsks6\" (UniqueName: \"kubernetes.io/projected/862db339-675b-49db-b27c-822e3a267797-kube-api-access-rsks6\") pod \"metrics-server-5447bdddcc-zjh67\" (UID: \"862db339-675b-49db-b27c-822e3a267797\") " pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.270664 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.270588    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:19:58.319173 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.319127    2575 generic.go:358] "Generic (PLEG): container finished" podID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerID="cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23" exitCode=0
May 28 03:19:58.319561 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.319189    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerDied","Data":"cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23"}
May 28 03:19:58.397330 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:58.397310    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5447bdddcc-zjh67"]
May 28 03:19:58.399759 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:19:58.399734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862db339_675b_49db_b27c_822e3a267797.slice/crio-3fff9a21db9132845813289d6516fffe3d83ca774e287558af9bdc354707f025 WatchSource:0}: Error finding container 3fff9a21db9132845813289d6516fffe3d83ca774e287558af9bdc354707f025: Status 404 returned error can't find the container with id 3fff9a21db9132845813289d6516fffe3d83ca774e287558af9bdc354707f025
May 28 03:19:59.323402 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:19:59.323358    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67" event={"ID":"862db339-675b-49db-b27c-822e3a267797","Type":"ContainerStarted","Data":"3fff9a21db9132845813289d6516fffe3d83ca774e287558af9bdc354707f025"}
May 28 03:20:00.265333 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:00.264606    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:20:00.265333 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:00.265296    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:20:00.277265 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:00.276724    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:20:00.328372 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:00.328343    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerStarted","Data":"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e"}
May 28 03:20:00.328669 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:00.328384    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerStarted","Data":"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51"}
May 28 03:20:00.329835 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:00.329809    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67" event={"ID":"862db339-675b-49db-b27c-822e3a267797","Type":"ContainerStarted","Data":"c1fd5f77579536ccdac56d3029e22736898be533990e8abc2ae213df504ebe37"}
May 28 03:20:00.334371 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:00.334349    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:20:00.350428 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:00.350384    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67" podStartSLOduration=1.57956776 podStartE2EDuration="3.350371031s" podCreationTimestamp="2026-05-28 03:19:57 +0000 UTC" firstStartedPulling="2026-05-28 03:19:58.401526897 +0000 UTC m=+187.210542481" lastFinishedPulling="2026-05-28 03:20:00.172330153 +0000 UTC m=+188.981345752" observedRunningTime="2026-05-28 03:20:00.349376774 +0000 UTC m=+189.158392393" watchObservedRunningTime="2026-05-28 03:20:00.350371031 +0000 UTC m=+189.159386637"
May 28 03:20:01.188890 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.188861    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-845b4cdc98-bfcxp"]
May 28 03:20:01.191198 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.191182    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.200525 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.200506    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 03:20:01.203566 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.203543    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b4cdc98-bfcxp"]
May 28 03:20:01.314320 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.314284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-config\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.314320 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.314323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-trusted-ca-bundle\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.314541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.314390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-service-ca\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.314541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.314452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-oauth-serving-cert\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.314541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.314505    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-serving-cert\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.314541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.314521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-oauth-config\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.314755 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.314549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2frf8\" (UniqueName: \"kubernetes.io/projected/91adc740-5edf-4ab7-8aed-724f3eeba17b-kube-api-access-2frf8\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.335535 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.335499    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerStarted","Data":"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc"}
May 28 03:20:01.335887 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.335543    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerStarted","Data":"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b"}
May 28 03:20:01.335887 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.335553    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerStarted","Data":"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e"}
May 28 03:20:01.418772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.416166    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2frf8\" (UniqueName: \"kubernetes.io/projected/91adc740-5edf-4ab7-8aed-724f3eeba17b-kube-api-access-2frf8\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.418772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.416438    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-config\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.418772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.416647    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-trusted-ca-bundle\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.418772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.417118    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-service-ca\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.418772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.417213    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-oauth-serving-cert\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.418772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.417406    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-serving-cert\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.418772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.417439    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-oauth-config\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.419280 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.419064    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-config\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.419688 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.419667    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-service-ca\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.419752 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.419704    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-oauth-serving-cert\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.420727 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.420689    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-oauth-config\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.425010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.423749    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-serving-cert\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.425010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.424375    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-trusted-ca-bundle\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.426841 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.426819    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2frf8\" (UniqueName: \"kubernetes.io/projected/91adc740-5edf-4ab7-8aed-724f3eeba17b-kube-api-access-2frf8\") pod \"console-845b4cdc98-bfcxp\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") " pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.501342 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.501226    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:01.632639 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:01.632607    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b4cdc98-bfcxp"]
May 28 03:20:01.635534 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:20:01.635506    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91adc740_5edf_4ab7_8aed_724f3eeba17b.slice/crio-d1ff7b071638a6431094c3cc56622e769b175c46e07f2d243544907bf34f2a76 WatchSource:0}: Error finding container d1ff7b071638a6431094c3cc56622e769b175c46e07f2d243544907bf34f2a76: Status 404 returned error can't find the container with id d1ff7b071638a6431094c3cc56622e769b175c46e07f2d243544907bf34f2a76
May 28 03:20:02.340028 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:02.339991    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b4cdc98-bfcxp" event={"ID":"91adc740-5edf-4ab7-8aed-724f3eeba17b","Type":"ContainerStarted","Data":"75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218"}
May 28 03:20:02.340028 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:02.340033    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b4cdc98-bfcxp" event={"ID":"91adc740-5edf-4ab7-8aed-724f3eeba17b","Type":"ContainerStarted","Data":"d1ff7b071638a6431094c3cc56622e769b175c46e07f2d243544907bf34f2a76"}
May 28 03:20:02.342879 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:02.342844    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerStarted","Data":"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e"}
May 28 03:20:02.361116 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:02.361071    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-845b4cdc98-bfcxp" podStartSLOduration=1.3610538540000001 podStartE2EDuration="1.361053854s" podCreationTimestamp="2026-05-28 03:20:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:20:02.359847213 +0000 UTC m=+191.168862819" watchObservedRunningTime="2026-05-28 03:20:02.361053854 +0000 UTC m=+191.170069460"
May 28 03:20:02.398154 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:02.398106    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.591946998 podStartE2EDuration="8.398091596s" podCreationTimestamp="2026-05-28 03:19:54 +0000 UTC" firstStartedPulling="2026-05-28 03:19:56.560458256 +0000 UTC m=+185.369473840" lastFinishedPulling="2026-05-28 03:20:01.366602849 +0000 UTC m=+190.175618438" observedRunningTime="2026-05-28 03:20:02.396385933 +0000 UTC m=+191.205401539" watchObservedRunningTime="2026-05-28 03:20:02.398091596 +0000 UTC m=+191.207107280"
May 28 03:20:11.502033 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:11.501993    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:11.502483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:11.502044    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:11.506850 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:11.506828    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:12.374603 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:12.374574    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:20:12.449100 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:12.449067    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c9bdbff6-dlk55"]
May 28 03:20:18.271434 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:18.271401    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:20:18.271803 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:18.271489    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:20:29.418777 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:29.418746    2575 generic.go:358] "Generic (PLEG): container finished" podID="797d1fdc-5aa3-48cb-9e36-27c72b6c1b75" containerID="ee3d9245b60bd70b32c180ca122c61240bd53b6286cc56576c8120875d0dec16" exitCode=0
May 28 03:20:29.419113 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:29.418824    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5" event={"ID":"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75","Type":"ContainerDied","Data":"ee3d9245b60bd70b32c180ca122c61240bd53b6286cc56576c8120875d0dec16"}
May 28 03:20:29.419180 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:29.419164    2575 scope.go:117] "RemoveContainer" containerID="ee3d9245b60bd70b32c180ca122c61240bd53b6286cc56576c8120875d0dec16"
May 28 03:20:30.423558 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:30.423524    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-q5vw5" event={"ID":"797d1fdc-5aa3-48cb-9e36-27c72b6c1b75","Type":"ContainerStarted","Data":"0bef14e326ae6bc5fbf56682feeeb1687c73f80c4fb978d99c6f33f79e970f48"}
May 28 03:20:31.427804 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:31.427771    2575 generic.go:358] "Generic (PLEG): container finished" podID="267909e0-ca12-4d64-b905-932d7abfab53" containerID="57576e8d55d42d6dc5b7108ce8131212529b99a4dccde499f996ebde61987b78" exitCode=0
May 28 03:20:31.428168 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:31.427820    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92" event={"ID":"267909e0-ca12-4d64-b905-932d7abfab53","Type":"ContainerDied","Data":"57576e8d55d42d6dc5b7108ce8131212529b99a4dccde499f996ebde61987b78"}
May 28 03:20:31.428168 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:31.428135    2575 scope.go:117] "RemoveContainer" containerID="57576e8d55d42d6dc5b7108ce8131212529b99a4dccde499f996ebde61987b78"
May 28 03:20:32.431845 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:32.431811    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-wnk92" event={"ID":"267909e0-ca12-4d64-b905-932d7abfab53","Type":"ContainerStarted","Data":"69c97e5af870e8f2b7a0fbc936321a24be3d63d96bc3a5bdc39f833a83251446"}
May 28 03:20:34.438615 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:34.438584    2575 generic.go:358] "Generic (PLEG): container finished" podID="bd10b71d-52e4-4b82-adc7-e6af5ce4ef94" containerID="39e2022aac190499dd57379b44c575f7c40ca85766851325c29b0af230b42f04" exitCode=0
May 28 03:20:34.439024 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:34.438657    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7hpnb" event={"ID":"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94","Type":"ContainerDied","Data":"39e2022aac190499dd57379b44c575f7c40ca85766851325c29b0af230b42f04"}
May 28 03:20:34.439024 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:34.438953    2575 scope.go:117] "RemoveContainer" containerID="39e2022aac190499dd57379b44c575f7c40ca85766851325c29b0af230b42f04"
May 28 03:20:35.443612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:35.443577    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7hpnb" event={"ID":"bd10b71d-52e4-4b82-adc7-e6af5ce4ef94","Type":"ContainerStarted","Data":"75370b093a62fd4a92e82fcb713af9caa1c651c39ecf19086f337cc0481a99f0"}
May 28 03:20:37.467689 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.467618    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-59c9bdbff6-dlk55" podUID="221d0ea4-95cf-4627-ad0f-696fac17ed1a" containerName="console" containerID="cri-o://50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d" gracePeriod=15
May 28 03:20:37.704532 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.704512    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59c9bdbff6-dlk55_221d0ea4-95cf-4627-ad0f-696fac17ed1a/console/0.log"
May 28 03:20:37.704648 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.704578    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:20:37.721474 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721425    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-oauth-config\") pod \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") "
May 28 03:20:37.721474 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721456    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-config\") pod \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") "
May 28 03:20:37.721602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721492    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-service-ca\") pod \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") "
May 28 03:20:37.721602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721536    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-oauth-serving-cert\") pod \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") "
May 28 03:20:37.721602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721561    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-serving-cert\") pod \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") "
May 28 03:20:37.721602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721576    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6zhm\" (UniqueName: \"kubernetes.io/projected/221d0ea4-95cf-4627-ad0f-696fac17ed1a-kube-api-access-c6zhm\") pod \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\" (UID: \"221d0ea4-95cf-4627-ad0f-696fac17ed1a\") "
May 28 03:20:37.721927 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721901    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "221d0ea4-95cf-4627-ad0f-696fac17ed1a" (UID: "221d0ea4-95cf-4627-ad0f-696fac17ed1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:20:37.721992 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721908    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-config" (OuterVolumeSpecName: "console-config") pod "221d0ea4-95cf-4627-ad0f-696fac17ed1a" (UID: "221d0ea4-95cf-4627-ad0f-696fac17ed1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:20:37.721992 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.721936    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "221d0ea4-95cf-4627-ad0f-696fac17ed1a" (UID: "221d0ea4-95cf-4627-ad0f-696fac17ed1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:20:37.724002 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.723943    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "221d0ea4-95cf-4627-ad0f-696fac17ed1a" (UID: "221d0ea4-95cf-4627-ad0f-696fac17ed1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:20:37.724096 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.724015    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "221d0ea4-95cf-4627-ad0f-696fac17ed1a" (UID: "221d0ea4-95cf-4627-ad0f-696fac17ed1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:20:37.724238 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.724212    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/221d0ea4-95cf-4627-ad0f-696fac17ed1a-kube-api-access-c6zhm" (OuterVolumeSpecName: "kube-api-access-c6zhm") pod "221d0ea4-95cf-4627-ad0f-696fac17ed1a" (UID: "221d0ea4-95cf-4627-ad0f-696fac17ed1a"). InnerVolumeSpecName "kube-api-access-c6zhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:20:37.822826 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.822789    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:20:37.822826 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.822819    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:20:37.822826 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.822832    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/221d0ea4-95cf-4627-ad0f-696fac17ed1a-oauth-serving-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:20:37.823049 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.822847    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-serving-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:20:37.823049 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.822860    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6zhm\" (UniqueName: \"kubernetes.io/projected/221d0ea4-95cf-4627-ad0f-696fac17ed1a-kube-api-access-c6zhm\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:20:37.823049 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:37.822872    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/221d0ea4-95cf-4627-ad0f-696fac17ed1a-console-oauth-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:20:38.275778 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.275747    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:20:38.279846 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.279824    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5447bdddcc-zjh67"
May 28 03:20:38.453440 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.453412    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59c9bdbff6-dlk55_221d0ea4-95cf-4627-ad0f-696fac17ed1a/console/0.log"
May 28 03:20:38.453600 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.453448    2575 generic.go:358] "Generic (PLEG): container finished" podID="221d0ea4-95cf-4627-ad0f-696fac17ed1a" containerID="50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d" exitCode=2
May 28 03:20:38.453600 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.453480    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c9bdbff6-dlk55" event={"ID":"221d0ea4-95cf-4627-ad0f-696fac17ed1a","Type":"ContainerDied","Data":"50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d"}
May 28 03:20:38.453600 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.453525    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c9bdbff6-dlk55"
May 28 03:20:38.453600 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.453539    2575 scope.go:117] "RemoveContainer" containerID="50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d"
May 28 03:20:38.453775 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.453526    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c9bdbff6-dlk55" event={"ID":"221d0ea4-95cf-4627-ad0f-696fac17ed1a","Type":"ContainerDied","Data":"f9e62b29f8072e4c7164caed1766a1066fbe7b8226d087e6320c15aa364e4e16"}
May 28 03:20:38.462115 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.462099    2575 scope.go:117] "RemoveContainer" containerID="50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d"
May 28 03:20:38.462362 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:20:38.462342    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d\": container with ID starting with 50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d not found: ID does not exist" containerID="50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d"
May 28 03:20:38.462413 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.462368    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d"} err="failed to get container status \"50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d\": rpc error: code = NotFound desc = could not find container \"50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d\": container with ID starting with 50d7b582f1d5e459fcc1e99d57f2c13cf3b68362a21479e444bde0b7d405b14d not found: ID does not exist"
May 28 03:20:38.470743 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.470724    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c9bdbff6-dlk55"]
May 28 03:20:38.487663 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:38.487645    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c9bdbff6-dlk55"]
May 28 03:20:39.748438 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:20:39.748405    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="221d0ea4-95cf-4627-ad0f-696fac17ed1a" path="/var/lib/kubelet/pods/221d0ea4-95cf-4627-ad0f-696fac17ed1a/volumes"
May 28 03:21:03.523317 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:03.523283    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:21:03.525476 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:03.525457    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce717d11-92f8-498b-a97e-2112e10126e4-metrics-certs\") pod \"network-metrics-daemon-zrh6v\" (UID: \"ce717d11-92f8-498b-a97e-2112e10126e4\") " pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:21:03.747989 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:03.747962    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzb4w\""
May 28 03:21:03.755356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:03.755335    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrh6v"
May 28 03:21:03.881343 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:03.881314    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrh6v"]
May 28 03:21:03.883658 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:21:03.883624    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce717d11_92f8_498b_a97e_2112e10126e4.slice/crio-7724ff0c3607cac7dcaf05304a6eb85505ecdd50d056030fcfb3ae06671b1c05 WatchSource:0}: Error finding container 7724ff0c3607cac7dcaf05304a6eb85505ecdd50d056030fcfb3ae06671b1c05: Status 404 returned error can't find the container with id 7724ff0c3607cac7dcaf05304a6eb85505ecdd50d056030fcfb3ae06671b1c05
May 28 03:21:04.527132 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:04.527097    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrh6v" event={"ID":"ce717d11-92f8-498b-a97e-2112e10126e4","Type":"ContainerStarted","Data":"7724ff0c3607cac7dcaf05304a6eb85505ecdd50d056030fcfb3ae06671b1c05"}
May 28 03:21:05.532282 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:05.532227    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrh6v" event={"ID":"ce717d11-92f8-498b-a97e-2112e10126e4","Type":"ContainerStarted","Data":"0d8550db5c51fc37505f3a13d0b13c4507ebf6c1d8234070d39c38f000cb70a8"}
May 28 03:21:05.532282 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:05.532282    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrh6v" event={"ID":"ce717d11-92f8-498b-a97e-2112e10126e4","Type":"ContainerStarted","Data":"d2ef416a37f7e37803c5329b05a3079c968b47fb1cde8b4ff970f4b94687aaf6"}
May 28 03:21:05.552681 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:05.552636    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zrh6v" podStartSLOduration=253.632720559 podStartE2EDuration="4m14.552624032s" podCreationTimestamp="2026-05-28 03:16:51 +0000 UTC" firstStartedPulling="2026-05-28 03:21:03.885547916 +0000 UTC m=+252.694563499" lastFinishedPulling="2026-05-28 03:21:04.805451386 +0000 UTC m=+253.614466972" observedRunningTime="2026-05-28 03:21:05.551071656 +0000 UTC m=+254.360087293" watchObservedRunningTime="2026-05-28 03:21:05.552624032 +0000 UTC m=+254.361639636"
May 28 03:21:14.047682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.047641    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:21:14.048261 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.048203    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="alertmanager" containerID="cri-o://7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51" gracePeriod=120
May 28 03:21:14.048368 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.048278    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy-metric" containerID="cri-o://2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc" gracePeriod=120
May 28 03:21:14.048368 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.048313    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy" containerID="cri-o://a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b" gracePeriod=120
May 28 03:21:14.048472 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.048364    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="config-reloader" containerID="cri-o://b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e" gracePeriod=120
May 28 03:21:14.048472 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.048281    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy-web" containerID="cri-o://8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e" gracePeriod=120
May 28 03:21:14.052292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.052200    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="prom-label-proxy" containerID="cri-o://27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e" gracePeriod=120
May 28 03:21:14.559063 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.559034    2575 generic.go:358] "Generic (PLEG): container finished" podID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerID="27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e" exitCode=0
May 28 03:21:14.559063 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.559059    2575 generic.go:358] "Generic (PLEG): container finished" podID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerID="a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b" exitCode=0
May 28 03:21:14.559063 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.559066    2575 generic.go:358] "Generic (PLEG): container finished" podID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerID="b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e" exitCode=0
May 28 03:21:14.559297 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.559072    2575 generic.go:358] "Generic (PLEG): container finished" podID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerID="7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51" exitCode=0
May 28 03:21:14.559297 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.559110    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerDied","Data":"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e"}
May 28 03:21:14.559297 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.559144    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerDied","Data":"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b"}
May 28 03:21:14.559297 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.559155    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerDied","Data":"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e"}
May 28 03:21:14.559297 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:14.559165    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerDied","Data":"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51"}
May 28 03:21:15.296037 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.296017    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.407296 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407191    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-cluster-tls-config\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407296 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407264    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-trusted-ca-bundle\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407484 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407312    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407484 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407351    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-main-db\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407563 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407478    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvbc4\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-kube-api-access-qvbc4\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407563 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407530    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-web-config\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407661 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407569    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-tls-assets\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407661 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407607    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407661 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407621    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:21:15.407816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407669    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407702    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-metrics-client-ca\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407699    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:21:15.407816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407731    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-volume\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407768    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-out\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.407816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.407799    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy\") pod \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\" (UID: \"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a\") "
May 28 03:21:15.408113 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.408057    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.408113 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.408076    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-alertmanager-main-db\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.408743 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.408718    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:21:15.410437 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.410357    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-kube-api-access-qvbc4" (OuterVolumeSpecName: "kube-api-access-qvbc4") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "kube-api-access-qvbc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:21:15.410572 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.410499    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:21:15.410757 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.410717    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:15.410888 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.410850    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:15.411007 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.410907    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:15.411841 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.411809    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:15.411966 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.411946    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-out" (OuterVolumeSpecName: "config-out") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:21:15.412073 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.412056    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-volume" (OuterVolumeSpecName: "config-volume") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:15.414569 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.414487    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:15.420427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.420404    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-web-config" (OuterVolumeSpecName: "web-config") pod "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" (UID: "8ce085a1-f9f0-4b79-ae8f-725eb200bc6a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:15.508979 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.508945    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-tls-assets\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.508979 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.508975    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.508979 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.508987    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.509194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.508997    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-metrics-client-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.509194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.509006    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.509194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.509015    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-config-out\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.509194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.509023    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.509194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.509031    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-cluster-tls-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.509194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.509041    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-secret-alertmanager-main-tls\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.509194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.509050    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvbc4\" (UniqueName: \"kubernetes.io/projected/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-kube-api-access-qvbc4\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.509194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.509058    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a-web-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:15.564827 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.564787    2575 generic.go:358] "Generic (PLEG): container finished" podID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerID="2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc" exitCode=0
May 28 03:21:15.564827 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.564818    2575 generic.go:358] "Generic (PLEG): container finished" podID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerID="8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e" exitCode=0
May 28 03:21:15.565055 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.564879    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerDied","Data":"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc"}
May 28 03:21:15.565055 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.564914    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.565055 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.564924    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerDied","Data":"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e"}
May 28 03:21:15.565055 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.564942    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ce085a1-f9f0-4b79-ae8f-725eb200bc6a","Type":"ContainerDied","Data":"44abc713937f3541b40c96eee77eed3c8d639bae9c0ea5d8b7ee3e43e5aa506f"}
May 28 03:21:15.565055 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.564961    2575 scope.go:117] "RemoveContainer" containerID="27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e"
May 28 03:21:15.572065 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.572044    2575 scope.go:117] "RemoveContainer" containerID="2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc"
May 28 03:21:15.578433 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.578415    2575 scope.go:117] "RemoveContainer" containerID="a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b"
May 28 03:21:15.584287 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.584268    2575 scope.go:117] "RemoveContainer" containerID="8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e"
May 28 03:21:15.590678 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.590663    2575 scope.go:117] "RemoveContainer" containerID="b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e"
May 28 03:21:15.595014 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.594993    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:21:15.597939 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.597918    2575 scope.go:117] "RemoveContainer" containerID="7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51"
May 28 03:21:15.604202 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.604162    2575 scope.go:117] "RemoveContainer" containerID="cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23"
May 28 03:21:15.605767 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.605750    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:21:15.610347 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.610334    2575 scope.go:117] "RemoveContainer" containerID="27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e"
May 28 03:21:15.610559 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:21:15.610543    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e\": container with ID starting with 27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e not found: ID does not exist" containerID="27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e"
May 28 03:21:15.610594 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.610567    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e"} err="failed to get container status \"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e\": rpc error: code = NotFound desc = could not find container \"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e\": container with ID starting with 27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e not found: ID does not exist"
May 28 03:21:15.610594 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.610584    2575 scope.go:117] "RemoveContainer" containerID="2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc"
May 28 03:21:15.610793 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:21:15.610780    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc\": container with ID starting with 2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc not found: ID does not exist" containerID="2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc"
May 28 03:21:15.610841 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.610799    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc"} err="failed to get container status \"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc\": rpc error: code = NotFound desc = could not find container \"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc\": container with ID starting with 2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc not found: ID does not exist"
May 28 03:21:15.610841 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.610810    2575 scope.go:117] "RemoveContainer" containerID="a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b"
May 28 03:21:15.610981 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:21:15.610968    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b\": container with ID starting with a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b not found: ID does not exist" containerID="a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b"
May 28 03:21:15.611015 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.610992    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b"} err="failed to get container status \"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b\": rpc error: code = NotFound desc = could not find container \"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b\": container with ID starting with a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b not found: ID does not exist"
May 28 03:21:15.611015 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611003    2575 scope.go:117] "RemoveContainer" containerID="8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e"
May 28 03:21:15.611172 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:21:15.611156    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e\": container with ID starting with 8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e not found: ID does not exist" containerID="8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e"
May 28 03:21:15.611205 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611174    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e"} err="failed to get container status \"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e\": rpc error: code = NotFound desc = could not find container \"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e\": container with ID starting with 8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e not found: ID does not exist"
May 28 03:21:15.611205 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611187    2575 scope.go:117] "RemoveContainer" containerID="b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e"
May 28 03:21:15.611429 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:21:15.611401    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e\": container with ID starting with b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e not found: ID does not exist" containerID="b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e"
May 28 03:21:15.611467 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611435    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e"} err="failed to get container status \"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e\": rpc error: code = NotFound desc = could not find container \"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e\": container with ID starting with b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e not found: ID does not exist"
May 28 03:21:15.611467 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611451    2575 scope.go:117] "RemoveContainer" containerID="7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51"
May 28 03:21:15.611667 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:21:15.611650    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51\": container with ID starting with 7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51 not found: ID does not exist" containerID="7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51"
May 28 03:21:15.611721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611675    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51"} err="failed to get container status \"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51\": rpc error: code = NotFound desc = could not find container \"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51\": container with ID starting with 7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51 not found: ID does not exist"
May 28 03:21:15.611721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611696    2575 scope.go:117] "RemoveContainer" containerID="cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23"
May 28 03:21:15.611927 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:21:15.611910    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23\": container with ID starting with cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23 not found: ID does not exist" containerID="cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23"
May 28 03:21:15.611967 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611932    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23"} err="failed to get container status \"cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23\": rpc error: code = NotFound desc = could not find container \"cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23\": container with ID starting with cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23 not found: ID does not exist"
May 28 03:21:15.611967 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.611946    2575 scope.go:117] "RemoveContainer" containerID="27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e"
May 28 03:21:15.612132 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612114    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e"} err="failed to get container status \"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e\": rpc error: code = NotFound desc = could not find container \"27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e\": container with ID starting with 27d517d8079cecf82be748653488129e7a062e2ee1279506bad98843c6f8b32e not found: ID does not exist"
May 28 03:21:15.612173 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612132    2575 scope.go:117] "RemoveContainer" containerID="2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc"
May 28 03:21:15.612419 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612401    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc"} err="failed to get container status \"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc\": rpc error: code = NotFound desc = could not find container \"2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc\": container with ID starting with 2441d7e6a2bbb5262507ab41cad30c6b6da5dbdb761110d31103efed2e9d6bbc not found: ID does not exist"
May 28 03:21:15.612497 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612420    2575 scope.go:117] "RemoveContainer" containerID="a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b"
May 28 03:21:15.612623 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612607    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b"} err="failed to get container status \"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b\": rpc error: code = NotFound desc = could not find container \"a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b\": container with ID starting with a5b3382e0c3acef5f429030718a0df485a8aeb2c76b7700f5266f467a14d681b not found: ID does not exist"
May 28 03:21:15.612688 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612624    2575 scope.go:117] "RemoveContainer" containerID="8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e"
May 28 03:21:15.612827 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612810    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e"} err="failed to get container status \"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e\": rpc error: code = NotFound desc = could not find container \"8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e\": container with ID starting with 8d83f4376337407459ebf02dfd76cd311f2941496bedddb98bcf4abe125f364e not found: ID does not exist"
May 28 03:21:15.612866 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612828    2575 scope.go:117] "RemoveContainer" containerID="b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e"
May 28 03:21:15.613001 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.612982    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e"} err="failed to get container status \"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e\": rpc error: code = NotFound desc = could not find container \"b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e\": container with ID starting with b4402e770a58a1780215672f552af9c8f12b535d915005014a8899b9162f0f0e not found: ID does not exist"
May 28 03:21:15.613043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.613001    2575 scope.go:117] "RemoveContainer" containerID="7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51"
May 28 03:21:15.613177 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.613159    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51"} err="failed to get container status \"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51\": rpc error: code = NotFound desc = could not find container \"7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51\": container with ID starting with 7542a89b078103901e44591750c8743d81d0742234ce863e7de3f95576fcaa51 not found: ID does not exist"
May 28 03:21:15.613212 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.613177    2575 scope.go:117] "RemoveContainer" containerID="cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23"
May 28 03:21:15.613409 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.613394    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23"} err="failed to get container status \"cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23\": rpc error: code = NotFound desc = could not find container \"cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23\": container with ID starting with cb3cd5690bc271ada107301b4151009464ca24b2e775ca8c9b87fafc5e28db23 not found: ID does not exist"
May 28 03:21:15.642914 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.642889    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:21:15.643305 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643280    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="config-reloader"
May 28 03:21:15.643305 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643309    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="config-reloader"
May 28 03:21:15.643391 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643323    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy-web"
May 28 03:21:15.643391 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643332    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy-web"
May 28 03:21:15.643391 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643357    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="alertmanager"
May 28 03:21:15.643391 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643366    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="alertmanager"
May 28 03:21:15.643391 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643376    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy"
May 28 03:21:15.643391 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643384    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643392    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="prom-label-proxy"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643400    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="prom-label-proxy"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643413    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy-metric"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643421    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy-metric"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643431    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="221d0ea4-95cf-4627-ad0f-696fac17ed1a" containerName="console"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643440    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="221d0ea4-95cf-4627-ad0f-696fac17ed1a" containerName="console"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643448    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="init-config-reloader"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643458    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="init-config-reloader"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643515    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy-web"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643525    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643534    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="config-reloader"
May 28 03:21:15.643541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643542    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="kube-rbac-proxy-metric"
May 28 03:21:15.643884 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643553    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="prom-label-proxy"
May 28 03:21:15.643884 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643563    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="221d0ea4-95cf-4627-ad0f-696fac17ed1a" containerName="console"
May 28 03:21:15.643884 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.643572    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" containerName="alertmanager"
May 28 03:21:15.648594 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.648573    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.651770 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.651752    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 03:21:15.652377 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.652146    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ww5dn\""
May 28 03:21:15.652377 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.652163    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 03:21:15.652377 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.652163    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 03:21:15.652377 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.652280    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 03:21:15.652602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.652475    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 03:21:15.652602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.652525    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 03:21:15.652702 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.652604    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 03:21:15.653173 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.653159    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 03:21:15.658766 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.658727    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 03:21:15.670922 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.670904    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:21:15.710670 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710761 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710761 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4863d8fe-0780-4f88-aa34-723ce3ace6d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710761 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710721    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710863 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710863 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4863d8fe-0780-4f88-aa34-723ce3ace6d4-config-out\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710863 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4863d8fe-0780-4f88-aa34-723ce3ace6d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710961 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710961 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4863d8fe-0780-4f88-aa34-723ce3ace6d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710961 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-web-config\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710961 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4863d8fe-0780-4f88-aa34-723ce3ace6d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.710961 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.711124 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.710982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zrjc\" (UniqueName: \"kubernetes.io/projected/4863d8fe-0780-4f88-aa34-723ce3ace6d4-kube-api-access-7zrjc\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.748514 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.748491    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce085a1-f9f0-4b79-ae8f-725eb200bc6a" path="/var/lib/kubelet/pods/8ce085a1-f9f0-4b79-ae8f-725eb200bc6a/volumes"
May 28 03:21:15.812256 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812216    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4863d8fe-0780-4f88-aa34-723ce3ace6d4-config-out\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.812359 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812263    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4863d8fe-0780-4f88-aa34-723ce3ace6d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.812359 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812283    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.812359 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812307    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4863d8fe-0780-4f88-aa34-723ce3ace6d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.812600 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812572    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-web-config\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.812670 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812617    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4863d8fe-0780-4f88-aa34-723ce3ace6d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.812670 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812654    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.812772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812695    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zrjc\" (UniqueName: \"kubernetes.io/projected/4863d8fe-0780-4f88-aa34-723ce3ace6d4-kube-api-access-7zrjc\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.812772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.812752    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.813777 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.813097    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.813777 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.813137    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4863d8fe-0780-4f88-aa34-723ce3ace6d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.813777 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.813167    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4863d8fe-0780-4f88-aa34-723ce3ace6d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.813777 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.813294    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4863d8fe-0780-4f88-aa34-723ce3ace6d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.813777 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.813173    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.814106 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.813796    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.814106 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.813868    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4863d8fe-0780-4f88-aa34-723ce3ace6d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.815535 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.815120    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4863d8fe-0780-4f88-aa34-723ce3ace6d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.815535 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.815229    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4863d8fe-0780-4f88-aa34-723ce3ace6d4-config-out\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.815535 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.815342    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.815535 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.815498    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-web-config\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.815766 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.815683    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.816119 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.816100    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.816339 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.816315    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.816697 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.816678    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.816738 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.816725    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4863d8fe-0780-4f88-aa34-723ce3ace6d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.833415 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.833399    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zrjc\" (UniqueName: \"kubernetes.io/projected/4863d8fe-0780-4f88-aa34-723ce3ace6d4-kube-api-access-7zrjc\") pod \"alertmanager-main-0\" (UID: \"4863d8fe-0780-4f88-aa34-723ce3ace6d4\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:15.957489 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:15.957467    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 03:21:16.085670 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:16.085618    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 03:21:16.088193 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:21:16.088167    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4863d8fe_0780_4f88_aa34_723ce3ace6d4.slice/crio-60348a077edae23e72bc3dc029ec4cb6177be848f33bd611ecd922f59ee6d217 WatchSource:0}: Error finding container 60348a077edae23e72bc3dc029ec4cb6177be848f33bd611ecd922f59ee6d217: Status 404 returned error can't find the container with id 60348a077edae23e72bc3dc029ec4cb6177be848f33bd611ecd922f59ee6d217
May 28 03:21:16.568962 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:16.568923    2575 generic.go:358] "Generic (PLEG): container finished" podID="4863d8fe-0780-4f88-aa34-723ce3ace6d4" containerID="6a9cdc1d53e06f75fddde48ca948f18f2c3b29c5950d46d4b52801f0ed8f0013" exitCode=0
May 28 03:21:16.569354 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:16.569012    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4863d8fe-0780-4f88-aa34-723ce3ace6d4","Type":"ContainerDied","Data":"6a9cdc1d53e06f75fddde48ca948f18f2c3b29c5950d46d4b52801f0ed8f0013"}
May 28 03:21:16.569354 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:16.569044    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4863d8fe-0780-4f88-aa34-723ce3ace6d4","Type":"ContainerStarted","Data":"60348a077edae23e72bc3dc029ec4cb6177be848f33bd611ecd922f59ee6d217"}
May 28 03:21:17.576164 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:17.576130    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4863d8fe-0780-4f88-aa34-723ce3ace6d4","Type":"ContainerStarted","Data":"1202c71a2f98dc54dcf63e609b4139a33656c262e19bc926925aca3ad4e1160b"}
May 28 03:21:17.576164 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:17.576165    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4863d8fe-0780-4f88-aa34-723ce3ace6d4","Type":"ContainerStarted","Data":"50bb4f556507c0c0577823f5c874d3ebe637f6ab5652d64404543119ac3e11f9"}
May 28 03:21:17.576567 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:17.576174    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4863d8fe-0780-4f88-aa34-723ce3ace6d4","Type":"ContainerStarted","Data":"217203b450fa9d958da115d1216f2aafa9ae5346eff8b1cd38703dae394a66b1"}
May 28 03:21:17.576567 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:17.576184    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4863d8fe-0780-4f88-aa34-723ce3ace6d4","Type":"ContainerStarted","Data":"b8a82f18e2111f870e83ea971777904c912ed15107c2e7d302e47fde45cadb6c"}
May 28 03:21:17.576567 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:17.576192    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4863d8fe-0780-4f88-aa34-723ce3ace6d4","Type":"ContainerStarted","Data":"45333ae0339194be7bcf0f904adf8b77f94820f9fecec8150a381654a2c96aa7"}
May 28 03:21:17.576567 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:17.576199    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4863d8fe-0780-4f88-aa34-723ce3ace6d4","Type":"ContainerStarted","Data":"8130f121dcdc930a2b9e9bfca7265b1364bb805a541c6c7a54433bcd0976d44b"}
May 28 03:21:17.609155 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:17.609109    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.60909551 podStartE2EDuration="2.60909551s" podCreationTimestamp="2026-05-28 03:21:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:21:17.605800563 +0000 UTC m=+266.414816167" watchObservedRunningTime="2026-05-28 03:21:17.60909551 +0000 UTC m=+266.418111114"
May 28 03:21:18.090231 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.090198    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"]
May 28 03:21:18.093751 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.093731    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.097080 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.097053    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 03:21:18.097381 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.097364    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 03:21:18.097657 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.097641    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4q7ct\""
May 28 03:21:18.097729 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.097678    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 03:21:18.097729 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.097707    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 03:21:18.097829 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.097708    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 03:21:18.105315 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.105295    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 03:21:18.113939 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.113917    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"]
May 28 03:21:18.232234 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.232203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-serving-certs-ca-bundle\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.232395 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.232238    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.232395 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.232312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-metrics-client-ca\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.232395 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.232353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-federate-client-tls\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.232395 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.232390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.232519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.232414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p785\" (UniqueName: \"kubernetes.io/projected/6824f236-acaa-47eb-b5e5-809d99db1a91-kube-api-access-7p785\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.232519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.232436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-secret-telemeter-client\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.232519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.232469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-telemeter-client-tls\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.333741 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.333706    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-secret-telemeter-client\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.333741 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.333743    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-telemeter-client-tls\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.333905 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.333768    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-serving-certs-ca-bundle\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.333976 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.333954    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.334038 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.334023    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-metrics-client-ca\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.334071 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.334060    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-federate-client-tls\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.334116 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.334101    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.334161 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.334143    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p785\" (UniqueName: \"kubernetes.io/projected/6824f236-acaa-47eb-b5e5-809d99db1a91-kube-api-access-7p785\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.334577 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.334497    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-serving-certs-ca-bundle\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.334764 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.334746    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-metrics-client-ca\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.334828 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.334810    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6824f236-acaa-47eb-b5e5-809d99db1a91-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.336350 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.336326    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-federate-client-tls\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.336350 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.336334    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-secret-telemeter-client\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.336525 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.336507    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-telemeter-client-tls\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.336623 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.336603    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6824f236-acaa-47eb-b5e5-809d99db1a91-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.341814 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.341769    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p785\" (UniqueName: \"kubernetes.io/projected/6824f236-acaa-47eb-b5e5-809d99db1a91-kube-api-access-7p785\") pod \"telemeter-client-7d8cbbcd75-kglfb\" (UID: \"6824f236-acaa-47eb-b5e5-809d99db1a91\") " pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.403308 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.403288    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"
May 28 03:21:18.543558 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.543528    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb"]
May 28 03:21:18.544686 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:21:18.544662    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6824f236_acaa_47eb_b5e5_809d99db1a91.slice/crio-6fa027685cc87485be8e36a44d9380860c9dc2c4d3736fb9023d9d16f553d912 WatchSource:0}: Error finding container 6fa027685cc87485be8e36a44d9380860c9dc2c4d3736fb9023d9d16f553d912: Status 404 returned error can't find the container with id 6fa027685cc87485be8e36a44d9380860c9dc2c4d3736fb9023d9d16f553d912
May 28 03:21:18.580785 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:18.580760    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb" event={"ID":"6824f236-acaa-47eb-b5e5-809d99db1a91","Type":"ContainerStarted","Data":"6fa027685cc87485be8e36a44d9380860c9dc2c4d3736fb9023d9d16f553d912"}
May 28 03:21:21.591821 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:21.591732    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb" event={"ID":"6824f236-acaa-47eb-b5e5-809d99db1a91","Type":"ContainerStarted","Data":"d114f14ca326597717f4f8738b18be9a565ae56e51333cb601ba84ad960d02cd"}
May 28 03:21:21.591821 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:21.591775    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb" event={"ID":"6824f236-acaa-47eb-b5e5-809d99db1a91","Type":"ContainerStarted","Data":"5b230ea99cb13c2fbb1468899783a6aa9cbaa00a9fa4e3993ff0aed1ba314097"}
May 28 03:21:21.591821 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:21.591787    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb" event={"ID":"6824f236-acaa-47eb-b5e5-809d99db1a91","Type":"ContainerStarted","Data":"11f789b5da397dee4d410f232e598a7e95a17ab622275ae87c57a1e67bcaffbf"}
May 28 03:21:21.616889 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:21.616841    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d8cbbcd75-kglfb" podStartSLOduration=0.871748134 podStartE2EDuration="3.616829055s" podCreationTimestamp="2026-05-28 03:21:18 +0000 UTC" firstStartedPulling="2026-05-28 03:21:18.546824457 +0000 UTC m=+267.355840040" lastFinishedPulling="2026-05-28 03:21:21.291905376 +0000 UTC m=+270.100920961" observedRunningTime="2026-05-28 03:21:21.614629686 +0000 UTC m=+270.423645293" watchObservedRunningTime="2026-05-28 03:21:21.616829055 +0000 UTC m=+270.425844660"
May 28 03:21:22.369546 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.369508    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-679dbb78fb-5xvlx"]
May 28 03:21:22.373087 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.373068    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.405302 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.405277    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679dbb78fb-5xvlx"]
May 28 03:21:22.467088 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.467057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwd6f\" (UniqueName: \"kubernetes.io/projected/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-kube-api-access-rwd6f\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.467299 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.467101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-service-ca\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.467299 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.467128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-oauth-serving-cert\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.467299 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.467166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-trusted-ca-bundle\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.467299 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.467268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-serving-cert\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.467299 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.467300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-oauth-config\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.467478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.467327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-config\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.568347 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.568325    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-config\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.568451 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.568366    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd6f\" (UniqueName: \"kubernetes.io/projected/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-kube-api-access-rwd6f\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.568451 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.568402    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-service-ca\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.568451 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.568430    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-oauth-serving-cert\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.568601 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.568469    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-trusted-ca-bundle\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.568601 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.568528    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-serving-cert\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.568601 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.568553    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-oauth-config\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.569026 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.569001    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-config\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.569111 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.569068    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-service-ca\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.569430 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.569408    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-oauth-serving-cert\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.569517 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.569453    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-trusted-ca-bundle\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.570892 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.570866    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-oauth-config\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.571078 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.571056    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-serving-cert\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.581443 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.581426    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwd6f\" (UniqueName: \"kubernetes.io/projected/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-kube-api-access-rwd6f\") pod \"console-679dbb78fb-5xvlx\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") " pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.682380 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.682359    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:22.805152 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:22.805126    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679dbb78fb-5xvlx"]
May 28 03:21:22.807196 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:21:22.807173    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22aee539_d0ae_4377_84b5_1a44c0f7ff1a.slice/crio-8181fca3bb34c46ddc634a3ecac65dc3439898490534d771e8740757687e462a WatchSource:0}: Error finding container 8181fca3bb34c46ddc634a3ecac65dc3439898490534d771e8740757687e462a: Status 404 returned error can't find the container with id 8181fca3bb34c46ddc634a3ecac65dc3439898490534d771e8740757687e462a
May 28 03:21:23.598415 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:23.598382    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679dbb78fb-5xvlx" event={"ID":"22aee539-d0ae-4377-84b5-1a44c0f7ff1a","Type":"ContainerStarted","Data":"4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b"}
May 28 03:21:23.598415 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:23.598418    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679dbb78fb-5xvlx" event={"ID":"22aee539-d0ae-4377-84b5-1a44c0f7ff1a","Type":"ContainerStarted","Data":"8181fca3bb34c46ddc634a3ecac65dc3439898490534d771e8740757687e462a"}
May 28 03:21:23.621307 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:23.621257    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-679dbb78fb-5xvlx" podStartSLOduration=1.621224161 podStartE2EDuration="1.621224161s" podCreationTimestamp="2026-05-28 03:21:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:21:23.619654267 +0000 UTC m=+272.428669871" watchObservedRunningTime="2026-05-28 03:21:23.621224161 +0000 UTC m=+272.430239770"
May 28 03:21:32.683513 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:32.683477    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:32.683513 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:32.683510    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:32.687877 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:32.687858    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:33.631403 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:33.631377    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:21:33.682342 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:33.682308    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845b4cdc98-bfcxp"]
May 28 03:21:51.679660 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:51.679640    2575 kubelet.go:1628] "Image garbage collection succeeded"
May 28 03:21:58.704421 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:58.704383    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-845b4cdc98-bfcxp" podUID="91adc740-5edf-4ab7-8aed-724f3eeba17b" containerName="console" containerID="cri-o://75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218" gracePeriod=15
May 28 03:21:58.936978 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:58.936957    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-845b4cdc98-bfcxp_91adc740-5edf-4ab7-8aed-724f3eeba17b/console/0.log"
May 28 03:21:58.937095 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:58.937028    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:21:59.031125 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031055    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-serving-cert\") pod \"91adc740-5edf-4ab7-8aed-724f3eeba17b\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") "
May 28 03:21:59.031125 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031104    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-trusted-ca-bundle\") pod \"91adc740-5edf-4ab7-8aed-724f3eeba17b\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") "
May 28 03:21:59.031333 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031128    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-oauth-serving-cert\") pod \"91adc740-5edf-4ab7-8aed-724f3eeba17b\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") "
May 28 03:21:59.031333 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031147    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-config\") pod \"91adc740-5edf-4ab7-8aed-724f3eeba17b\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") "
May 28 03:21:59.031333 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031164    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-service-ca\") pod \"91adc740-5edf-4ab7-8aed-724f3eeba17b\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") "
May 28 03:21:59.031333 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031181    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2frf8\" (UniqueName: \"kubernetes.io/projected/91adc740-5edf-4ab7-8aed-724f3eeba17b-kube-api-access-2frf8\") pod \"91adc740-5edf-4ab7-8aed-724f3eeba17b\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") "
May 28 03:21:59.031333 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031211    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-oauth-config\") pod \"91adc740-5edf-4ab7-8aed-724f3eeba17b\" (UID: \"91adc740-5edf-4ab7-8aed-724f3eeba17b\") "
May 28 03:21:59.031730 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031702    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91adc740-5edf-4ab7-8aed-724f3eeba17b" (UID: "91adc740-5edf-4ab7-8aed-724f3eeba17b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:21:59.031852 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031720    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-service-ca" (OuterVolumeSpecName: "service-ca") pod "91adc740-5edf-4ab7-8aed-724f3eeba17b" (UID: "91adc740-5edf-4ab7-8aed-724f3eeba17b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:21:59.031852 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031726    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-config" (OuterVolumeSpecName: "console-config") pod "91adc740-5edf-4ab7-8aed-724f3eeba17b" (UID: "91adc740-5edf-4ab7-8aed-724f3eeba17b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:21:59.031852 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.031731    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91adc740-5edf-4ab7-8aed-724f3eeba17b" (UID: "91adc740-5edf-4ab7-8aed-724f3eeba17b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:21:59.033131 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.033113    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91adc740-5edf-4ab7-8aed-724f3eeba17b" (UID: "91adc740-5edf-4ab7-8aed-724f3eeba17b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:59.033274 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.033230    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91adc740-5edf-4ab7-8aed-724f3eeba17b" (UID: "91adc740-5edf-4ab7-8aed-724f3eeba17b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:21:59.033362 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.033278    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91adc740-5edf-4ab7-8aed-724f3eeba17b-kube-api-access-2frf8" (OuterVolumeSpecName: "kube-api-access-2frf8") pod "91adc740-5edf-4ab7-8aed-724f3eeba17b" (UID: "91adc740-5edf-4ab7-8aed-724f3eeba17b"). InnerVolumeSpecName "kube-api-access-2frf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:21:59.132610 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.132578    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-trusted-ca-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:59.132610 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.132608    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-oauth-serving-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:59.132610 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.132619    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:59.132765 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.132628    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91adc740-5edf-4ab7-8aed-724f3eeba17b-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:59.132765 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.132637    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2frf8\" (UniqueName: \"kubernetes.io/projected/91adc740-5edf-4ab7-8aed-724f3eeba17b-kube-api-access-2frf8\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:59.132765 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.132646    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-oauth-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:59.132765 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.132654    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91adc740-5edf-4ab7-8aed-724f3eeba17b-console-serving-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:21:59.706999 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.706978    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-845b4cdc98-bfcxp_91adc740-5edf-4ab7-8aed-724f3eeba17b/console/0.log"
May 28 03:21:59.707459 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.707015    2575 generic.go:358] "Generic (PLEG): container finished" podID="91adc740-5edf-4ab7-8aed-724f3eeba17b" containerID="75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218" exitCode=2
May 28 03:21:59.707459 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.707042    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b4cdc98-bfcxp" event={"ID":"91adc740-5edf-4ab7-8aed-724f3eeba17b","Type":"ContainerDied","Data":"75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218"}
May 28 03:21:59.707459 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.707077    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b4cdc98-bfcxp" event={"ID":"91adc740-5edf-4ab7-8aed-724f3eeba17b","Type":"ContainerDied","Data":"d1ff7b071638a6431094c3cc56622e769b175c46e07f2d243544907bf34f2a76"}
May 28 03:21:59.707459 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.707092    2575 scope.go:117] "RemoveContainer" containerID="75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218"
May 28 03:21:59.707459 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.707092    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b4cdc98-bfcxp"
May 28 03:21:59.714848 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.714835    2575 scope.go:117] "RemoveContainer" containerID="75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218"
May 28 03:21:59.715075 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:21:59.715058    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218\": container with ID starting with 75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218 not found: ID does not exist" containerID="75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218"
May 28 03:21:59.715128 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.715079    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218"} err="failed to get container status \"75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218\": rpc error: code = NotFound desc = could not find container \"75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218\": container with ID starting with 75bdf69e310f11ba3c5a36f7eb870ea47df905fed385729cbc25843c7183d218 not found: ID does not exist"
May 28 03:21:59.728785 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.728762    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845b4cdc98-bfcxp"]
May 28 03:21:59.731107 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.731086    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-845b4cdc98-bfcxp"]
May 28 03:21:59.748584 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:21:59.748556    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91adc740-5edf-4ab7-8aed-724f3eeba17b" path="/var/lib/kubelet/pods/91adc740-5edf-4ab7-8aed-724f3eeba17b/volumes"
May 28 03:22:33.337504 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.337465    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b47d6f9dc-nf7h9"]
May 28 03:22:33.338047 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.337927    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91adc740-5edf-4ab7-8aed-724f3eeba17b" containerName="console"
May 28 03:22:33.338047 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.337946    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="91adc740-5edf-4ab7-8aed-724f3eeba17b" containerName="console"
May 28 03:22:33.338047 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.338034    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="91adc740-5edf-4ab7-8aed-724f3eeba17b" containerName="console"
May 28 03:22:33.342060 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.342038    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.353740 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.353710    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b47d6f9dc-nf7h9"]
May 28 03:22:33.498427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.498400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-service-ca\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.498556 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.498438    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-trusted-ca-bundle\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.498556 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.498457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmgx2\" (UniqueName: \"kubernetes.io/projected/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-kube-api-access-vmgx2\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.498556 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.498534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-oauth-serving-cert\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.498556 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.498552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-config\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.498715 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.498577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-serving-cert\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.498715 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.498592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-oauth-config\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.599404 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.599319    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-serving-cert\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.599404 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.599351    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-oauth-config\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.599404 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.599377    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-service-ca\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.599677 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.599496    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-trusted-ca-bundle\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.599677 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.599525    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmgx2\" (UniqueName: \"kubernetes.io/projected/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-kube-api-access-vmgx2\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.599677 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.599575    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-oauth-serving-cert\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.599677 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.599595    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-config\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.600063 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.600042    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-service-ca\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.600286 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.600238    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-config\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.600380 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.600321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-oauth-serving-cert\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.600380 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.600368    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-trusted-ca-bundle\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.601805 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.601779    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-serving-cert\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.601896 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.601816    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-oauth-config\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.611059 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.611041    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmgx2\" (UniqueName: \"kubernetes.io/projected/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-kube-api-access-vmgx2\") pod \"console-5b47d6f9dc-nf7h9\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") " pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.651054 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.651032    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:33.777753 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.777727    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b47d6f9dc-nf7h9"]
May 28 03:22:33.779849 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:22:33.779823    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37eabe96_50fc_442a_ac4e_8b5fc3ee7ada.slice/crio-364a7ec8a0da0bed08f39f7b34388449e847c89e1e2e82bcbf204969c9702d06 WatchSource:0}: Error finding container 364a7ec8a0da0bed08f39f7b34388449e847c89e1e2e82bcbf204969c9702d06: Status 404 returned error can't find the container with id 364a7ec8a0da0bed08f39f7b34388449e847c89e1e2e82bcbf204969c9702d06
May 28 03:22:33.781548 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.781530    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 03:22:33.803852 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:33.803821    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b47d6f9dc-nf7h9" event={"ID":"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada","Type":"ContainerStarted","Data":"364a7ec8a0da0bed08f39f7b34388449e847c89e1e2e82bcbf204969c9702d06"}
May 28 03:22:34.808556 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:34.808519    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b47d6f9dc-nf7h9" event={"ID":"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada","Type":"ContainerStarted","Data":"7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce"}
May 28 03:22:34.826930 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:34.826882    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b47d6f9dc-nf7h9" podStartSLOduration=1.826870032 podStartE2EDuration="1.826870032s" podCreationTimestamp="2026-05-28 03:22:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:22:34.8255309 +0000 UTC m=+343.634546521" watchObservedRunningTime="2026-05-28 03:22:34.826870032 +0000 UTC m=+343.635885637"
May 28 03:22:43.651816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:43.651738    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:43.651816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:43.651780    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:43.655908 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:43.655884    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:43.838731 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:43.838706    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:22:43.886939 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:22:43.886912    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679dbb78fb-5xvlx"]
May 28 03:23:08.906991 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:08.906955    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-679dbb78fb-5xvlx" podUID="22aee539-d0ae-4377-84b5-1a44c0f7ff1a" containerName="console" containerID="cri-o://4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b" gracePeriod=15
May 28 03:23:09.143938 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.143917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-679dbb78fb-5xvlx_22aee539-d0ae-4377-84b5-1a44c0f7ff1a/console/0.log"
May 28 03:23:09.144056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.143987    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:23:09.170447 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170407    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-service-ca\") pod \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") "
May 28 03:23:09.170569 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170456    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-oauth-serving-cert\") pod \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") "
May 28 03:23:09.170569 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170486    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-oauth-config\") pod \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") "
May 28 03:23:09.170569 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170516    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-config\") pod \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") "
May 28 03:23:09.170569 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170558    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-serving-cert\") pod \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") "
May 28 03:23:09.170773 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170587    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-trusted-ca-bundle\") pod \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") "
May 28 03:23:09.170824 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170771    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "22aee539-d0ae-4377-84b5-1a44c0f7ff1a" (UID: "22aee539-d0ae-4377-84b5-1a44c0f7ff1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:23:09.170877 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170821    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwd6f\" (UniqueName: \"kubernetes.io/projected/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-kube-api-access-rwd6f\") pod \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\" (UID: \"22aee539-d0ae-4377-84b5-1a44c0f7ff1a\") "
May 28 03:23:09.171216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.170951    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "22aee539-d0ae-4377-84b5-1a44c0f7ff1a" (UID: "22aee539-d0ae-4377-84b5-1a44c0f7ff1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:23:09.171216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.171048    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "22aee539-d0ae-4377-84b5-1a44c0f7ff1a" (UID: "22aee539-d0ae-4377-84b5-1a44c0f7ff1a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:23:09.171216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.171130    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-config" (OuterVolumeSpecName: "console-config") pod "22aee539-d0ae-4377-84b5-1a44c0f7ff1a" (UID: "22aee539-d0ae-4377-84b5-1a44c0f7ff1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:23:09.171216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.171165    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:23:09.171216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.171182    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-oauth-serving-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:23:09.171216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.171196    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-trusted-ca-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:23:09.173380 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.173347    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "22aee539-d0ae-4377-84b5-1a44c0f7ff1a" (UID: "22aee539-d0ae-4377-84b5-1a44c0f7ff1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:23:09.173565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.173539    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-kube-api-access-rwd6f" (OuterVolumeSpecName: "kube-api-access-rwd6f") pod "22aee539-d0ae-4377-84b5-1a44c0f7ff1a" (UID: "22aee539-d0ae-4377-84b5-1a44c0f7ff1a"). InnerVolumeSpecName "kube-api-access-rwd6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:23:09.173641 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.173616    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "22aee539-d0ae-4377-84b5-1a44c0f7ff1a" (UID: "22aee539-d0ae-4377-84b5-1a44c0f7ff1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:23:09.272536 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.272513    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwd6f\" (UniqueName: \"kubernetes.io/projected/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-kube-api-access-rwd6f\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:23:09.272536 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.272535    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-oauth-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:23:09.272655 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.272546    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:23:09.272655 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.272555    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22aee539-d0ae-4377-84b5-1a44c0f7ff1a-console-serving-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:23:09.912518 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.912493    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-679dbb78fb-5xvlx_22aee539-d0ae-4377-84b5-1a44c0f7ff1a/console/0.log"
May 28 03:23:09.912928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.912529    2575 generic.go:358] "Generic (PLEG): container finished" podID="22aee539-d0ae-4377-84b5-1a44c0f7ff1a" containerID="4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b" exitCode=2
May 28 03:23:09.912928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.912564    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679dbb78fb-5xvlx" event={"ID":"22aee539-d0ae-4377-84b5-1a44c0f7ff1a","Type":"ContainerDied","Data":"4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b"}
May 28 03:23:09.912928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.912591    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679dbb78fb-5xvlx"
May 28 03:23:09.912928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.912604    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679dbb78fb-5xvlx" event={"ID":"22aee539-d0ae-4377-84b5-1a44c0f7ff1a","Type":"ContainerDied","Data":"8181fca3bb34c46ddc634a3ecac65dc3439898490534d771e8740757687e462a"}
May 28 03:23:09.912928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.912620    2575 scope.go:117] "RemoveContainer" containerID="4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b"
May 28 03:23:09.919998 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.919979    2575 scope.go:117] "RemoveContainer" containerID="4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b"
May 28 03:23:09.920253 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:23:09.920226    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b\": container with ID starting with 4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b not found: ID does not exist" containerID="4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b"
May 28 03:23:09.920293 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.920262    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b"} err="failed to get container status \"4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b\": rpc error: code = NotFound desc = could not find container \"4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b\": container with ID starting with 4c8690677fe0fa23a53ee7bc07b625ed7ee09def888dd9f64251b72d1e4e237b not found: ID does not exist"
May 28 03:23:09.946374 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.946351    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679dbb78fb-5xvlx"]
May 28 03:23:09.957296 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:09.957274    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-679dbb78fb-5xvlx"]
May 28 03:23:11.562132 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.562103    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8flcl"]
May 28 03:23:11.562504 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.562420    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22aee539-d0ae-4377-84b5-1a44c0f7ff1a" containerName="console"
May 28 03:23:11.562504 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.562433    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="22aee539-d0ae-4377-84b5-1a44c0f7ff1a" containerName="console"
May 28 03:23:11.562504 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.562488    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="22aee539-d0ae-4377-84b5-1a44c0f7ff1a" containerName="console"
May 28 03:23:11.566570 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.566554    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.569359 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.569333    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 03:23:11.576824 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.576800    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8flcl"]
May 28 03:23:11.592951 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.592928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02041b89-775a-421d-bd11-5966795bcf39-dbus\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.593042 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.592961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02041b89-775a-421d-bd11-5966795bcf39-original-pull-secret\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.593042 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.593018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02041b89-775a-421d-bd11-5966795bcf39-kubelet-config\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.694261 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.694222    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02041b89-775a-421d-bd11-5966795bcf39-dbus\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.694360 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.694276    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02041b89-775a-421d-bd11-5966795bcf39-original-pull-secret\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.694360 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.694314    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02041b89-775a-421d-bd11-5966795bcf39-kubelet-config\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.694440 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.694361    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02041b89-775a-421d-bd11-5966795bcf39-dbus\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.694440 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.694374    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02041b89-775a-421d-bd11-5966795bcf39-kubelet-config\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.696434 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.696415    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02041b89-775a-421d-bd11-5966795bcf39-original-pull-secret\") pod \"global-pull-secret-syncer-8flcl\" (UID: \"02041b89-775a-421d-bd11-5966795bcf39\") " pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.748328 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.748305    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22aee539-d0ae-4377-84b5-1a44c0f7ff1a" path="/var/lib/kubelet/pods/22aee539-d0ae-4377-84b5-1a44c0f7ff1a/volumes"
May 28 03:23:11.877140 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.877079    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8flcl"
May 28 03:23:11.995640 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:11.995615    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8flcl"]
May 28 03:23:11.998146 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:23:11.998118    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02041b89_775a_421d_bd11_5966795bcf39.slice/crio-396217a6f2e73914d979db55644343041684daeb7b87e4a1ad66ff488fdeaeec WatchSource:0}: Error finding container 396217a6f2e73914d979db55644343041684daeb7b87e4a1ad66ff488fdeaeec: Status 404 returned error can't find the container with id 396217a6f2e73914d979db55644343041684daeb7b87e4a1ad66ff488fdeaeec
May 28 03:23:12.924403 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:12.924368    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8flcl" event={"ID":"02041b89-775a-421d-bd11-5966795bcf39","Type":"ContainerStarted","Data":"396217a6f2e73914d979db55644343041684daeb7b87e4a1ad66ff488fdeaeec"}
May 28 03:23:16.938060 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:16.938016    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8flcl" event={"ID":"02041b89-775a-421d-bd11-5966795bcf39","Type":"ContainerStarted","Data":"7701ef77f6869abe84199d611ef803bcc583c2e2342d9382e9ebfc9506e0229b"}
May 28 03:23:16.959969 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:16.959920    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8flcl" podStartSLOduration=1.982317946 podStartE2EDuration="5.959908355s" podCreationTimestamp="2026-05-28 03:23:11 +0000 UTC" firstStartedPulling="2026-05-28 03:23:11.9996487 +0000 UTC m=+380.808664283" lastFinishedPulling="2026-05-28 03:23:15.977239085 +0000 UTC m=+384.786254692" observedRunningTime="2026-05-28 03:23:16.958761102 +0000 UTC m=+385.767776708" watchObservedRunningTime="2026-05-28 03:23:16.959908355 +0000 UTC m=+385.768923959"
May 28 03:23:48.390542 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.390509    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"]
May 28 03:23:48.393145 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.393125    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.396015 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.395991    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 03:23:48.396015 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.396000    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zvp7c\""
May 28 03:23:48.396015 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.395991    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 03:23:48.404876 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.404855    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"]
May 28 03:23:48.486472 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.486449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.486565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.486479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8b95\" (UniqueName: \"kubernetes.io/projected/f21de6e8-5ec1-4135-a483-741f2dd3f421-kube-api-access-r8b95\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.486565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.486513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.587740 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.587707    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.587823 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.587751    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8b95\" (UniqueName: \"kubernetes.io/projected/f21de6e8-5ec1-4135-a483-741f2dd3f421-kube-api-access-r8b95\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.587823 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.587793    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.588064 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.588047    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.588133 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.588109    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.596284 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.596261    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8b95\" (UniqueName: \"kubernetes.io/projected/f21de6e8-5ec1-4135-a483-741f2dd3f421-kube-api-access-r8b95\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.701485 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.701469    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:23:48.820631 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:48.820599    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"]
May 28 03:23:48.824133 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:23:48.824103    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21de6e8_5ec1_4135_a483_741f2dd3f421.slice/crio-29d81e6fc729879b0061db6c02a5696dd1fdda7a232ca1ee4a459a08ed8732f0 WatchSource:0}: Error finding container 29d81e6fc729879b0061db6c02a5696dd1fdda7a232ca1ee4a459a08ed8732f0: Status 404 returned error can't find the container with id 29d81e6fc729879b0061db6c02a5696dd1fdda7a232ca1ee4a459a08ed8732f0
May 28 03:23:49.028979 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:49.028901    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv" event={"ID":"f21de6e8-5ec1-4135-a483-741f2dd3f421","Type":"ContainerStarted","Data":"29d81e6fc729879b0061db6c02a5696dd1fdda7a232ca1ee4a459a08ed8732f0"}
May 28 03:23:55.049256 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:55.049218    2575 generic.go:358] "Generic (PLEG): container finished" podID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerID="58d011d6a4e00d9a0fb43eb74a5a05df4446b7573fdaee3948303b6ae136e299" exitCode=0
May 28 03:23:55.049649 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:55.049309    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv" event={"ID":"f21de6e8-5ec1-4135-a483-741f2dd3f421","Type":"ContainerDied","Data":"58d011d6a4e00d9a0fb43eb74a5a05df4446b7573fdaee3948303b6ae136e299"}
May 28 03:23:58.059766 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:58.059733    2575 generic.go:358] "Generic (PLEG): container finished" podID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerID="61c78abbc163b8547a9df27e1419ab04aac50e94bc1bca8c9f73487fabc27bdb" exitCode=0
May 28 03:23:58.060199 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:23:58.059783    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv" event={"ID":"f21de6e8-5ec1-4135-a483-741f2dd3f421","Type":"ContainerDied","Data":"61c78abbc163b8547a9df27e1419ab04aac50e94bc1bca8c9f73487fabc27bdb"}
May 28 03:24:05.083812 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:05.083776    2575 generic.go:358] "Generic (PLEG): container finished" podID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerID="b7d0178ff2d312b42fa2c3c1d454d5f6aec40424780406ec0a347d4f0f039b2e" exitCode=0
May 28 03:24:05.084171 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:05.083844    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv" event={"ID":"f21de6e8-5ec1-4135-a483-741f2dd3f421","Type":"ContainerDied","Data":"b7d0178ff2d312b42fa2c3c1d454d5f6aec40424780406ec0a347d4f0f039b2e"}
May 28 03:24:06.206153 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.206124    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:24:06.234984 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.234962    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-util\") pod \"f21de6e8-5ec1-4135-a483-741f2dd3f421\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") "
May 28 03:24:06.235079 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.235020    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-bundle\") pod \"f21de6e8-5ec1-4135-a483-741f2dd3f421\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") "
May 28 03:24:06.235079 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.235055    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8b95\" (UniqueName: \"kubernetes.io/projected/f21de6e8-5ec1-4135-a483-741f2dd3f421-kube-api-access-r8b95\") pod \"f21de6e8-5ec1-4135-a483-741f2dd3f421\" (UID: \"f21de6e8-5ec1-4135-a483-741f2dd3f421\") "
May 28 03:24:06.235665 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.235643    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-bundle" (OuterVolumeSpecName: "bundle") pod "f21de6e8-5ec1-4135-a483-741f2dd3f421" (UID: "f21de6e8-5ec1-4135-a483-741f2dd3f421"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:24:06.237056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.237035    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f21de6e8-5ec1-4135-a483-741f2dd3f421-kube-api-access-r8b95" (OuterVolumeSpecName: "kube-api-access-r8b95") pod "f21de6e8-5ec1-4135-a483-741f2dd3f421" (UID: "f21de6e8-5ec1-4135-a483-741f2dd3f421"). InnerVolumeSpecName "kube-api-access-r8b95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:24:06.242706 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.242679    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-util" (OuterVolumeSpecName: "util") pod "f21de6e8-5ec1-4135-a483-741f2dd3f421" (UID: "f21de6e8-5ec1-4135-a483-741f2dd3f421"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:24:06.336557 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.336525    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:06.336557 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.336556    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8b95\" (UniqueName: \"kubernetes.io/projected/f21de6e8-5ec1-4135-a483-741f2dd3f421-kube-api-access-r8b95\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:06.336557 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:06.336566    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f21de6e8-5ec1-4135-a483-741f2dd3f421-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:07.090952 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:07.090914    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv" event={"ID":"f21de6e8-5ec1-4135-a483-741f2dd3f421","Type":"ContainerDied","Data":"29d81e6fc729879b0061db6c02a5696dd1fdda7a232ca1ee4a459a08ed8732f0"}
May 28 03:24:07.090952 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:07.090949    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29d81e6fc729879b0061db6c02a5696dd1fdda7a232ca1ee4a459a08ed8732f0"
May 28 03:24:07.091152 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:07.090958    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drvhxv"
May 28 03:24:12.027664 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.027634    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"]
May 28 03:24:12.028017 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.027935    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerName="pull"
May 28 03:24:12.028017 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.027944    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerName="pull"
May 28 03:24:12.028017 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.027964    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerName="extract"
May 28 03:24:12.028017 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.027969    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerName="extract"
May 28 03:24:12.028017 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.027978    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerName="util"
May 28 03:24:12.028017 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.027983    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerName="util"
May 28 03:24:12.028199 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.028028    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="f21de6e8-5ec1-4135-a483-741f2dd3f421" containerName="extract"
May 28 03:24:12.072421 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.072395    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"]
May 28 03:24:12.072575 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.072498    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"
May 28 03:24:12.076920 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.076899    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v5gs8\""
May 28 03:24:12.077353 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.077332    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 28 03:24:12.077545 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.077528    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 28 03:24:12.185977 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.185951    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73e580a7-3cc2-4dff-aa1a-95d1de6e982e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-t9mfv\" (UID: \"73e580a7-3cc2-4dff-aa1a-95d1de6e982e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"
May 28 03:24:12.186094 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.185993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbvft\" (UniqueName: \"kubernetes.io/projected/73e580a7-3cc2-4dff-aa1a-95d1de6e982e-kube-api-access-gbvft\") pod \"cert-manager-operator-controller-manager-54b9655956-t9mfv\" (UID: \"73e580a7-3cc2-4dff-aa1a-95d1de6e982e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"
May 28 03:24:12.286634 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.286573    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73e580a7-3cc2-4dff-aa1a-95d1de6e982e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-t9mfv\" (UID: \"73e580a7-3cc2-4dff-aa1a-95d1de6e982e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"
May 28 03:24:12.286634 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.286608    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbvft\" (UniqueName: \"kubernetes.io/projected/73e580a7-3cc2-4dff-aa1a-95d1de6e982e-kube-api-access-gbvft\") pod \"cert-manager-operator-controller-manager-54b9655956-t9mfv\" (UID: \"73e580a7-3cc2-4dff-aa1a-95d1de6e982e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"
May 28 03:24:12.286906 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.286889    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73e580a7-3cc2-4dff-aa1a-95d1de6e982e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-t9mfv\" (UID: \"73e580a7-3cc2-4dff-aa1a-95d1de6e982e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"
May 28 03:24:12.297977 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.297956    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbvft\" (UniqueName: \"kubernetes.io/projected/73e580a7-3cc2-4dff-aa1a-95d1de6e982e-kube-api-access-gbvft\") pod \"cert-manager-operator-controller-manager-54b9655956-t9mfv\" (UID: \"73e580a7-3cc2-4dff-aa1a-95d1de6e982e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"
May 28 03:24:12.381786 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.381766    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"
May 28 03:24:12.511546 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:12.511524    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv"]
May 28 03:24:12.513474 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:24:12.513446    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e580a7_3cc2_4dff_aa1a_95d1de6e982e.slice/crio-96fef1af916816707de36f90db3804b1937a629e2b3f417da73d1eea340320d9 WatchSource:0}: Error finding container 96fef1af916816707de36f90db3804b1937a629e2b3f417da73d1eea340320d9: Status 404 returned error can't find the container with id 96fef1af916816707de36f90db3804b1937a629e2b3f417da73d1eea340320d9
May 28 03:24:13.109261 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:13.109213    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv" event={"ID":"73e580a7-3cc2-4dff-aa1a-95d1de6e982e","Type":"ContainerStarted","Data":"96fef1af916816707de36f90db3804b1937a629e2b3f417da73d1eea340320d9"}
May 28 03:24:15.118102 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:15.118065    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv" event={"ID":"73e580a7-3cc2-4dff-aa1a-95d1de6e982e","Type":"ContainerStarted","Data":"cb0ab161c1d37c983a64c9aae758470a2356556f5d81c7caddbb536bebc6e22d"}
May 28 03:24:15.141434 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:15.141385    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-t9mfv" podStartSLOduration=2.063511929 podStartE2EDuration="4.14136811s" podCreationTimestamp="2026-05-28 03:24:11 +0000 UTC" firstStartedPulling="2026-05-28 03:24:12.515782892 +0000 UTC m=+441.324798477" lastFinishedPulling="2026-05-28 03:24:14.593639075 +0000 UTC m=+443.402654658" observedRunningTime="2026-05-28 03:24:15.139588097 +0000 UTC m=+443.948603703" watchObservedRunningTime="2026-05-28 03:24:15.14136811 +0000 UTC m=+443.950383716"
May 28 03:24:15.866356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:15.866319    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"]
May 28 03:24:15.889331 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:15.889305    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"]
May 28 03:24:15.889469 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:15.889435    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:15.894157 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:15.894130    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zvp7c\""
May 28 03:24:15.894321 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:15.894175    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 03:24:15.894321 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:15.894130    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 03:24:16.015514 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.015487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.015685 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.015550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.015685 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.015620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djlr9\" (UniqueName: \"kubernetes.io/projected/361f15b5-50bf-4a09-8528-9674dfe453fa-kube-api-access-djlr9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.115990 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.115962    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djlr9\" (UniqueName: \"kubernetes.io/projected/361f15b5-50bf-4a09-8528-9674dfe453fa-kube-api-access-djlr9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.116134 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.116008    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.116134 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.116058    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.116428 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.116366    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.116518 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.116458    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.136644 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.136613    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djlr9\" (UniqueName: \"kubernetes.io/projected/361f15b5-50bf-4a09-8528-9674dfe453fa-kube-api-access-djlr9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.199833 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.199807    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:16.375653 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:16.375583    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"]
May 28 03:24:16.378683 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:24:16.378649    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361f15b5_50bf_4a09_8528_9674dfe453fa.slice/crio-ce6a33b6a34056dd7f9bb8155ccc667137868d342f345a8b3446a942086182f2 WatchSource:0}: Error finding container ce6a33b6a34056dd7f9bb8155ccc667137868d342f345a8b3446a942086182f2: Status 404 returned error can't find the container with id ce6a33b6a34056dd7f9bb8155ccc667137868d342f345a8b3446a942086182f2
May 28 03:24:17.125983 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:17.125950    2575 generic.go:358] "Generic (PLEG): container finished" podID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerID="9833cb0b7aabfb10158f18a26ed4dc33527feb9c3ec17c42da37fdc78bf52265" exitCode=0
May 28 03:24:17.126156 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:17.126039    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml" event={"ID":"361f15b5-50bf-4a09-8528-9674dfe453fa","Type":"ContainerDied","Data":"9833cb0b7aabfb10158f18a26ed4dc33527feb9c3ec17c42da37fdc78bf52265"}
May 28 03:24:17.126156 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:17.126078    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml" event={"ID":"361f15b5-50bf-4a09-8528-9674dfe453fa","Type":"ContainerStarted","Data":"ce6a33b6a34056dd7f9bb8155ccc667137868d342f345a8b3446a942086182f2"}
May 28 03:24:20.138038 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:20.138004    2575 generic.go:358] "Generic (PLEG): container finished" podID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerID="ab0c26335f80be4181d0485d6739ca87302d11f8c83cc810b32d1175b555e29b" exitCode=0
May 28 03:24:20.138520 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:20.138084    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml" event={"ID":"361f15b5-50bf-4a09-8528-9674dfe453fa","Type":"ContainerDied","Data":"ab0c26335f80be4181d0485d6739ca87302d11f8c83cc810b32d1175b555e29b"}
May 28 03:24:21.111150 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.111115    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-7ts28"]
May 28 03:24:21.113547 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.113533    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28"
May 28 03:24:21.116297 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.116276    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 03:24:21.117526 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.117509    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-csxx9\""
May 28 03:24:21.117578 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.117509    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 03:24:21.126673 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.126652    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-7ts28"]
May 28 03:24:21.143099 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.143074    2575 generic.go:358] "Generic (PLEG): container finished" podID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerID="76ce7217b097d023ee59d7dd4356abe1fa26e9b64d8ac079ae4b93917299e76a" exitCode=0
May 28 03:24:21.143441 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.143117    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml" event={"ID":"361f15b5-50bf-4a09-8528-9674dfe453fa","Type":"ContainerDied","Data":"76ce7217b097d023ee59d7dd4356abe1fa26e9b64d8ac079ae4b93917299e76a"}
May 28 03:24:21.258685 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.258653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq6k7\" (UniqueName: \"kubernetes.io/projected/3ce09294-18d6-454e-a3e1-4e92b153d09d-kube-api-access-gq6k7\") pod \"cert-manager-cainjector-68b757865b-7ts28\" (UID: \"3ce09294-18d6-454e-a3e1-4e92b153d09d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28"
May 28 03:24:21.258852 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.258708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ce09294-18d6-454e-a3e1-4e92b153d09d-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-7ts28\" (UID: \"3ce09294-18d6-454e-a3e1-4e92b153d09d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28"
May 28 03:24:21.359490 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.359454    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gq6k7\" (UniqueName: \"kubernetes.io/projected/3ce09294-18d6-454e-a3e1-4e92b153d09d-kube-api-access-gq6k7\") pod \"cert-manager-cainjector-68b757865b-7ts28\" (UID: \"3ce09294-18d6-454e-a3e1-4e92b153d09d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28"
May 28 03:24:21.359653 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.359512    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ce09294-18d6-454e-a3e1-4e92b153d09d-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-7ts28\" (UID: \"3ce09294-18d6-454e-a3e1-4e92b153d09d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28"
May 28 03:24:21.371797 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.371730    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq6k7\" (UniqueName: \"kubernetes.io/projected/3ce09294-18d6-454e-a3e1-4e92b153d09d-kube-api-access-gq6k7\") pod \"cert-manager-cainjector-68b757865b-7ts28\" (UID: \"3ce09294-18d6-454e-a3e1-4e92b153d09d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28"
May 28 03:24:21.372458 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.372439    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ce09294-18d6-454e-a3e1-4e92b153d09d-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-7ts28\" (UID: \"3ce09294-18d6-454e-a3e1-4e92b153d09d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28"
May 28 03:24:21.436239 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.436215    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28"
May 28 03:24:21.560198 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:21.560173    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-7ts28"]
May 28 03:24:21.561644 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:24:21.561616    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ce09294_18d6_454e_a3e1_4e92b153d09d.slice/crio-4b3ba3a1b35f141818bb41aba96f9c3ca6e09137083d43390cc9a4ffbb2d7d5a WatchSource:0}: Error finding container 4b3ba3a1b35f141818bb41aba96f9c3ca6e09137083d43390cc9a4ffbb2d7d5a: Status 404 returned error can't find the container with id 4b3ba3a1b35f141818bb41aba96f9c3ca6e09137083d43390cc9a4ffbb2d7d5a
May 28 03:24:22.147230 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.147193    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28" event={"ID":"3ce09294-18d6-454e-a3e1-4e92b153d09d","Type":"ContainerStarted","Data":"4b3ba3a1b35f141818bb41aba96f9c3ca6e09137083d43390cc9a4ffbb2d7d5a"}
May 28 03:24:22.268356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.268330    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:22.367824 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.367791    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-bundle\") pod \"361f15b5-50bf-4a09-8528-9674dfe453fa\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") "
May 28 03:24:22.368036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.367878    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-util\") pod \"361f15b5-50bf-4a09-8528-9674dfe453fa\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") "
May 28 03:24:22.368036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.367978    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djlr9\" (UniqueName: \"kubernetes.io/projected/361f15b5-50bf-4a09-8528-9674dfe453fa-kube-api-access-djlr9\") pod \"361f15b5-50bf-4a09-8528-9674dfe453fa\" (UID: \"361f15b5-50bf-4a09-8528-9674dfe453fa\") "
May 28 03:24:22.368230 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.368200    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-bundle" (OuterVolumeSpecName: "bundle") pod "361f15b5-50bf-4a09-8528-9674dfe453fa" (UID: "361f15b5-50bf-4a09-8528-9674dfe453fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:24:22.370204 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.370179    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361f15b5-50bf-4a09-8528-9674dfe453fa-kube-api-access-djlr9" (OuterVolumeSpecName: "kube-api-access-djlr9") pod "361f15b5-50bf-4a09-8528-9674dfe453fa" (UID: "361f15b5-50bf-4a09-8528-9674dfe453fa"). InnerVolumeSpecName "kube-api-access-djlr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:24:22.373181 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.373160    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-util" (OuterVolumeSpecName: "util") pod "361f15b5-50bf-4a09-8528-9674dfe453fa" (UID: "361f15b5-50bf-4a09-8528-9674dfe453fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:24:22.469463 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.469435    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djlr9\" (UniqueName: \"kubernetes.io/projected/361f15b5-50bf-4a09-8528-9674dfe453fa-kube-api-access-djlr9\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:22.469463 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.469463    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:22.469625 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:22.469472    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/361f15b5-50bf-4a09-8528-9674dfe453fa-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:23.152924 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:23.152886    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml" event={"ID":"361f15b5-50bf-4a09-8528-9674dfe453fa","Type":"ContainerDied","Data":"ce6a33b6a34056dd7f9bb8155ccc667137868d342f345a8b3446a942086182f2"}
May 28 03:24:23.152924 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:23.152924    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce6a33b6a34056dd7f9bb8155ccc667137868d342f345a8b3446a942086182f2"
May 28 03:24:23.153386 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:23.152952    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6f6ml"
May 28 03:24:24.158002 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:24.157970    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28" event={"ID":"3ce09294-18d6-454e-a3e1-4e92b153d09d","Type":"ContainerStarted","Data":"7bb3db826d9f421a79c7f9cbf0efeab9eb0550fd9786bc69ca67dcc5dd7d8b81"}
May 28 03:24:24.182079 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:24.182031    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-7ts28" podStartSLOduration=0.834086359 podStartE2EDuration="3.18201931s" podCreationTimestamp="2026-05-28 03:24:21 +0000 UTC" firstStartedPulling="2026-05-28 03:24:21.563437936 +0000 UTC m=+450.372453524" lastFinishedPulling="2026-05-28 03:24:23.911370889 +0000 UTC m=+452.720386475" observedRunningTime="2026-05-28 03:24:24.179512666 +0000 UTC m=+452.988528272" watchObservedRunningTime="2026-05-28 03:24:24.18201931 +0000 UTC m=+452.991034913"
May 28 03:24:32.717045 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.717013    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"]
May 28 03:24:32.717437 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.717421    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerName="pull"
May 28 03:24:32.717477 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.717439    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerName="pull"
May 28 03:24:32.717477 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.717454    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerName="util"
May 28 03:24:32.717477 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.717461    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerName="util"
May 28 03:24:32.717565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.717482    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerName="extract"
May 28 03:24:32.717565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.717489    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerName="extract"
May 28 03:24:32.717565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.717546    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="361f15b5-50bf-4a09-8528-9674dfe453fa" containerName="extract"
May 28 03:24:32.719413 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.719397    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"
May 28 03:24:32.722605 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.722578    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p2rr6\""
May 28 03:24:32.722731 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.722617    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 03:24:32.722731 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.722623    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 03:24:32.730820 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.730798    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"]
May 28 03:24:32.857191 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.857161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5cda5d8-728d-487a-bb31-58e1aab51e91-tmp\") pod \"openshift-lws-operator-bfc7f696d-lz9wr\" (UID: \"e5cda5d8-728d-487a-bb31-58e1aab51e91\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"
May 28 03:24:32.857191 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.857192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj8jx\" (UniqueName: \"kubernetes.io/projected/e5cda5d8-728d-487a-bb31-58e1aab51e91-kube-api-access-hj8jx\") pod \"openshift-lws-operator-bfc7f696d-lz9wr\" (UID: \"e5cda5d8-728d-487a-bb31-58e1aab51e91\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"
May 28 03:24:32.957955 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.957912    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5cda5d8-728d-487a-bb31-58e1aab51e91-tmp\") pod \"openshift-lws-operator-bfc7f696d-lz9wr\" (UID: \"e5cda5d8-728d-487a-bb31-58e1aab51e91\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"
May 28 03:24:32.957955 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.957955    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hj8jx\" (UniqueName: \"kubernetes.io/projected/e5cda5d8-728d-487a-bb31-58e1aab51e91-kube-api-access-hj8jx\") pod \"openshift-lws-operator-bfc7f696d-lz9wr\" (UID: \"e5cda5d8-728d-487a-bb31-58e1aab51e91\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"
May 28 03:24:32.958332 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.958311    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5cda5d8-728d-487a-bb31-58e1aab51e91-tmp\") pod \"openshift-lws-operator-bfc7f696d-lz9wr\" (UID: \"e5cda5d8-728d-487a-bb31-58e1aab51e91\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"
May 28 03:24:32.968154 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:32.968102    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj8jx\" (UniqueName: \"kubernetes.io/projected/e5cda5d8-728d-487a-bb31-58e1aab51e91-kube-api-access-hj8jx\") pod \"openshift-lws-operator-bfc7f696d-lz9wr\" (UID: \"e5cda5d8-728d-487a-bb31-58e1aab51e91\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"
May 28 03:24:33.027979 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:33.027947    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"
May 28 03:24:33.174176 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:33.174152    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr"]
May 28 03:24:33.175950 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:24:33.175923    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5cda5d8_728d_487a_bb31_58e1aab51e91.slice/crio-4aa381ef7fb1732e6cfddde805ee147a41e11fdbfeeebddb9b1c0d50982311c6 WatchSource:0}: Error finding container 4aa381ef7fb1732e6cfddde805ee147a41e11fdbfeeebddb9b1c0d50982311c6: Status 404 returned error can't find the container with id 4aa381ef7fb1732e6cfddde805ee147a41e11fdbfeeebddb9b1c0d50982311c6
May 28 03:24:33.187721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:33.187694    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr" event={"ID":"e5cda5d8-728d-487a-bb31-58e1aab51e91","Type":"ContainerStarted","Data":"4aa381ef7fb1732e6cfddde805ee147a41e11fdbfeeebddb9b1c0d50982311c6"}
May 28 03:24:36.136640 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.136610    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rxrt4"]
May 28 03:24:36.139375 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.139353    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-rxrt4"
May 28 03:24:36.142264 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.142232    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9skpv\""
May 28 03:24:36.150512 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.150493    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rxrt4"]
May 28 03:24:36.287198 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.287168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c9a7cb2-521f-4bcf-a52c-edef2175cb14-bound-sa-token\") pod \"cert-manager-79c8d999ff-rxrt4\" (UID: \"1c9a7cb2-521f-4bcf-a52c-edef2175cb14\") " pod="cert-manager/cert-manager-79c8d999ff-rxrt4"
May 28 03:24:36.287366 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.287268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6s2s\" (UniqueName: \"kubernetes.io/projected/1c9a7cb2-521f-4bcf-a52c-edef2175cb14-kube-api-access-k6s2s\") pod \"cert-manager-79c8d999ff-rxrt4\" (UID: \"1c9a7cb2-521f-4bcf-a52c-edef2175cb14\") " pod="cert-manager/cert-manager-79c8d999ff-rxrt4"
May 28 03:24:36.388547 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.388483    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6s2s\" (UniqueName: \"kubernetes.io/projected/1c9a7cb2-521f-4bcf-a52c-edef2175cb14-kube-api-access-k6s2s\") pod \"cert-manager-79c8d999ff-rxrt4\" (UID: \"1c9a7cb2-521f-4bcf-a52c-edef2175cb14\") " pod="cert-manager/cert-manager-79c8d999ff-rxrt4"
May 28 03:24:36.388743 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.388625    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c9a7cb2-521f-4bcf-a52c-edef2175cb14-bound-sa-token\") pod \"cert-manager-79c8d999ff-rxrt4\" (UID: \"1c9a7cb2-521f-4bcf-a52c-edef2175cb14\") " pod="cert-manager/cert-manager-79c8d999ff-rxrt4"
May 28 03:24:36.397475 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.397449    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c9a7cb2-521f-4bcf-a52c-edef2175cb14-bound-sa-token\") pod \"cert-manager-79c8d999ff-rxrt4\" (UID: \"1c9a7cb2-521f-4bcf-a52c-edef2175cb14\") " pod="cert-manager/cert-manager-79c8d999ff-rxrt4"
May 28 03:24:36.397605 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.397584    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6s2s\" (UniqueName: \"kubernetes.io/projected/1c9a7cb2-521f-4bcf-a52c-edef2175cb14-kube-api-access-k6s2s\") pod \"cert-manager-79c8d999ff-rxrt4\" (UID: \"1c9a7cb2-521f-4bcf-a52c-edef2175cb14\") " pod="cert-manager/cert-manager-79c8d999ff-rxrt4"
May 28 03:24:36.451533 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.451501    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-rxrt4"
May 28 03:24:36.582582 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:36.582559    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rxrt4"]
May 28 03:24:36.584866 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:24:36.584836    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c9a7cb2_521f_4bcf_a52c_edef2175cb14.slice/crio-8fe8a8173ad63fb47c1e394296f4c1218530afbc52a5ec38e4d4764bf43d99aa WatchSource:0}: Error finding container 8fe8a8173ad63fb47c1e394296f4c1218530afbc52a5ec38e4d4764bf43d99aa: Status 404 returned error can't find the container with id 8fe8a8173ad63fb47c1e394296f4c1218530afbc52a5ec38e4d4764bf43d99aa
May 28 03:24:37.203027 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:37.202989    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr" event={"ID":"e5cda5d8-728d-487a-bb31-58e1aab51e91","Type":"ContainerStarted","Data":"1919ddd37276c86f6d073eebded4473934e17b963a2915a03bf422767845dbfb"}
May 28 03:24:37.204308 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:37.204285    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-rxrt4" event={"ID":"1c9a7cb2-521f-4bcf-a52c-edef2175cb14","Type":"ContainerStarted","Data":"fe63f7af9347ebe4cca40721f279483dfd1eb6b9136f42e6c665696a57ec0837"}
May 28 03:24:37.204404 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:37.204315    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-rxrt4" event={"ID":"1c9a7cb2-521f-4bcf-a52c-edef2175cb14","Type":"ContainerStarted","Data":"8fe8a8173ad63fb47c1e394296f4c1218530afbc52a5ec38e4d4764bf43d99aa"}
May 28 03:24:37.222542 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:37.222506    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lz9wr" podStartSLOduration=2.084243054 podStartE2EDuration="5.222493934s" podCreationTimestamp="2026-05-28 03:24:32 +0000 UTC" firstStartedPulling="2026-05-28 03:24:33.17748437 +0000 UTC m=+461.986499954" lastFinishedPulling="2026-05-28 03:24:36.315735246 +0000 UTC m=+465.124750834" observedRunningTime="2026-05-28 03:24:37.221595269 +0000 UTC m=+466.030610888" watchObservedRunningTime="2026-05-28 03:24:37.222493934 +0000 UTC m=+466.031509539"
May 28 03:24:37.243995 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:37.243954    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-rxrt4" podStartSLOduration=1.2439408809999999 podStartE2EDuration="1.243940881s" podCreationTimestamp="2026-05-28 03:24:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:24:37.243746501 +0000 UTC m=+466.052762108" watchObservedRunningTime="2026-05-28 03:24:37.243940881 +0000 UTC m=+466.052956485"
May 28 03:24:40.235670 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.235637    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"]
May 28 03:24:40.239239 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.239220    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.241949 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.241924    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 03:24:40.242190 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.242174    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 03:24:40.242302 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.242286    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zvp7c\""
May 28 03:24:40.247058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.246980    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"]
May 28 03:24:40.419382 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.419347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8z9k\" (UniqueName: \"kubernetes.io/projected/577809ea-8c2a-4e46-b587-4d401d9ce0a6-kube-api-access-s8z9k\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.419503 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.419396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.419503 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.419484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.520637 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.520572    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.520637 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.520612    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8z9k\" (UniqueName: \"kubernetes.io/projected/577809ea-8c2a-4e46-b587-4d401d9ce0a6-kube-api-access-s8z9k\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.520811 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.520642    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.520978 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.520958    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.520978 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.520971    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.529361 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.529338    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8z9k\" (UniqueName: \"kubernetes.io/projected/577809ea-8c2a-4e46-b587-4d401d9ce0a6-kube-api-access-s8z9k\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.549310 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.549293    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:40.674778 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:40.674748    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"]
May 28 03:24:40.676556 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:24:40.676533    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577809ea_8c2a_4e46_b587_4d401d9ce0a6.slice/crio-2c7cd89ab80bad71ffdba6dfa7153ec93826ca4ffa72d2b3abb1925739f6a7f4 WatchSource:0}: Error finding container 2c7cd89ab80bad71ffdba6dfa7153ec93826ca4ffa72d2b3abb1925739f6a7f4: Status 404 returned error can't find the container with id 2c7cd89ab80bad71ffdba6dfa7153ec93826ca4ffa72d2b3abb1925739f6a7f4
May 28 03:24:41.221319 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:41.221283    2575 generic.go:358] "Generic (PLEG): container finished" podID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerID="39b3d73ce4e84ffc1e4e995fe9a895a862962e0b6de559fafb38d38ce885492e" exitCode=0
May 28 03:24:41.221461 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:41.221334    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6" event={"ID":"577809ea-8c2a-4e46-b587-4d401d9ce0a6","Type":"ContainerDied","Data":"39b3d73ce4e84ffc1e4e995fe9a895a862962e0b6de559fafb38d38ce885492e"}
May 28 03:24:41.221461 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:41.221359    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6" event={"ID":"577809ea-8c2a-4e46-b587-4d401d9ce0a6","Type":"ContainerStarted","Data":"2c7cd89ab80bad71ffdba6dfa7153ec93826ca4ffa72d2b3abb1925739f6a7f4"}
May 28 03:24:42.226608 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:42.226565    2575 generic.go:358] "Generic (PLEG): container finished" podID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerID="c96648e4b5c526f3229524c750b953de44633074533129904a2427f5fe7ec4bd" exitCode=0
May 28 03:24:42.226971 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:42.226662    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6" event={"ID":"577809ea-8c2a-4e46-b587-4d401d9ce0a6","Type":"ContainerDied","Data":"c96648e4b5c526f3229524c750b953de44633074533129904a2427f5fe7ec4bd"}
May 28 03:24:43.235405 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:43.235362    2575 generic.go:358] "Generic (PLEG): container finished" podID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerID="0a619b16c5d67dc49fa07d2555a0f2a40b200119cbd1cece929db2427b0f346e" exitCode=0
May 28 03:24:43.235776 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:43.235414    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6" event={"ID":"577809ea-8c2a-4e46-b587-4d401d9ce0a6","Type":"ContainerDied","Data":"0a619b16c5d67dc49fa07d2555a0f2a40b200119cbd1cece929db2427b0f346e"}
May 28 03:24:44.358589 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.358566    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:44.555515 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.555449    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8z9k\" (UniqueName: \"kubernetes.io/projected/577809ea-8c2a-4e46-b587-4d401d9ce0a6-kube-api-access-s8z9k\") pod \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") "
May 28 03:24:44.555515 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.555497    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-util\") pod \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") "
May 28 03:24:44.555679 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.555529    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-bundle\") pod \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\" (UID: \"577809ea-8c2a-4e46-b587-4d401d9ce0a6\") "
May 28 03:24:44.556354 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.556323    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-bundle" (OuterVolumeSpecName: "bundle") pod "577809ea-8c2a-4e46-b587-4d401d9ce0a6" (UID: "577809ea-8c2a-4e46-b587-4d401d9ce0a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:24:44.557283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.557260    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577809ea-8c2a-4e46-b587-4d401d9ce0a6-kube-api-access-s8z9k" (OuterVolumeSpecName: "kube-api-access-s8z9k") pod "577809ea-8c2a-4e46-b587-4d401d9ce0a6" (UID: "577809ea-8c2a-4e46-b587-4d401d9ce0a6"). InnerVolumeSpecName "kube-api-access-s8z9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:24:44.563672 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.563650    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-util" (OuterVolumeSpecName: "util") pod "577809ea-8c2a-4e46-b587-4d401d9ce0a6" (UID: "577809ea-8c2a-4e46-b587-4d401d9ce0a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:24:44.656519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.656499    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8z9k\" (UniqueName: \"kubernetes.io/projected/577809ea-8c2a-4e46-b587-4d401d9ce0a6-kube-api-access-s8z9k\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:44.656519 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.656518    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:44.656622 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:44.656528    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577809ea-8c2a-4e46-b587-4d401d9ce0a6-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:45.245410 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:45.245380    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6" event={"ID":"577809ea-8c2a-4e46-b587-4d401d9ce0a6","Type":"ContainerDied","Data":"2c7cd89ab80bad71ffdba6dfa7153ec93826ca4ffa72d2b3abb1925739f6a7f4"}
May 28 03:24:45.245410 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:45.245414    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c7cd89ab80bad71ffdba6dfa7153ec93826ca4ffa72d2b3abb1925739f6a7f4"
May 28 03:24:45.245613 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:45.245393    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5xv7t6"
May 28 03:24:50.144338 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.144301    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"]
May 28 03:24:50.144721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.144638    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerName="util"
May 28 03:24:50.144721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.144648    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerName="util"
May 28 03:24:50.144721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.144658    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerName="extract"
May 28 03:24:50.144721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.144665    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerName="extract"
May 28 03:24:50.144721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.144679    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerName="pull"
May 28 03:24:50.144721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.144684    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerName="pull"
May 28 03:24:50.144895 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.144746    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="577809ea-8c2a-4e46-b587-4d401d9ce0a6" containerName="extract"
May 28 03:24:50.150557 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.150534    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.154577 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.154551    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 03:24:50.154577 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.154569    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 03:24:50.155831 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.155813    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zvp7c\""
May 28 03:24:50.160484 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.160465    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"]
May 28 03:24:50.198463 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.198427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgzkr\" (UniqueName: \"kubernetes.io/projected/a49cc841-01bf-46e8-a036-cdb96c606615-kube-api-access-mgzkr\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.198603 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.198496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.198603 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.198536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.299870 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.299824    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.300051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.299880    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.300051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.299945    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgzkr\" (UniqueName: \"kubernetes.io/projected/a49cc841-01bf-46e8-a036-cdb96c606615-kube-api-access-mgzkr\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.300225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.300203    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.300314 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.300223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.309510 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.309491    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgzkr\" (UniqueName: \"kubernetes.io/projected/a49cc841-01bf-46e8-a036-cdb96c606615-kube-api-access-mgzkr\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.459745 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.459715    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:50.591582 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:50.591557    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"]
May 28 03:24:50.593347 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:24:50.593319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49cc841_01bf_46e8_a036_cdb96c606615.slice/crio-fb9c297b6c559187dc3912e4e7173acc1d0813e0487339aa9cf60f90cb357bca WatchSource:0}: Error finding container fb9c297b6c559187dc3912e4e7173acc1d0813e0487339aa9cf60f90cb357bca: Status 404 returned error can't find the container with id fb9c297b6c559187dc3912e4e7173acc1d0813e0487339aa9cf60f90cb357bca
May 28 03:24:51.273459 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:51.273415    2575 generic.go:358] "Generic (PLEG): container finished" podID="a49cc841-01bf-46e8-a036-cdb96c606615" containerID="217a61bb6cf316763e50c561f1a853bf8d9f97bd56c95dd19a9553eb8f144890" exitCode=0
May 28 03:24:51.273827 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:51.273497    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw" event={"ID":"a49cc841-01bf-46e8-a036-cdb96c606615","Type":"ContainerDied","Data":"217a61bb6cf316763e50c561f1a853bf8d9f97bd56c95dd19a9553eb8f144890"}
May 28 03:24:51.273827 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:51.273548    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw" event={"ID":"a49cc841-01bf-46e8-a036-cdb96c606615","Type":"ContainerStarted","Data":"fb9c297b6c559187dc3912e4e7173acc1d0813e0487339aa9cf60f90cb357bca"}
May 28 03:24:52.223998 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.223966    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"]
May 28 03:24:52.227197 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.227181    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.231310 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.231288    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l2nrl\""
May 28 03:24:52.231446 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.231288    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 03:24:52.231446 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.231312    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 03:24:52.231742 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.231727    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 03:24:52.231821 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.231745    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 03:24:52.249982 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.249957    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"]
May 28 03:24:52.278951 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.278923    2575 generic.go:358] "Generic (PLEG): container finished" podID="a49cc841-01bf-46e8-a036-cdb96c606615" containerID="417ab09d71af62456128dd43128db7be05ba91a80c2c32c1e9b4cc96f1f762da" exitCode=0
May 28 03:24:52.279339 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.278977    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw" event={"ID":"a49cc841-01bf-46e8-a036-cdb96c606615","Type":"ContainerDied","Data":"417ab09d71af62456128dd43128db7be05ba91a80c2c32c1e9b4cc96f1f762da"}
May 28 03:24:52.317155 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.317129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae649575-c446-4123-903a-eacdeb311582-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.317267 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.317178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae649575-c446-4123-903a-eacdeb311582-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.317346 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.317325    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gds2\" (UniqueName: \"kubernetes.io/projected/ae649575-c446-4123-903a-eacdeb311582-kube-api-access-2gds2\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.418555 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.418520    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae649575-c446-4123-903a-eacdeb311582-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.418722 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.418575    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae649575-c446-4123-903a-eacdeb311582-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.418722 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.418688    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gds2\" (UniqueName: \"kubernetes.io/projected/ae649575-c446-4123-903a-eacdeb311582-kube-api-access-2gds2\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.421083 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.421056    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae649575-c446-4123-903a-eacdeb311582-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.421178 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.421058    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae649575-c446-4123-903a-eacdeb311582-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.434130 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.434103    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gds2\" (UniqueName: \"kubernetes.io/projected/ae649575-c446-4123-903a-eacdeb311582-kube-api-access-2gds2\") pod \"opendatahub-operator-controller-manager-77cd789dcd-bnb9p\" (UID: \"ae649575-c446-4123-903a-eacdeb311582\") " pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.538413 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.538317    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:52.675263 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:52.674943    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"]
May 28 03:24:52.680571 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:24:52.677740    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae649575_c446_4123_903a_eacdeb311582.slice/crio-3051b040a48dc7dbdbb90ce5bd682105d87dfca7d1991ac8a304c19386340bc0 WatchSource:0}: Error finding container 3051b040a48dc7dbdbb90ce5bd682105d87dfca7d1991ac8a304c19386340bc0: Status 404 returned error can't find the container with id 3051b040a48dc7dbdbb90ce5bd682105d87dfca7d1991ac8a304c19386340bc0
May 28 03:24:53.286402 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:53.286345    2575 generic.go:358] "Generic (PLEG): container finished" podID="a49cc841-01bf-46e8-a036-cdb96c606615" containerID="c12e63f79ea66ce7f183ff674d465e7f2753b3fd8579ac97f25bbd2f2198d3f8" exitCode=0
May 28 03:24:53.286854 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:53.286478    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw" event={"ID":"a49cc841-01bf-46e8-a036-cdb96c606615","Type":"ContainerDied","Data":"c12e63f79ea66ce7f183ff674d465e7f2753b3fd8579ac97f25bbd2f2198d3f8"}
May 28 03:24:53.287920 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:53.287892    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p" event={"ID":"ae649575-c446-4123-903a-eacdeb311582","Type":"ContainerStarted","Data":"3051b040a48dc7dbdbb90ce5bd682105d87dfca7d1991ac8a304c19386340bc0"}
May 28 03:24:55.077057 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.077034    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:55.140911 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.140887    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-util\") pod \"a49cc841-01bf-46e8-a036-cdb96c606615\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") "
May 28 03:24:55.141012 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.140950    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-bundle\") pod \"a49cc841-01bf-46e8-a036-cdb96c606615\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") "
May 28 03:24:55.141012 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.140987    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgzkr\" (UniqueName: \"kubernetes.io/projected/a49cc841-01bf-46e8-a036-cdb96c606615-kube-api-access-mgzkr\") pod \"a49cc841-01bf-46e8-a036-cdb96c606615\" (UID: \"a49cc841-01bf-46e8-a036-cdb96c606615\") "
May 28 03:24:55.142266 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.142210    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-bundle" (OuterVolumeSpecName: "bundle") pod "a49cc841-01bf-46e8-a036-cdb96c606615" (UID: "a49cc841-01bf-46e8-a036-cdb96c606615"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:24:55.143039 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.143013    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49cc841-01bf-46e8-a036-cdb96c606615-kube-api-access-mgzkr" (OuterVolumeSpecName: "kube-api-access-mgzkr") pod "a49cc841-01bf-46e8-a036-cdb96c606615" (UID: "a49cc841-01bf-46e8-a036-cdb96c606615"). InnerVolumeSpecName "kube-api-access-mgzkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:24:55.149756 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.149705    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-util" (OuterVolumeSpecName: "util") pod "a49cc841-01bf-46e8-a036-cdb96c606615" (UID: "a49cc841-01bf-46e8-a036-cdb96c606615"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:24:55.242643 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.242605    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:55.242643 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.242638    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a49cc841-01bf-46e8-a036-cdb96c606615-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:55.242643 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.242651    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgzkr\" (UniqueName: \"kubernetes.io/projected/a49cc841-01bf-46e8-a036-cdb96c606615-kube-api-access-mgzkr\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:24:55.302981 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.302940    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw" event={"ID":"a49cc841-01bf-46e8-a036-cdb96c606615","Type":"ContainerDied","Data":"fb9c297b6c559187dc3912e4e7173acc1d0813e0487339aa9cf60f90cb357bca"}
May 28 03:24:55.302981 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.302983    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb9c297b6c559187dc3912e4e7173acc1d0813e0487339aa9cf60f90cb357bca"
May 28 03:24:55.303220 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.302987    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9ww7kw"
May 28 03:24:55.304590 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.304560    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p" event={"ID":"ae649575-c446-4123-903a-eacdeb311582","Type":"ContainerStarted","Data":"0ac92aa30fc0ec3fe936f296c62f0197e1960ef30ad206373969bd2cfcfbae31"}
May 28 03:24:55.304817 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.304795    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:24:55.378043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:24:55.377999    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p" podStartSLOduration=0.969043483 podStartE2EDuration="3.377987284s" podCreationTimestamp="2026-05-28 03:24:52 +0000 UTC" firstStartedPulling="2026-05-28 03:24:52.680651293 +0000 UTC m=+481.489666876" lastFinishedPulling="2026-05-28 03:24:55.089595089 +0000 UTC m=+483.898610677" observedRunningTime="2026-05-28 03:24:55.377233317 +0000 UTC m=+484.186248932" watchObservedRunningTime="2026-05-28 03:24:55.377987284 +0000 UTC m=+484.187002888"
May 28 03:25:06.216856 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.216823    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"]
May 28 03:25:06.217228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.217136    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49cc841-01bf-46e8-a036-cdb96c606615" containerName="util"
May 28 03:25:06.217228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.217146    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49cc841-01bf-46e8-a036-cdb96c606615" containerName="util"
May 28 03:25:06.217228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.217157    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49cc841-01bf-46e8-a036-cdb96c606615" containerName="pull"
May 28 03:25:06.217228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.217162    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49cc841-01bf-46e8-a036-cdb96c606615" containerName="pull"
May 28 03:25:06.217228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.217182    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49cc841-01bf-46e8-a036-cdb96c606615" containerName="extract"
May 28 03:25:06.217228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.217187    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49cc841-01bf-46e8-a036-cdb96c606615" containerName="extract"
May 28 03:25:06.217462 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.217257    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a49cc841-01bf-46e8-a036-cdb96c606615" containerName="extract"
May 28 03:25:06.219714 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.219697    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.222649 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.222628    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 03:25:06.224189 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.224166    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jvk9g\""
May 28 03:25:06.224189 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.224183    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 03:25:06.224343 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.224208    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 03:25:06.229004 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.228985    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"]
May 28 03:25:06.310331 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.310305    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77cd789dcd-bnb9p"
May 28 03:25:06.326838 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.326809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04375827-72ed-4a59-a1dc-d700a5dad4d5-metrics-cert\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.326974 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.326848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4cw\" (UniqueName: \"kubernetes.io/projected/04375827-72ed-4a59-a1dc-d700a5dad4d5-kube-api-access-mz4cw\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.326974 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.326915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04375827-72ed-4a59-a1dc-d700a5dad4d5-cert\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.326974 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.326949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04375827-72ed-4a59-a1dc-d700a5dad4d5-manager-config\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.427621 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.427591    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04375827-72ed-4a59-a1dc-d700a5dad4d5-metrics-cert\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.427621 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.427624    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4cw\" (UniqueName: \"kubernetes.io/projected/04375827-72ed-4a59-a1dc-d700a5dad4d5-kube-api-access-mz4cw\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.427851 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.427761    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04375827-72ed-4a59-a1dc-d700a5dad4d5-cert\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.427851 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.427801    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04375827-72ed-4a59-a1dc-d700a5dad4d5-manager-config\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.428417 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.428396    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04375827-72ed-4a59-a1dc-d700a5dad4d5-manager-config\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.429971 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.429945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04375827-72ed-4a59-a1dc-d700a5dad4d5-metrics-cert\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.430049 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.430023    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04375827-72ed-4a59-a1dc-d700a5dad4d5-cert\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.437674 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.437649    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4cw\" (UniqueName: \"kubernetes.io/projected/04375827-72ed-4a59-a1dc-d700a5dad4d5-kube-api-access-mz4cw\") pod \"lws-controller-manager-8546f974ff-x5cws\" (UID: \"04375827-72ed-4a59-a1dc-d700a5dad4d5\") " pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.530548 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.530487    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:06.662271 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:06.662218    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"]
May 28 03:25:06.664114 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:25:06.664088    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04375827_72ed_4a59_a1dc_d700a5dad4d5.slice/crio-ee100e347d4b799cd471e50e411f791a6c40f867e923bf2d31af1feb228df45b WatchSource:0}: Error finding container ee100e347d4b799cd471e50e411f791a6c40f867e923bf2d31af1feb228df45b: Status 404 returned error can't find the container with id ee100e347d4b799cd471e50e411f791a6c40f867e923bf2d31af1feb228df45b
May 28 03:25:07.345825 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:07.345790    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws" event={"ID":"04375827-72ed-4a59-a1dc-d700a5dad4d5","Type":"ContainerStarted","Data":"ee100e347d4b799cd471e50e411f791a6c40f867e923bf2d31af1feb228df45b"}
May 28 03:25:09.047928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.047895    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"]
May 28 03:25:09.050471 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.050452    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.054994 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.054974    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 03:25:09.055429 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.055412    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zvp7c\""
May 28 03:25:09.055834 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.055773    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 03:25:09.063268 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.063228    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"]
May 28 03:25:09.148889 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.148859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z4nm\" (UniqueName: \"kubernetes.io/projected/26fa400f-5586-47e8-bdb0-c9c3032b81a0-kube-api-access-5z4nm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.149017 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.148911    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.149084 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.149025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.250376 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.250352    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.250462 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.250395    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.250462 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.250451    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z4nm\" (UniqueName: \"kubernetes.io/projected/26fa400f-5586-47e8-bdb0-c9c3032b81a0-kube-api-access-5z4nm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.250698 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.250680    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.250768 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.250722    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.265145 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.265121    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z4nm\" (UniqueName: \"kubernetes.io/projected/26fa400f-5586-47e8-bdb0-c9c3032b81a0-kube-api-access-5z4nm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.355672 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.355616    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws" event={"ID":"04375827-72ed-4a59-a1dc-d700a5dad4d5","Type":"ContainerStarted","Data":"66cc2478d86fd9605c663f8b62741f66b21e9a3cf3bd2b064c47ba8701a71722"}
May 28 03:25:09.355766 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.355737    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:09.359951 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.359934    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:09.385268 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.385209    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws" podStartSLOduration=1.547026265 podStartE2EDuration="3.385174391s" podCreationTimestamp="2026-05-28 03:25:06 +0000 UTC" firstStartedPulling="2026-05-28 03:25:06.665810251 +0000 UTC m=+495.474825834" lastFinishedPulling="2026-05-28 03:25:08.503958373 +0000 UTC m=+497.312973960" observedRunningTime="2026-05-28 03:25:09.382674382 +0000 UTC m=+498.191689986" watchObservedRunningTime="2026-05-28 03:25:09.385174391 +0000 UTC m=+498.194189994"
May 28 03:25:09.491339 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:09.491310    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"]
May 28 03:25:09.492820 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:25:09.492793    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fa400f_5586_47e8_bdb0_c9c3032b81a0.slice/crio-0c4774e52fd68e40cc4c74e35844c2699280aa8d5380d631053cfefa8b0cc6d8 WatchSource:0}: Error finding container 0c4774e52fd68e40cc4c74e35844c2699280aa8d5380d631053cfefa8b0cc6d8: Status 404 returned error can't find the container with id 0c4774e52fd68e40cc4c74e35844c2699280aa8d5380d631053cfefa8b0cc6d8
May 28 03:25:10.360097 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:10.360064    2575 generic.go:358] "Generic (PLEG): container finished" podID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerID="a4f840e257ffcb56dd43451af0b88db5833fe04aeacef891297d197099e9d740" exitCode=0
May 28 03:25:10.360546 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:10.360154    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s" event={"ID":"26fa400f-5586-47e8-bdb0-c9c3032b81a0","Type":"ContainerDied","Data":"a4f840e257ffcb56dd43451af0b88db5833fe04aeacef891297d197099e9d740"}
May 28 03:25:10.360546 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:10.360196    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s" event={"ID":"26fa400f-5586-47e8-bdb0-c9c3032b81a0","Type":"ContainerStarted","Data":"0c4774e52fd68e40cc4c74e35844c2699280aa8d5380d631053cfefa8b0cc6d8"}
May 28 03:25:11.364901 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:11.364816    2575 generic.go:358] "Generic (PLEG): container finished" podID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerID="170c73af23a3ec4ed570ad1d0b1b75d6f1f21c09bd04dc4320a0de06b44283ac" exitCode=0
May 28 03:25:11.365303 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:11.364900    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s" event={"ID":"26fa400f-5586-47e8-bdb0-c9c3032b81a0","Type":"ContainerDied","Data":"170c73af23a3ec4ed570ad1d0b1b75d6f1f21c09bd04dc4320a0de06b44283ac"}
May 28 03:25:12.369772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:12.369738    2575 generic.go:358] "Generic (PLEG): container finished" podID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerID="c61a63e86512689fc2aa1f90d2c0f75ea3d32c30b888efd16683da181f873658" exitCode=0
May 28 03:25:12.370200 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:12.369816    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s" event={"ID":"26fa400f-5586-47e8-bdb0-c9c3032b81a0","Type":"ContainerDied","Data":"c61a63e86512689fc2aa1f90d2c0f75ea3d32c30b888efd16683da181f873658"}
May 28 03:25:13.508565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.508542    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:13.587272 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.587223    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-util\") pod \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") "
May 28 03:25:13.587272 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.587277    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z4nm\" (UniqueName: \"kubernetes.io/projected/26fa400f-5586-47e8-bdb0-c9c3032b81a0-kube-api-access-5z4nm\") pod \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") "
May 28 03:25:13.587490 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.587336    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-bundle\") pod \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\" (UID: \"26fa400f-5586-47e8-bdb0-c9c3032b81a0\") "
May 28 03:25:13.588165 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.588137    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-bundle" (OuterVolumeSpecName: "bundle") pod "26fa400f-5586-47e8-bdb0-c9c3032b81a0" (UID: "26fa400f-5586-47e8-bdb0-c9c3032b81a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:25:13.589373 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.589349    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fa400f-5586-47e8-bdb0-c9c3032b81a0-kube-api-access-5z4nm" (OuterVolumeSpecName: "kube-api-access-5z4nm") pod "26fa400f-5586-47e8-bdb0-c9c3032b81a0" (UID: "26fa400f-5586-47e8-bdb0-c9c3032b81a0"). InnerVolumeSpecName "kube-api-access-5z4nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:25:13.595234 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.595195    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-util" (OuterVolumeSpecName: "util") pod "26fa400f-5586-47e8-bdb0-c9c3032b81a0" (UID: "26fa400f-5586-47e8-bdb0-c9c3032b81a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:25:13.688102 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.688072    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z4nm\" (UniqueName: \"kubernetes.io/projected/26fa400f-5586-47e8-bdb0-c9c3032b81a0-kube-api-access-5z4nm\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:25:13.688102 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.688099    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:25:13.688102 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:13.688108    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fa400f-5586-47e8-bdb0-c9c3032b81a0-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:25:14.378117 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:14.378081    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s" event={"ID":"26fa400f-5586-47e8-bdb0-c9c3032b81a0","Type":"ContainerDied","Data":"0c4774e52fd68e40cc4c74e35844c2699280aa8d5380d631053cfefa8b0cc6d8"}
May 28 03:25:14.378312 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:14.378132    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c4774e52fd68e40cc4c74e35844c2699280aa8d5380d631053cfefa8b0cc6d8"
May 28 03:25:14.378312 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:14.378095    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zrv5s"
May 28 03:25:20.362355 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:20.362323    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8546f974ff-x5cws"
May 28 03:25:23.519300 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.519269    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"]
May 28 03:25:23.519656 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.519589    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerName="extract"
May 28 03:25:23.519656 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.519599    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerName="extract"
May 28 03:25:23.519656 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.519607    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerName="util"
May 28 03:25:23.519656 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.519613    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerName="util"
May 28 03:25:23.519656 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.519630    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerName="pull"
May 28 03:25:23.519656 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.519635    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerName="pull"
May 28 03:25:23.519835 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.519716    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="26fa400f-5586-47e8-bdb0-c9c3032b81a0" containerName="extract"
May 28 03:25:23.524348 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.524320    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.528210 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.528185    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zvp7c\""
May 28 03:25:23.528770 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.528755    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 03:25:23.529135 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.529121    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 03:25:23.541170 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.541141    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"]
May 28 03:25:23.670070 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.670035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfvtp\" (UniqueName: \"kubernetes.io/projected/853dfae6-d9ec-407c-b84b-c083fc9dbb04-kube-api-access-pfvtp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.670070 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.670071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.670316 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.670105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.771284 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.771198    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.771416 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.771304    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfvtp\" (UniqueName: \"kubernetes.io/projected/853dfae6-d9ec-407c-b84b-c083fc9dbb04-kube-api-access-pfvtp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.771416 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.771337    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.771669 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.771647    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.771704 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.771655    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.810526 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.810494    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfvtp\" (UniqueName: \"kubernetes.io/projected/853dfae6-d9ec-407c-b84b-c083fc9dbb04-kube-api-access-pfvtp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.833152 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.833128    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:23.997766 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:23.997734    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"]
May 28 03:25:23.998816 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:25:23.998785    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853dfae6_d9ec_407c_b84b_c083fc9dbb04.slice/crio-463d42801280a9c5bf55dcc5d8562b1c842fc4d7bb81be25d3c2b5c03f87c7ff WatchSource:0}: Error finding container 463d42801280a9c5bf55dcc5d8562b1c842fc4d7bb81be25d3c2b5c03f87c7ff: Status 404 returned error can't find the container with id 463d42801280a9c5bf55dcc5d8562b1c842fc4d7bb81be25d3c2b5c03f87c7ff
May 28 03:25:24.414463 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:24.414370    2575 generic.go:358] "Generic (PLEG): container finished" podID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerID="32a92abbfde6b752bc7e837c9461e44ca70bd19d4f9ed1c7f2d4b48556909ee0" exitCode=0
May 28 03:25:24.414635 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:24.414459    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd" event={"ID":"853dfae6-d9ec-407c-b84b-c083fc9dbb04","Type":"ContainerDied","Data":"32a92abbfde6b752bc7e837c9461e44ca70bd19d4f9ed1c7f2d4b48556909ee0"}
May 28 03:25:24.414635 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:24.414502    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd" event={"ID":"853dfae6-d9ec-407c-b84b-c083fc9dbb04","Type":"ContainerStarted","Data":"463d42801280a9c5bf55dcc5d8562b1c842fc4d7bb81be25d3c2b5c03f87c7ff"}
May 28 03:25:25.420302 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:25.420269    2575 generic.go:358] "Generic (PLEG): container finished" podID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerID="8023f35949aba7d14b308f78b2840558462e7187e2d60674de83d5c9a3802a2e" exitCode=0
May 28 03:25:25.420724 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:25.420330    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd" event={"ID":"853dfae6-d9ec-407c-b84b-c083fc9dbb04","Type":"ContainerDied","Data":"8023f35949aba7d14b308f78b2840558462e7187e2d60674de83d5c9a3802a2e"}
May 28 03:25:26.426024 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:26.425979    2575 generic.go:358] "Generic (PLEG): container finished" podID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerID="cc6e0f2597fe155da1f1f3b1433f692ebb545d3ce0f02afd0dc397dd63290851" exitCode=0
May 28 03:25:26.426408 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:26.426063    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd" event={"ID":"853dfae6-d9ec-407c-b84b-c083fc9dbb04","Type":"ContainerDied","Data":"cc6e0f2597fe155da1f1f3b1433f692ebb545d3ce0f02afd0dc397dd63290851"}
May 28 03:25:27.554505 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.554482    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:27.705811 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.705753    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-util\") pod \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") "
May 28 03:25:27.705811 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.705788    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-bundle\") pod \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") "
May 28 03:25:27.705986 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.705814    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfvtp\" (UniqueName: \"kubernetes.io/projected/853dfae6-d9ec-407c-b84b-c083fc9dbb04-kube-api-access-pfvtp\") pod \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\" (UID: \"853dfae6-d9ec-407c-b84b-c083fc9dbb04\") "
May 28 03:25:27.706889 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.706863    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-bundle" (OuterVolumeSpecName: "bundle") pod "853dfae6-d9ec-407c-b84b-c083fc9dbb04" (UID: "853dfae6-d9ec-407c-b84b-c083fc9dbb04"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:25:27.707783 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.707761    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853dfae6-d9ec-407c-b84b-c083fc9dbb04-kube-api-access-pfvtp" (OuterVolumeSpecName: "kube-api-access-pfvtp") pod "853dfae6-d9ec-407c-b84b-c083fc9dbb04" (UID: "853dfae6-d9ec-407c-b84b-c083fc9dbb04"). InnerVolumeSpecName "kube-api-access-pfvtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:25:27.711611 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.711577    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-util" (OuterVolumeSpecName: "util") pod "853dfae6-d9ec-407c-b84b-c083fc9dbb04" (UID: "853dfae6-d9ec-407c-b84b-c083fc9dbb04"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:25:27.807023 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.806999    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:25:27.807023 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.807020    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/853dfae6-d9ec-407c-b84b-c083fc9dbb04-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:25:27.807134 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:27.807029    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfvtp\" (UniqueName: \"kubernetes.io/projected/853dfae6-d9ec-407c-b84b-c083fc9dbb04-kube-api-access-pfvtp\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:25:28.435190 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:28.435154    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd" event={"ID":"853dfae6-d9ec-407c-b84b-c083fc9dbb04","Type":"ContainerDied","Data":"463d42801280a9c5bf55dcc5d8562b1c842fc4d7bb81be25d3c2b5c03f87c7ff"}
May 28 03:25:28.435190 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:28.435183    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8f9pd"
May 28 03:25:28.435454 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:25:28.435187    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="463d42801280a9c5bf55dcc5d8562b1c842fc4d7bb81be25d3c2b5c03f87c7ff"
May 28 03:26:16.247225 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.247187    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"]
May 28 03:26:16.247728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.247621    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerName="pull"
May 28 03:26:16.247728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.247636    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerName="pull"
May 28 03:26:16.247728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.247651    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerName="extract"
May 28 03:26:16.247728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.247656    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerName="extract"
May 28 03:26:16.247728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.247664    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerName="util"
May 28 03:26:16.247728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.247670    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerName="util"
May 28 03:26:16.247728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.247729    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="853dfae6-d9ec-407c-b84b-c083fc9dbb04" containerName="extract"
May 28 03:26:16.250722 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.250705    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.255621 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.255600    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 03:26:16.255737 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.255648    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2m7sp\""
May 28 03:26:16.265082 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.265058    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"]
May 28 03:26:16.380101 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e97508-cf5e-4335-9a45-e436c26f5b58-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.380296 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnl7s\" (UniqueName: \"kubernetes.io/projected/59e97508-cf5e-4335-9a45-e436c26f5b58-kube-api-access-cnl7s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.380296 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.380296 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.380478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.380478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.380478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.380478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380416    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.380478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.380452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.481795 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.481766    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.481957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.481802    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.481957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.481828    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e97508-cf5e-4335-9a45-e436c26f5b58-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.481957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.481882    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnl7s\" (UniqueName: \"kubernetes.io/projected/59e97508-cf5e-4335-9a45-e436c26f5b58-kube-api-access-cnl7s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.481957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.481911    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.481957 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.481944    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.482203 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.482006    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.482203 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.482035    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.482203 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.482059    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.482366 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.482279    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.482590 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.482559    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.482710 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.482564    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.482710 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.482625    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.482710 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.482645    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e97508-cf5e-4335-9a45-e436c26f5b58-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.484296 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.484275    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.484413 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.484396    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.493580 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.493563    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e97508-cf5e-4335-9a45-e436c26f5b58-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.494520 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.494504    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnl7s\" (UniqueName: \"kubernetes.io/projected/59e97508-cf5e-4335-9a45-e436c26f5b58-kube-api-access-cnl7s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b85mn5\" (UID: \"59e97508-cf5e-4335-9a45-e436c26f5b58\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.561370 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.561313    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:16.727540 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:16.727508    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"]
May 28 03:26:16.727954 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:16.727929    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e97508_cf5e_4335_9a45_e436c26f5b58.slice/crio-daec7a65f4ce430b993fc3ca7ec06d907c638286bc30748b2765000a3f9203e9 WatchSource:0}: Error finding container daec7a65f4ce430b993fc3ca7ec06d907c638286bc30748b2765000a3f9203e9: Status 404 returned error can't find the container with id daec7a65f4ce430b993fc3ca7ec06d907c638286bc30748b2765000a3f9203e9
May 28 03:26:17.614883 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:17.614842    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5" event={"ID":"59e97508-cf5e-4335-9a45-e436c26f5b58","Type":"ContainerStarted","Data":"daec7a65f4ce430b993fc3ca7ec06d907c638286bc30748b2765000a3f9203e9"}
May 28 03:26:19.314913 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:19.314874    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 28 03:26:19.315284 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:19.314963    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 28 03:26:19.315284 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:19.315008    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 28 03:26:19.624201 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:19.624114    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5" event={"ID":"59e97508-cf5e-4335-9a45-e436c26f5b58","Type":"ContainerStarted","Data":"81a3bdea75da49bf816cec68705a49143996a86068087a33f74e708259539912"}
May 28 03:26:19.649773 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:19.649724    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5" podStartSLOduration=1.064864909 podStartE2EDuration="3.649701309s" podCreationTimestamp="2026-05-28 03:26:16 +0000 UTC" firstStartedPulling="2026-05-28 03:26:16.729817053 +0000 UTC m=+565.538832636" lastFinishedPulling="2026-05-28 03:26:19.314653449 +0000 UTC m=+568.123669036" observedRunningTime="2026-05-28 03:26:19.648537181 +0000 UTC m=+568.457552787" watchObservedRunningTime="2026-05-28 03:26:19.649701309 +0000 UTC m=+568.458716914"
May 28 03:26:20.562064 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:20.562032    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:20.566575 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:20.566551    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:20.627215 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:20.627192    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:20.628074 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:20.628057    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b85mn5"
May 28 03:26:24.867234 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.867198    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d5d9f79d-n96cs"]
May 28 03:26:24.870820 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.870800    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:24.884197 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.884174    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d5d9f79d-n96cs"]
May 28 03:26:24.958390 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.958362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-service-ca\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:24.958527 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.958395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk96q\" (UniqueName: \"kubernetes.io/projected/f929c585-2f26-4c25-907e-6aeb218f3d6d-kube-api-access-gk96q\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:24.958527 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.958422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-serving-cert\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:24.958527 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.958446    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-oauth-config\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:24.958527 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.958477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-config\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:24.958527 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.958509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-trusted-ca-bundle\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:24.958695 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:24.958531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-oauth-serving-cert\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.059728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.059699    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-serving-cert\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.059728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.059730    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-oauth-config\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.059893 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.059767    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-config\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.059893 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.059813    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-trusted-ca-bundle\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.059893 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.059841    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-oauth-serving-cert\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.060025 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.059914    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-service-ca\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.060025 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.059939    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk96q\" (UniqueName: \"kubernetes.io/projected/f929c585-2f26-4c25-907e-6aeb218f3d6d-kube-api-access-gk96q\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.060561 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.060536    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-config\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.060761 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.060735    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-oauth-serving-cert\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.060804 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.060760    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-service-ca\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.060804 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.060766    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f929c585-2f26-4c25-907e-6aeb218f3d6d-trusted-ca-bundle\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.062264 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.062225    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-oauth-config\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.062344 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.062226    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f929c585-2f26-4c25-907e-6aeb218f3d6d-console-serving-cert\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.070383 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.070366    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk96q\" (UniqueName: \"kubernetes.io/projected/f929c585-2f26-4c25-907e-6aeb218f3d6d-kube-api-access-gk96q\") pod \"console-59d5d9f79d-n96cs\" (UID: \"f929c585-2f26-4c25-907e-6aeb218f3d6d\") " pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.139181 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.139113    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"]
May 28 03:26:25.143689 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.143674    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.146604 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.146585    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lgq78\""
May 28 03:26:25.146703 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.146620    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 03:26:25.146703 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.146622    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 03:26:25.150507 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.150486    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"]
May 28 03:26:25.180047 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.180020    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:25.261964 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.261927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.262098 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.261980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ng2w\" (UniqueName: \"kubernetes.io/projected/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-kube-api-access-9ng2w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.262098 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.262037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.308902 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.308877    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d5d9f79d-n96cs"]
May 28 03:26:25.310863 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:25.310834    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf929c585_2f26_4c25_907e_6aeb218f3d6d.slice/crio-6ec62d8b2fe4517fde76ec1d18de6cce3443c09ca5e5b60ea0c9c2e7d766bd0e WatchSource:0}: Error finding container 6ec62d8b2fe4517fde76ec1d18de6cce3443c09ca5e5b60ea0c9c2e7d766bd0e: Status 404 returned error can't find the container with id 6ec62d8b2fe4517fde76ec1d18de6cce3443c09ca5e5b60ea0c9c2e7d766bd0e
May 28 03:26:25.362941 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.362923    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.362998 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.362954    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ng2w\" (UniqueName: \"kubernetes.io/projected/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-kube-api-access-9ng2w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.362998 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.362988    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.363280 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.363262    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.363332 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.363321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.372036 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.372018    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ng2w\" (UniqueName: \"kubernetes.io/projected/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-kube-api-access-9ng2w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.454129 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.454097    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:25.583204 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.583170    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"]
May 28 03:26:25.583389 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:25.583363    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77dcc6e_8d29_464d_b48f_14c01b2ce45e.slice/crio-0c3e047cba31081d63d87e32876374d6d12e136b5f50765e21b263b0b8ad4d4f WatchSource:0}: Error finding container 0c3e047cba31081d63d87e32876374d6d12e136b5f50765e21b263b0b8ad4d4f: Status 404 returned error can't find the container with id 0c3e047cba31081d63d87e32876374d6d12e136b5f50765e21b263b0b8ad4d4f
May 28 03:26:25.647693 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.647636    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5d9f79d-n96cs" event={"ID":"f929c585-2f26-4c25-907e-6aeb218f3d6d","Type":"ContainerStarted","Data":"5456f4333a3b266eb9765057423954b5567f1dafe20e5614e63a4ec62ba9cbd1"}
May 28 03:26:25.647804 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.647704    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5d9f79d-n96cs" event={"ID":"f929c585-2f26-4c25-907e-6aeb218f3d6d","Type":"ContainerStarted","Data":"6ec62d8b2fe4517fde76ec1d18de6cce3443c09ca5e5b60ea0c9c2e7d766bd0e"}
May 28 03:26:25.649101 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.649081    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r" event={"ID":"c77dcc6e-8d29-464d-b48f-14c01b2ce45e","Type":"ContainerStarted","Data":"80739ac7133c592ea367b58cb2d5f85cbc45c30f36b1462eefe269636c90c255"}
May 28 03:26:25.649188 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.649108    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r" event={"ID":"c77dcc6e-8d29-464d-b48f-14c01b2ce45e","Type":"ContainerStarted","Data":"0c3e047cba31081d63d87e32876374d6d12e136b5f50765e21b263b0b8ad4d4f"}
May 28 03:26:25.683155 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.683112    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59d5d9f79d-n96cs" podStartSLOduration=1.683098865 podStartE2EDuration="1.683098865s" podCreationTimestamp="2026-05-28 03:26:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:26:25.681708701 +0000 UTC m=+574.490724307" watchObservedRunningTime="2026-05-28 03:26:25.683098865 +0000 UTC m=+574.492114469"
May 28 03:26:25.756218 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.756143    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"]
May 28 03:26:25.759564 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.759548    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.769700 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.769682    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"]
May 28 03:26:25.868846 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.868816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.869235 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.868931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt27s\" (UniqueName: \"kubernetes.io/projected/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-kube-api-access-tt27s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.869235 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.869024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.970429 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.970395    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tt27s\" (UniqueName: \"kubernetes.io/projected/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-kube-api-access-tt27s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.970612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.970473    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.970612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.970514    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.970834 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.970812    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.970902 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.970853    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:25.980460 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:25.980435    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt27s\" (UniqueName: \"kubernetes.io/projected/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-kube-api-access-tt27s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:26.068629 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.068559    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:26.196622 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.196586    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"]
May 28 03:26:26.199553 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:26.199523    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43682a5_9dba_4423_8b3c_d5f3ef3ebef0.slice/crio-094aec4944f21d2a6fac88072fe17f718fa1a1d138aae1530b1f92a9eb0cced6 WatchSource:0}: Error finding container 094aec4944f21d2a6fac88072fe17f718fa1a1d138aae1530b1f92a9eb0cced6: Status 404 returned error can't find the container with id 094aec4944f21d2a6fac88072fe17f718fa1a1d138aae1530b1f92a9eb0cced6
May 28 03:26:26.342279 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.342215    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"]
May 28 03:26:26.345845 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.345829    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.356577 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.356549    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"]
May 28 03:26:26.475620 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.475594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.475740 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.475649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.475740 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.475719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgl8d\" (UniqueName: \"kubernetes.io/projected/92547c43-1c68-42b5-adf0-6951024cb1c9-kube-api-access-lgl8d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.576097 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.576070    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgl8d\" (UniqueName: \"kubernetes.io/projected/92547c43-1c68-42b5-adf0-6951024cb1c9-kube-api-access-lgl8d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.576214 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.576122    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.576214 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.576167    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.576514 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.576495    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.576548 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.576523    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.586222 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.586204    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgl8d\" (UniqueName: \"kubernetes.io/projected/92547c43-1c68-42b5-adf0-6951024cb1c9-kube-api-access-lgl8d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.654396 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.654332    2575 generic.go:358] "Generic (PLEG): container finished" podID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerID="8a1ebc281a195ebb19309a9296098df8d21f0353c3b72fab6449ce766c6479dd" exitCode=0
May 28 03:26:26.654510 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.654421    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l" event={"ID":"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0","Type":"ContainerDied","Data":"8a1ebc281a195ebb19309a9296098df8d21f0353c3b72fab6449ce766c6479dd"}
May 28 03:26:26.654510 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.654458    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l" event={"ID":"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0","Type":"ContainerStarted","Data":"094aec4944f21d2a6fac88072fe17f718fa1a1d138aae1530b1f92a9eb0cced6"}
May 28 03:26:26.655879 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.655860    2575 generic.go:358] "Generic (PLEG): container finished" podID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerID="80739ac7133c592ea367b58cb2d5f85cbc45c30f36b1462eefe269636c90c255" exitCode=0
May 28 03:26:26.655961 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.655942    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r" event={"ID":"c77dcc6e-8d29-464d-b48f-14c01b2ce45e","Type":"ContainerDied","Data":"80739ac7133c592ea367b58cb2d5f85cbc45c30f36b1462eefe269636c90c255"}
May 28 03:26:26.670970 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.670953    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:26.743859 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.743831    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"]
May 28 03:26:26.748959 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.748933    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.759055 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.759023    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"]
May 28 03:26:26.806887 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.806864    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"]
May 28 03:26:26.808218 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:26.808195    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92547c43_1c68_42b5_adf0_6951024cb1c9.slice/crio-490fe140bbde03ded171ebafc6fe38f7aa823317df71047f79e1113615fda29e WatchSource:0}: Error finding container 490fe140bbde03ded171ebafc6fe38f7aa823317df71047f79e1113615fda29e: Status 404 returned error can't find the container with id 490fe140bbde03ded171ebafc6fe38f7aa823317df71047f79e1113615fda29e
May 28 03:26:26.879673 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.879644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.879976 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.879865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d42g6\" (UniqueName: \"kubernetes.io/projected/2668f310-5905-4a73-aef3-8f47a60111ff-kube-api-access-d42g6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.880024 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.879985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.980935 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.980908    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d42g6\" (UniqueName: \"kubernetes.io/projected/2668f310-5905-4a73-aef3-8f47a60111ff-kube-api-access-d42g6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.981032 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.980967    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.981086 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.981031    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.981268 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.981231    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.981342 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.981325    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:26.991721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:26.991703    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d42g6\" (UniqueName: \"kubernetes.io/projected/2668f310-5905-4a73-aef3-8f47a60111ff-kube-api-access-d42g6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:27.061407 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:27.061389    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:27.189038 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:27.189013    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"]
May 28 03:26:27.190233 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:27.190204    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2668f310_5905_4a73_aef3_8f47a60111ff.slice/crio-e0033a8731a59999271d0ab4ce51fda80bbce9bd166464ac3dc8a3f43e45626e WatchSource:0}: Error finding container e0033a8731a59999271d0ab4ce51fda80bbce9bd166464ac3dc8a3f43e45626e: Status 404 returned error can't find the container with id e0033a8731a59999271d0ab4ce51fda80bbce9bd166464ac3dc8a3f43e45626e
May 28 03:26:27.661148 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:27.661122    2575 generic.go:358] "Generic (PLEG): container finished" podID="2668f310-5905-4a73-aef3-8f47a60111ff" containerID="83cf5d87ccda44f0efcf213165f316e55e1e905ef90542ed036d69526de23c37" exitCode=0
May 28 03:26:27.661281 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:27.661206    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r" event={"ID":"2668f310-5905-4a73-aef3-8f47a60111ff","Type":"ContainerDied","Data":"83cf5d87ccda44f0efcf213165f316e55e1e905ef90542ed036d69526de23c37"}
May 28 03:26:27.661281 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:27.661260    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r" event={"ID":"2668f310-5905-4a73-aef3-8f47a60111ff","Type":"ContainerStarted","Data":"e0033a8731a59999271d0ab4ce51fda80bbce9bd166464ac3dc8a3f43e45626e"}
May 28 03:26:27.662785 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:27.662766    2575 generic.go:358] "Generic (PLEG): container finished" podID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerID="8306a7921ddfe820ff391af1850abc771f6fa91909dfb1cafef9d2fd570897d8" exitCode=0
May 28 03:26:27.662875 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:27.662804    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw" event={"ID":"92547c43-1c68-42b5-adf0-6951024cb1c9","Type":"ContainerDied","Data":"8306a7921ddfe820ff391af1850abc771f6fa91909dfb1cafef9d2fd570897d8"}
May 28 03:26:27.662875 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:27.662823    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw" event={"ID":"92547c43-1c68-42b5-adf0-6951024cb1c9","Type":"ContainerStarted","Data":"490fe140bbde03ded171ebafc6fe38f7aa823317df71047f79e1113615fda29e"}
May 28 03:26:28.668322 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:28.668290    2575 generic.go:358] "Generic (PLEG): container finished" podID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerID="1794e2a19bef38f9895f730c31b6afd55dcf3e64af358052ecf3ccb1f38bbe00" exitCode=0
May 28 03:26:28.668728 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:28.668376    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r" event={"ID":"c77dcc6e-8d29-464d-b48f-14c01b2ce45e","Type":"ContainerDied","Data":"1794e2a19bef38f9895f730c31b6afd55dcf3e64af358052ecf3ccb1f38bbe00"}
May 28 03:26:28.670152 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:28.670047    2575 generic.go:358] "Generic (PLEG): container finished" podID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerID="2c57b857bfadf09a8066702baceecc04f2da961e6efdae57c144b491ecbb44a0" exitCode=0
May 28 03:26:28.670152 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:28.670136    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l" event={"ID":"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0","Type":"ContainerDied","Data":"2c57b857bfadf09a8066702baceecc04f2da961e6efdae57c144b491ecbb44a0"}
May 28 03:26:28.672077 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:28.671822    2575 generic.go:358] "Generic (PLEG): container finished" podID="2668f310-5905-4a73-aef3-8f47a60111ff" containerID="0ee2e9c02cc04802544a965edffdce1f6b13cfa46ffa7e23cd0feb383ed328dd" exitCode=0
May 28 03:26:28.672077 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:28.671911    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r" event={"ID":"2668f310-5905-4a73-aef3-8f47a60111ff","Type":"ContainerDied","Data":"0ee2e9c02cc04802544a965edffdce1f6b13cfa46ffa7e23cd0feb383ed328dd"}
May 28 03:26:28.673792 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:28.673772    2575 generic.go:358] "Generic (PLEG): container finished" podID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerID="52e01b6b107e586e6ff05827787fbb62237a3804b4ed995d7ee90eefb50f449b" exitCode=0
May 28 03:26:28.673854 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:28.673792    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw" event={"ID":"92547c43-1c68-42b5-adf0-6951024cb1c9","Type":"ContainerDied","Data":"52e01b6b107e586e6ff05827787fbb62237a3804b4ed995d7ee90eefb50f449b"}
May 28 03:26:29.679597 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:29.679565    2575 generic.go:358] "Generic (PLEG): container finished" podID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerID="704bbb9934f62c8df6085a259ca26106e7d43e1ad1edbdcff4777aa20b3f5028" exitCode=0
May 28 03:26:29.679945 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:29.679643    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw" event={"ID":"92547c43-1c68-42b5-adf0-6951024cb1c9","Type":"ContainerDied","Data":"704bbb9934f62c8df6085a259ca26106e7d43e1ad1edbdcff4777aa20b3f5028"}
May 28 03:26:29.681367 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:29.681340    2575 generic.go:358] "Generic (PLEG): container finished" podID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerID="46a70a6591a9728e3ff152f2a6d7e4d709b42e93b6c6b11df7a3192e8ef3dd91" exitCode=0
May 28 03:26:29.681494 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:29.681395    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r" event={"ID":"c77dcc6e-8d29-464d-b48f-14c01b2ce45e","Type":"ContainerDied","Data":"46a70a6591a9728e3ff152f2a6d7e4d709b42e93b6c6b11df7a3192e8ef3dd91"}
May 28 03:26:29.683013 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:29.682992    2575 generic.go:358] "Generic (PLEG): container finished" podID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerID="45864670aca10fa2947007e458746c97a64d56e7da42a27c8e1b3e43a5e0207a" exitCode=0
May 28 03:26:29.683120 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:29.683076    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l" event={"ID":"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0","Type":"ContainerDied","Data":"45864670aca10fa2947007e458746c97a64d56e7da42a27c8e1b3e43a5e0207a"}
May 28 03:26:29.684688 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:29.684667    2575 generic.go:358] "Generic (PLEG): container finished" podID="2668f310-5905-4a73-aef3-8f47a60111ff" containerID="80b2d5b9e30d787fec0e4f8e32ac2414d5e626262de8c50403a5c98c22e87e3f" exitCode=0
May 28 03:26:29.684792 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:29.684708    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r" event={"ID":"2668f310-5905-4a73-aef3-8f47a60111ff","Type":"ContainerDied","Data":"80b2d5b9e30d787fec0e4f8e32ac2414d5e626262de8c50403a5c98c22e87e3f"}
May 28 03:26:30.838805 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:30.838750    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:30.889865 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:30.889840    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:30.893130 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:30.893113    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:30.896310 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:30.896294    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:31.018068 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018002    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgl8d\" (UniqueName: \"kubernetes.io/projected/92547c43-1c68-42b5-adf0-6951024cb1c9-kube-api-access-lgl8d\") pod \"92547c43-1c68-42b5-adf0-6951024cb1c9\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") "
May 28 03:26:31.018068 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018061    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-bundle\") pod \"2668f310-5905-4a73-aef3-8f47a60111ff\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") "
May 28 03:26:31.018292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018090    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-util\") pod \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") "
May 28 03:26:31.018292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018110    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-util\") pod \"92547c43-1c68-42b5-adf0-6951024cb1c9\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") "
May 28 03:26:31.018292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018145    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ng2w\" (UniqueName: \"kubernetes.io/projected/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-kube-api-access-9ng2w\") pod \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") "
May 28 03:26:31.018292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018162    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-util\") pod \"2668f310-5905-4a73-aef3-8f47a60111ff\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") "
May 28 03:26:31.018292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018196    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-bundle\") pod \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") "
May 28 03:26:31.018292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018231    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-bundle\") pod \"92547c43-1c68-42b5-adf0-6951024cb1c9\" (UID: \"92547c43-1c68-42b5-adf0-6951024cb1c9\") "
May 28 03:26:31.018292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018283    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt27s\" (UniqueName: \"kubernetes.io/projected/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-kube-api-access-tt27s\") pod \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") "
May 28 03:26:31.018612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018311    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d42g6\" (UniqueName: \"kubernetes.io/projected/2668f310-5905-4a73-aef3-8f47a60111ff-kube-api-access-d42g6\") pod \"2668f310-5905-4a73-aef3-8f47a60111ff\" (UID: \"2668f310-5905-4a73-aef3-8f47a60111ff\") "
May 28 03:26:31.018612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018348    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-bundle\") pod \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\" (UID: \"c77dcc6e-8d29-464d-b48f-14c01b2ce45e\") "
May 28 03:26:31.018612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018371    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-util\") pod \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\" (UID: \"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0\") "
May 28 03:26:31.019012 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.018758    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-bundle" (OuterVolumeSpecName: "bundle") pod "2668f310-5905-4a73-aef3-8f47a60111ff" (UID: "2668f310-5905-4a73-aef3-8f47a60111ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:26:31.019354 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.019332    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-bundle" (OuterVolumeSpecName: "bundle") pod "a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" (UID: "a43682a5-9dba-4423-8b3c-d5f3ef3ebef0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:26:31.020195 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.020175    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-bundle" (OuterVolumeSpecName: "bundle") pod "92547c43-1c68-42b5-adf0-6951024cb1c9" (UID: "92547c43-1c68-42b5-adf0-6951024cb1c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:26:31.020940 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.020869    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-kube-api-access-9ng2w" (OuterVolumeSpecName: "kube-api-access-9ng2w") pod "c77dcc6e-8d29-464d-b48f-14c01b2ce45e" (UID: "c77dcc6e-8d29-464d-b48f-14c01b2ce45e"). InnerVolumeSpecName "kube-api-access-9ng2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:26:31.020940 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.020906    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92547c43-1c68-42b5-adf0-6951024cb1c9-kube-api-access-lgl8d" (OuterVolumeSpecName: "kube-api-access-lgl8d") pod "92547c43-1c68-42b5-adf0-6951024cb1c9" (UID: "92547c43-1c68-42b5-adf0-6951024cb1c9"). InnerVolumeSpecName "kube-api-access-lgl8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:26:31.021206 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.021182    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-kube-api-access-tt27s" (OuterVolumeSpecName: "kube-api-access-tt27s") pod "a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" (UID: "a43682a5-9dba-4423-8b3c-d5f3ef3ebef0"). InnerVolumeSpecName "kube-api-access-tt27s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:26:31.021387 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.021357    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-bundle" (OuterVolumeSpecName: "bundle") pod "c77dcc6e-8d29-464d-b48f-14c01b2ce45e" (UID: "c77dcc6e-8d29-464d-b48f-14c01b2ce45e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:26:31.022573 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.022557    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2668f310-5905-4a73-aef3-8f47a60111ff-kube-api-access-d42g6" (OuterVolumeSpecName: "kube-api-access-d42g6") pod "2668f310-5905-4a73-aef3-8f47a60111ff" (UID: "2668f310-5905-4a73-aef3-8f47a60111ff"). InnerVolumeSpecName "kube-api-access-d42g6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:26:31.025125 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.025100    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-util" (OuterVolumeSpecName: "util") pod "c77dcc6e-8d29-464d-b48f-14c01b2ce45e" (UID: "c77dcc6e-8d29-464d-b48f-14c01b2ce45e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:26:31.025295 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.025276    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-util" (OuterVolumeSpecName: "util") pod "2668f310-5905-4a73-aef3-8f47a60111ff" (UID: "2668f310-5905-4a73-aef3-8f47a60111ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:26:31.026770 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.026748    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-util" (OuterVolumeSpecName: "util") pod "92547c43-1c68-42b5-adf0-6951024cb1c9" (UID: "92547c43-1c68-42b5-adf0-6951024cb1c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:26:31.027178 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.027164    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-util" (OuterVolumeSpecName: "util") pod "a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" (UID: "a43682a5-9dba-4423-8b3c-d5f3ef3ebef0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:26:31.119280 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119236    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d42g6\" (UniqueName: \"kubernetes.io/projected/2668f310-5905-4a73-aef3-8f47a60111ff-kube-api-access-d42g6\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119284    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119294    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119303    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgl8d\" (UniqueName: \"kubernetes.io/projected/92547c43-1c68-42b5-adf0-6951024cb1c9-kube-api-access-lgl8d\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119312    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119321    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119328    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119336    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ng2w\" (UniqueName: \"kubernetes.io/projected/c77dcc6e-8d29-464d-b48f-14c01b2ce45e-kube-api-access-9ng2w\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119344    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2668f310-5905-4a73-aef3-8f47a60111ff-util\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119352    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119360    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92547c43-1c68-42b5-adf0-6951024cb1c9-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.119640 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.119368    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt27s\" (UniqueName: \"kubernetes.io/projected/a43682a5-9dba-4423-8b3c-d5f3ef3ebef0-kube-api-access-tt27s\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:26:31.694642 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.694613    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw"
May 28 03:26:31.694805 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.694619    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw" event={"ID":"92547c43-1c68-42b5-adf0-6951024cb1c9","Type":"ContainerDied","Data":"490fe140bbde03ded171ebafc6fe38f7aa823317df71047f79e1113615fda29e"}
May 28 03:26:31.694805 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.694717    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="490fe140bbde03ded171ebafc6fe38f7aa823317df71047f79e1113615fda29e"
May 28 03:26:31.696474 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.696435    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r" event={"ID":"c77dcc6e-8d29-464d-b48f-14c01b2ce45e","Type":"ContainerDied","Data":"0c3e047cba31081d63d87e32876374d6d12e136b5f50765e21b263b0b8ad4d4f"}
May 28 03:26:31.696474 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.696470    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c3e047cba31081d63d87e32876374d6d12e136b5f50765e21b263b0b8ad4d4f"
May 28 03:26:31.696655 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.696474    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r"
May 28 03:26:31.698277 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.698235    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l"
May 28 03:26:31.698277 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.698266    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l" event={"ID":"a43682a5-9dba-4423-8b3c-d5f3ef3ebef0","Type":"ContainerDied","Data":"094aec4944f21d2a6fac88072fe17f718fa1a1d138aae1530b1f92a9eb0cced6"}
May 28 03:26:31.698480 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.698295    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="094aec4944f21d2a6fac88072fe17f718fa1a1d138aae1530b1f92a9eb0cced6"
May 28 03:26:31.700103 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.700080    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r" event={"ID":"2668f310-5905-4a73-aef3-8f47a60111ff","Type":"ContainerDied","Data":"e0033a8731a59999271d0ab4ce51fda80bbce9bd166464ac3dc8a3f43e45626e"}
May 28 03:26:31.700410 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.700105    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0033a8731a59999271d0ab4ce51fda80bbce9bd166464ac3dc8a3f43e45626e"
May 28 03:26:31.700410 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:31.700186    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r"
May 28 03:26:35.181167 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:35.181128    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:35.181543 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:35.181182    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:35.185829 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:35.185807    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:35.718703 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:35.718676    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59d5d9f79d-n96cs"
May 28 03:26:35.768365 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:35.768333    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b47d6f9dc-nf7h9"]
May 28 03:26:40.282221 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282184    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"]
May 28 03:26:40.282706 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282690    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerName="util"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282708    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerName="util"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282716    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerName="pull"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282721    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerName="pull"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282728    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2668f310-5905-4a73-aef3-8f47a60111ff" containerName="extract"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282733    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2668f310-5905-4a73-aef3-8f47a60111ff" containerName="extract"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282740    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerName="pull"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282745    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerName="pull"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282753    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerName="extract"
May 28 03:26:40.282762 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282759    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerName="extract"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282770    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2668f310-5905-4a73-aef3-8f47a60111ff" containerName="pull"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282775    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2668f310-5905-4a73-aef3-8f47a60111ff" containerName="pull"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282781    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerName="extract"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282786    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerName="extract"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282798    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerName="util"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282804    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerName="util"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282809    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2668f310-5905-4a73-aef3-8f47a60111ff" containerName="util"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282814    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2668f310-5905-4a73-aef3-8f47a60111ff" containerName="util"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282820    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerName="extract"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282824    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerName="extract"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282830    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerName="pull"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282834    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerName="pull"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282842    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerName="util"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282847    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerName="util"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282895    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="92547c43-1c68-42b5-adf0-6951024cb1c9" containerName="extract"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282905    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="2668f310-5905-4a73-aef3-8f47a60111ff" containerName="extract"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282913    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a43682a5-9dba-4423-8b3c-d5f3ef3ebef0" containerName="extract"
May 28 03:26:40.283010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.282921    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c77dcc6e-8d29-464d-b48f-14c01b2ce45e" containerName="extract"
May 28 03:26:40.285820 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.285804    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"
May 28 03:26:40.289847 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.289823    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zbvgc\""
May 28 03:26:40.290069 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.290052    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 03:26:40.290825 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.290804    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 03:26:40.291077 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.291063    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 03:26:40.295316 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.295294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s68pb\" (UniqueName: \"kubernetes.io/projected/226723ed-cfc4-4b9a-a121-d141a974188d-kube-api-access-s68pb\") pod \"dns-operator-controller-manager-648d5c98bc-62j2j\" (UID: \"226723ed-cfc4-4b9a-a121-d141a974188d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"
May 28 03:26:40.298158 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.298139    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"]
May 28 03:26:40.396044 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.396014    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s68pb\" (UniqueName: \"kubernetes.io/projected/226723ed-cfc4-4b9a-a121-d141a974188d-kube-api-access-s68pb\") pod \"dns-operator-controller-manager-648d5c98bc-62j2j\" (UID: \"226723ed-cfc4-4b9a-a121-d141a974188d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"
May 28 03:26:40.405513 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.405484    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s68pb\" (UniqueName: \"kubernetes.io/projected/226723ed-cfc4-4b9a-a121-d141a974188d-kube-api-access-s68pb\") pod \"dns-operator-controller-manager-648d5c98bc-62j2j\" (UID: \"226723ed-cfc4-4b9a-a121-d141a974188d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"
May 28 03:26:40.596374 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.596284    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"
May 28 03:26:40.750635 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:40.750593    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226723ed_cfc4_4b9a_a121_d141a974188d.slice/crio-5549f03c3e0fc8d749f1886ea6f68b24914f09922b0e3b401bd56999c83a22a7 WatchSource:0}: Error finding container 5549f03c3e0fc8d749f1886ea6f68b24914f09922b0e3b401bd56999c83a22a7: Status 404 returned error can't find the container with id 5549f03c3e0fc8d749f1886ea6f68b24914f09922b0e3b401bd56999c83a22a7
May 28 03:26:40.751447 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:40.751380    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"]
May 28 03:26:41.739380 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:41.739347    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j" event={"ID":"226723ed-cfc4-4b9a-a121-d141a974188d","Type":"ContainerStarted","Data":"5549f03c3e0fc8d749f1886ea6f68b24914f09922b0e3b401bd56999c83a22a7"}
May 28 03:26:43.749062 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:43.749033    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"
May 28 03:26:43.749062 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:43.749066    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j" event={"ID":"226723ed-cfc4-4b9a-a121-d141a974188d","Type":"ContainerStarted","Data":"96b4559a696d33ff9b7fd75479aea9d76c54e75fd58f1febe138e66dceff4349"}
May 28 03:26:43.771148 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:43.771100    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j" podStartSLOduration=1.315511845 podStartE2EDuration="3.771087791s" podCreationTimestamp="2026-05-28 03:26:40 +0000 UTC" firstStartedPulling="2026-05-28 03:26:40.75282508 +0000 UTC m=+589.561840669" lastFinishedPulling="2026-05-28 03:26:43.208401027 +0000 UTC m=+592.017416615" observedRunningTime="2026-05-28 03:26:43.769141976 +0000 UTC m=+592.578157581" watchObservedRunningTime="2026-05-28 03:26:43.771087791 +0000 UTC m=+592.580103395"
May 28 03:26:44.549600 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.549560    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"]
May 28 03:26:44.553152 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.553129    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:44.556907 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.556888    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vntjn\""
May 28 03:26:44.567769 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.567751    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"]
May 28 03:26:44.636941 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.636919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqzrd\" (UniqueName: \"kubernetes.io/projected/c8cad8ef-99f3-4dc9-9053-75afde3a5391-kube-api-access-jqzrd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" (UID: \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:44.637045 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.636952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8cad8ef-99f3-4dc9-9053-75afde3a5391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" (UID: \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:44.737852 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.737827    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8cad8ef-99f3-4dc9-9053-75afde3a5391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" (UID: \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:44.737946 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.737932    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqzrd\" (UniqueName: \"kubernetes.io/projected/c8cad8ef-99f3-4dc9-9053-75afde3a5391-kube-api-access-jqzrd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" (UID: \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:44.738265 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.738226    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8cad8ef-99f3-4dc9-9053-75afde3a5391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" (UID: \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:44.751435 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.751413    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqzrd\" (UniqueName: \"kubernetes.io/projected/c8cad8ef-99f3-4dc9-9053-75afde3a5391-kube-api-access-jqzrd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" (UID: \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:44.862708 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.862658    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:44.999859 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:44.999831    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"]
May 28 03:26:45.001863 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:45.001835    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cad8ef_99f3_4dc9_9053_75afde3a5391.slice/crio-f59fcb51414adcc188a076b082b879596cceeed0154097ca66219a67d594f66e WatchSource:0}: Error finding container f59fcb51414adcc188a076b082b879596cceeed0154097ca66219a67d594f66e: Status 404 returned error can't find the container with id f59fcb51414adcc188a076b082b879596cceeed0154097ca66219a67d594f66e
May 28 03:26:45.756150 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:45.756119    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj" event={"ID":"c8cad8ef-99f3-4dc9-9053-75afde3a5391","Type":"ContainerStarted","Data":"f59fcb51414adcc188a076b082b879596cceeed0154097ca66219a67d594f66e"}
May 28 03:26:46.500594 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.500553    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"]
May 28 03:26:46.504195 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.504173    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:26:46.507941 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.507919    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-x88fg\""
May 28 03:26:46.517784 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.517741    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"]
May 28 03:26:46.552721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.552691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pjs6\" (UniqueName: \"kubernetes.io/projected/5a3369a0-a52c-4726-b6ba-90fb1b83790c-kube-api-access-2pjs6\") pod \"limitador-operator-controller-manager-85c4996f8c-rvl78\" (UID: \"5a3369a0-a52c-4726-b6ba-90fb1b83790c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:26:46.653422 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.653380    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjs6\" (UniqueName: \"kubernetes.io/projected/5a3369a0-a52c-4726-b6ba-90fb1b83790c-kube-api-access-2pjs6\") pod \"limitador-operator-controller-manager-85c4996f8c-rvl78\" (UID: \"5a3369a0-a52c-4726-b6ba-90fb1b83790c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:26:46.676545 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.674419    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pjs6\" (UniqueName: \"kubernetes.io/projected/5a3369a0-a52c-4726-b6ba-90fb1b83790c-kube-api-access-2pjs6\") pod \"limitador-operator-controller-manager-85c4996f8c-rvl78\" (UID: \"5a3369a0-a52c-4726-b6ba-90fb1b83790c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:26:46.820272 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.820176    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:26:46.978283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:46.978257    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"]
May 28 03:26:46.978852 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:26:46.978823    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3369a0_a52c_4726_b6ba_90fb1b83790c.slice/crio-48c02c13b528917f55c06ddbe56d4f88e788c67da9834319cbe20dd0e35d0457 WatchSource:0}: Error finding container 48c02c13b528917f55c06ddbe56d4f88e788c67da9834319cbe20dd0e35d0457: Status 404 returned error can't find the container with id 48c02c13b528917f55c06ddbe56d4f88e788c67da9834319cbe20dd0e35d0457
May 28 03:26:47.766227 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:47.766171    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78" event={"ID":"5a3369a0-a52c-4726-b6ba-90fb1b83790c","Type":"ContainerStarted","Data":"48c02c13b528917f55c06ddbe56d4f88e788c67da9834319cbe20dd0e35d0457"}
May 28 03:26:49.775058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:49.775015    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78" event={"ID":"5a3369a0-a52c-4726-b6ba-90fb1b83790c","Type":"ContainerStarted","Data":"299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc"}
May 28 03:26:49.775541 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:49.775069    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:26:49.794679 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:49.794631    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78" podStartSLOduration=2.041923691 podStartE2EDuration="3.794617689s" podCreationTimestamp="2026-05-28 03:26:46 +0000 UTC" firstStartedPulling="2026-05-28 03:26:46.980664619 +0000 UTC m=+595.789680204" lastFinishedPulling="2026-05-28 03:26:48.733358619 +0000 UTC m=+597.542374202" observedRunningTime="2026-05-28 03:26:49.792704521 +0000 UTC m=+598.601720119" watchObservedRunningTime="2026-05-28 03:26:49.794617689 +0000 UTC m=+598.603633292"
May 28 03:26:50.779958 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:50.779911    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj" event={"ID":"c8cad8ef-99f3-4dc9-9053-75afde3a5391","Type":"ContainerStarted","Data":"aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91"}
May 28 03:26:50.780385 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:50.779978    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:26:50.801072 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:50.801027    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj" podStartSLOduration=1.702171721 podStartE2EDuration="6.801013043s" podCreationTimestamp="2026-05-28 03:26:44 +0000 UTC" firstStartedPulling="2026-05-28 03:26:45.004438015 +0000 UTC m=+593.813453598" lastFinishedPulling="2026-05-28 03:26:50.103279337 +0000 UTC m=+598.912294920" observedRunningTime="2026-05-28 03:26:50.800188011 +0000 UTC m=+599.609203618" watchObservedRunningTime="2026-05-28 03:26:50.801013043 +0000 UTC m=+599.610028647"
May 28 03:26:54.754721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:26:54.754690    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-62j2j"
May 28 03:27:00.782335 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:00.782302    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:27:00.789943 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:00.789892    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5b47d6f9dc-nf7h9" podUID="37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" containerName="console" containerID="cri-o://7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce" gracePeriod=15
May 28 03:27:01.040829 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.040771    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b47d6f9dc-nf7h9_37eabe96-50fc-442a-ac4e-8b5fc3ee7ada/console/0.log"
May 28 03:27:01.040927 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.040849    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:27:01.186700 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.186672    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-serving-cert\") pod \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") "
May 28 03:27:01.186859 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.186708    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-service-ca\") pod \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") "
May 28 03:27:01.186859 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.186742    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-oauth-serving-cert\") pod \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") "
May 28 03:27:01.186859 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.186769    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmgx2\" (UniqueName: \"kubernetes.io/projected/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-kube-api-access-vmgx2\") pod \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") "
May 28 03:27:01.186859 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.186787    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-trusted-ca-bundle\") pod \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") "
May 28 03:27:01.186859 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.186849    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-config\") pod \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") "
May 28 03:27:01.187123 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.186880    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-oauth-config\") pod \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\" (UID: \"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada\") "
May 28 03:27:01.187201 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.187071    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-service-ca" (OuterVolumeSpecName: "service-ca") pod "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" (UID: "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:27:01.187283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.187200    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" (UID: "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:27:01.187356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.187283    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-config" (OuterVolumeSpecName: "console-config") pod "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" (UID: "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:27:01.187356 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.187333    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" (UID: "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 03:27:01.189181 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.189154    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" (UID: "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:27:01.189287 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.189195    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" (UID: "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 03:27:01.189287 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.189195    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-kube-api-access-vmgx2" (OuterVolumeSpecName: "kube-api-access-vmgx2") pod "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" (UID: "37eabe96-50fc-442a-ac4e-8b5fc3ee7ada"). InnerVolumeSpecName "kube-api-access-vmgx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:27:01.287916 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.287888    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-oauth-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:01.288052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.287919    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-serving-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:01.288052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.287934    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:01.288052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.287948    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-oauth-serving-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:01.288052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.287962    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmgx2\" (UniqueName: \"kubernetes.io/projected/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-kube-api-access-vmgx2\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:01.288052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.287974    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-trusted-ca-bundle\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:01.288052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.287987    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada-console-config\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:01.785367 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.785341    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:27:01.821744 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.821707    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b47d6f9dc-nf7h9_37eabe96-50fc-442a-ac4e-8b5fc3ee7ada/console/0.log"
May 28 03:27:01.821879 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.821760    2575 generic.go:358] "Generic (PLEG): container finished" podID="37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" containerID="7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce" exitCode=2
May 28 03:27:01.821879 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.821866    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b47d6f9dc-nf7h9"
May 28 03:27:01.821995 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.821908    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b47d6f9dc-nf7h9" event={"ID":"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada","Type":"ContainerDied","Data":"7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce"}
May 28 03:27:01.821995 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.821958    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b47d6f9dc-nf7h9" event={"ID":"37eabe96-50fc-442a-ac4e-8b5fc3ee7ada","Type":"ContainerDied","Data":"364a7ec8a0da0bed08f39f7b34388449e847c89e1e2e82bcbf204969c9702d06"}
May 28 03:27:01.821995 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.821979    2575 scope.go:117] "RemoveContainer" containerID="7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce"
May 28 03:27:01.832320 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.832302    2575 scope.go:117] "RemoveContainer" containerID="7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce"
May 28 03:27:01.832600 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:27:01.832572    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce\": container with ID starting with 7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce not found: ID does not exist" containerID="7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce"
May 28 03:27:01.832713 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.832609    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce"} err="failed to get container status \"7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce\": rpc error: code = NotFound desc = could not find container \"7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce\": container with ID starting with 7dcdc692f3929052766eb8fcaeca02c6c8b37a2168ab80c766cfddc5e7880cce not found: ID does not exist"
May 28 03:27:01.858043 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.858021    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b47d6f9dc-nf7h9"]
May 28 03:27:01.862393 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:01.862372    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b47d6f9dc-nf7h9"]
May 28 03:27:03.308669 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.308634    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"]
May 28 03:27:03.309057 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.309029    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" containerName="console"
May 28 03:27:03.309057 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.309042    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" containerName="console"
May 28 03:27:03.309140 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.309107    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" containerName="console"
May 28 03:27:03.313620 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.313602    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.325559 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.325537    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"]
May 28 03:27:03.406359 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.406332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fbf9846-e6fd-472d-be04-adadcaa251a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" (UID: \"4fbf9846-e6fd-472d-be04-adadcaa251a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.406477 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.406412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgqdj\" (UniqueName: \"kubernetes.io/projected/4fbf9846-e6fd-472d-be04-adadcaa251a5-kube-api-access-zgqdj\") pod \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" (UID: \"4fbf9846-e6fd-472d-be04-adadcaa251a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.414501 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.414481    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"]
May 28 03:27:03.414677 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:27:03.414658    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-zgqdj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd" podUID="4fbf9846-e6fd-472d-be04-adadcaa251a5"
May 28 03:27:03.456389 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.456366    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s"]
May 28 03:27:03.459928 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.459914    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s"
May 28 03:27:03.482079 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.482056    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s"]
May 28 03:27:03.491643 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.491621    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s"]
May 28 03:27:03.491846 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:27:03.491825    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-6dmsc], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-6dmsc]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s" podUID="937f72f2-18d5-4b78-b3ba-e13be8b8f739"
May 28 03:27:03.502950 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.502928    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s"]
May 28 03:27:03.507063 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.507043    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fbf9846-e6fd-472d-be04-adadcaa251a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" (UID: \"4fbf9846-e6fd-472d-be04-adadcaa251a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.507139 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.507114    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgqdj\" (UniqueName: \"kubernetes.io/projected/4fbf9846-e6fd-472d-be04-adadcaa251a5-kube-api-access-zgqdj\") pod \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" (UID: \"4fbf9846-e6fd-472d-be04-adadcaa251a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.507441 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.507420    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fbf9846-e6fd-472d-be04-adadcaa251a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" (UID: \"4fbf9846-e6fd-472d-be04-adadcaa251a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.512394 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.512374    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"]
May 28 03:27:03.512586 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.512544    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj" podUID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" containerName="manager" containerID="cri-o://aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91" gracePeriod=2
May 28 03:27:03.524449 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.524422    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgqdj\" (UniqueName: \"kubernetes.io/projected/4fbf9846-e6fd-472d-be04-adadcaa251a5-kube-api-access-zgqdj\") pod \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" (UID: \"4fbf9846-e6fd-472d-be04-adadcaa251a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.529132 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.529111    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"]
May 28 03:27:03.531664 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.531640    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"]
May 28 03:27:03.531976 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.531965    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" containerName="manager"
May 28 03:27:03.532018 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.531978    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" containerName="manager"
May 28 03:27:03.532052 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.532043    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" containerName="manager"
May 28 03:27:03.535368 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.535348    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:03.553934 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.542819    2575 status_manager.go:895] "Failed to get status for pod" podUID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:03.553934 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.550734    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"]
May 28 03:27:03.553934 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.553677    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"]
May 28 03:27:03.559775 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.559706    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"]
May 28 03:27:03.559879 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.559796    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:03.560836 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.560813    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"]
May 28 03:27:03.571337 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.571317    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"]
May 28 03:27:03.589253 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.589220    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"]
May 28 03:27:03.589451 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.589432    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78" podUID="5a3369a0-a52c-4726-b6ba-90fb1b83790c" containerName="manager" containerID="cri-o://299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc" gracePeriod=2
May 28 03:27:03.595538 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.595515    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"]
May 28 03:27:03.608159 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.608139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jsgh\" (UniqueName: \"kubernetes.io/projected/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-kube-api-access-8jsgh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghwc4\" (UID: \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:03.608256 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.608172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghwc4\" (UID: \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:03.618218 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.618187    2575 status_manager.go:895] "Failed to get status for pod" podUID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:03.620480 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.620449    2575 status_manager.go:895] "Failed to get status for pod" podUID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-mvqwj\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:03.622713 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.622691    2575 status_manager.go:895] "Failed to get status for pod" podUID="5a3369a0-a52c-4726-b6ba-90fb1b83790c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78" err="pods \"limitador-operator-controller-manager-85c4996f8c-rvl78\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:03.709643 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.709607    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jsgh\" (UniqueName: \"kubernetes.io/projected/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-kube-api-access-8jsgh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghwc4\" (UID: \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:03.709765 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.709683    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghwc4\" (UID: \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:03.709765 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.709731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmlln\" (UniqueName: \"kubernetes.io/projected/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-kube-api-access-cmlln\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2h5bn\" (UID: \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:03.709898 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.709832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2h5bn\" (UID: \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:03.710086 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.710060    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghwc4\" (UID: \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:03.719046 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.719023    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jsgh\" (UniqueName: \"kubernetes.io/projected/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-kube-api-access-8jsgh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghwc4\" (UID: \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:03.751363 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.750863    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37eabe96-50fc-442a-ac4e-8b5fc3ee7ada" path="/var/lib/kubelet/pods/37eabe96-50fc-442a-ac4e-8b5fc3ee7ada/volumes"
May 28 03:27:03.751363 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.751176    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="937f72f2-18d5-4b78-b3ba-e13be8b8f739" path="/var/lib/kubelet/pods/937f72f2-18d5-4b78-b3ba-e13be8b8f739/volumes"
May 28 03:27:03.804936 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.804915    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:27:03.811647 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.811571    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmlln\" (UniqueName: \"kubernetes.io/projected/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-kube-api-access-cmlln\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2h5bn\" (UID: \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:03.811761 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.811668    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2h5bn\" (UID: \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:03.812067 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.812046    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2h5bn\" (UID: \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:03.824770 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.824754    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:27:03.826690 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.826674    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmlln\" (UniqueName: \"kubernetes.io/projected/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-kube-api-access-cmlln\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2h5bn\" (UID: \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:03.832317 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.832292    2575 generic.go:358] "Generic (PLEG): container finished" podID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" containerID="aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91" exitCode=0
May 28 03:27:03.832386 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.832334    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mvqwj"
May 28 03:27:03.832427 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.832391    2575 scope.go:117] "RemoveContainer" containerID="aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91"
May 28 03:27:03.833687 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.833664    2575 generic.go:358] "Generic (PLEG): container finished" podID="5a3369a0-a52c-4726-b6ba-90fb1b83790c" containerID="299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc" exitCode=0
May 28 03:27:03.833789 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.833711    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvl78"
May 28 03:27:03.833871 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.833859    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s"
May 28 03:27:03.833915 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.833900    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.839282 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.839267    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s"
May 28 03:27:03.841970 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.841954    2575 scope.go:117] "RemoveContainer" containerID="aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91"
May 28 03:27:03.842216 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:27:03.842195    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91\": container with ID starting with aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91 not found: ID does not exist" containerID="aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91"
May 28 03:27:03.842306 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.842226    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91"} err="failed to get container status \"aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91\": rpc error: code = NotFound desc = could not find container \"aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91\": container with ID starting with aba2e8ed0b6217d9765d00b3ec8c98089bc5e89fdac0e92be82b6e856de13b91 not found: ID does not exist"
May 28 03:27:03.842306 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.842278    2575 scope.go:117] "RemoveContainer" containerID="299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc"
May 28 03:27:03.842895 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.842870    2575 status_manager.go:895] "Failed to get status for pod" podUID="937f72f2-18d5-4b78-b3ba-e13be8b8f739" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-bnp5s\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:03.842987 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.842932    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:03.845360 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.845337    2575 status_manager.go:895] "Failed to get status for pod" podUID="4fbf9846-e6fd-472d-be04-adadcaa251a5" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd" err="pods \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:03.848280 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.848236    2575 status_manager.go:895] "Failed to get status for pod" podUID="937f72f2-18d5-4b78-b3ba-e13be8b8f739" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-bnp5s\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:03.850046 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.850029    2575 scope.go:117] "RemoveContainer" containerID="299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc"
May 28 03:27:03.850289 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:27:03.850270    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc\": container with ID starting with 299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc not found: ID does not exist" containerID="299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc"
May 28 03:27:03.850332 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.850297    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc"} err="failed to get container status \"299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc\": rpc error: code = NotFound desc = could not find container \"299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc\": container with ID starting with 299a661e0006c3b1e58635043e515bb70a265f939a84c6a70b77d1de7aaa22bc not found: ID does not exist"
May 28 03:27:03.912220 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.912197    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqzrd\" (UniqueName: \"kubernetes.io/projected/c8cad8ef-99f3-4dc9-9053-75afde3a5391-kube-api-access-jqzrd\") pod \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\" (UID: \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\") "
May 28 03:27:03.912318 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.912291    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fbf9846-e6fd-472d-be04-adadcaa251a5-extensions-socket-volume\") pod \"4fbf9846-e6fd-472d-be04-adadcaa251a5\" (UID: \"4fbf9846-e6fd-472d-be04-adadcaa251a5\") "
May 28 03:27:03.912358 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.912325    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8cad8ef-99f3-4dc9-9053-75afde3a5391-extensions-socket-volume\") pod \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\" (UID: \"c8cad8ef-99f3-4dc9-9053-75afde3a5391\") "
May 28 03:27:03.912398 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.912359    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pjs6\" (UniqueName: \"kubernetes.io/projected/5a3369a0-a52c-4726-b6ba-90fb1b83790c-kube-api-access-2pjs6\") pod \"5a3369a0-a52c-4726-b6ba-90fb1b83790c\" (UID: \"5a3369a0-a52c-4726-b6ba-90fb1b83790c\") "
May 28 03:27:03.912431 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.912399    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgqdj\" (UniqueName: \"kubernetes.io/projected/4fbf9846-e6fd-472d-be04-adadcaa251a5-kube-api-access-zgqdj\") pod \"4fbf9846-e6fd-472d-be04-adadcaa251a5\" (UID: \"4fbf9846-e6fd-472d-be04-adadcaa251a5\") "
May 28 03:27:03.912563 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.912539    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fbf9846-e6fd-472d-be04-adadcaa251a5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4fbf9846-e6fd-472d-be04-adadcaa251a5" (UID: "4fbf9846-e6fd-472d-be04-adadcaa251a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:27:03.912672 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.912620    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fbf9846-e6fd-472d-be04-adadcaa251a5-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:03.912672 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.912652    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8cad8ef-99f3-4dc9-9053-75afde3a5391-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c8cad8ef-99f3-4dc9-9053-75afde3a5391" (UID: "c8cad8ef-99f3-4dc9-9053-75afde3a5391"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:27:03.914095 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.914075    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8cad8ef-99f3-4dc9-9053-75afde3a5391-kube-api-access-jqzrd" (OuterVolumeSpecName: "kube-api-access-jqzrd") pod "c8cad8ef-99f3-4dc9-9053-75afde3a5391" (UID: "c8cad8ef-99f3-4dc9-9053-75afde3a5391"). InnerVolumeSpecName "kube-api-access-jqzrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:27:03.914271 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.914239    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fbf9846-e6fd-472d-be04-adadcaa251a5-kube-api-access-zgqdj" (OuterVolumeSpecName: "kube-api-access-zgqdj") pod "4fbf9846-e6fd-472d-be04-adadcaa251a5" (UID: "4fbf9846-e6fd-472d-be04-adadcaa251a5"). InnerVolumeSpecName "kube-api-access-zgqdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:27:03.914331 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.914313    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a3369a0-a52c-4726-b6ba-90fb1b83790c-kube-api-access-2pjs6" (OuterVolumeSpecName: "kube-api-access-2pjs6") pod "5a3369a0-a52c-4726-b6ba-90fb1b83790c" (UID: "5a3369a0-a52c-4726-b6ba-90fb1b83790c"). InnerVolumeSpecName "kube-api-access-2pjs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:27:03.969176 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.969155    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:03.973780 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:03.973758    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:04.013878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.013815    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8cad8ef-99f3-4dc9-9053-75afde3a5391-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:04.013878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.013856    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pjs6\" (UniqueName: \"kubernetes.io/projected/5a3369a0-a52c-4726-b6ba-90fb1b83790c-kube-api-access-2pjs6\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:04.013878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.013873    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgqdj\" (UniqueName: \"kubernetes.io/projected/4fbf9846-e6fd-472d-be04-adadcaa251a5-kube-api-access-zgqdj\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:04.013878 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.013886    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqzrd\" (UniqueName: \"kubernetes.io/projected/c8cad8ef-99f3-4dc9-9053-75afde3a5391-kube-api-access-jqzrd\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:04.108336 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.108299    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"]
May 28 03:27:04.110554 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:27:04.110520    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7661559c_4c9a_4d16_ae1a_6df7fd2381cf.slice/crio-5aacb7504efa57bbd9fd6a789ecb79d2c0fb96e98fbf67c94f0e1886ab0fba70 WatchSource:0}: Error finding container 5aacb7504efa57bbd9fd6a789ecb79d2c0fb96e98fbf67c94f0e1886ab0fba70: Status 404 returned error can't find the container with id 5aacb7504efa57bbd9fd6a789ecb79d2c0fb96e98fbf67c94f0e1886ab0fba70
May 28 03:27:04.137624 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.137557    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"]
May 28 03:27:04.147454 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:27:04.147427    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4d84b4_caa7_436e_bc20_bd60cd53d89d.slice/crio-8b54e87d51d17dffb71bc806ec7ee55c9ca951999790cf9aaa8d98c420eed6c0 WatchSource:0}: Error finding container 8b54e87d51d17dffb71bc806ec7ee55c9ca951999790cf9aaa8d98c420eed6c0: Status 404 returned error can't find the container with id 8b54e87d51d17dffb71bc806ec7ee55c9ca951999790cf9aaa8d98c420eed6c0
May 28 03:27:04.153794 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.153766    2575 status_manager.go:895] "Failed to get status for pod" podUID="937f72f2-18d5-4b78-b3ba-e13be8b8f739" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-bnp5s\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:04.155841 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.155820    2575 status_manager.go:895] "Failed to get status for pod" podUID="4fbf9846-e6fd-472d-be04-adadcaa251a5" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd" err="pods \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:04.157836 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.157809    2575 status_manager.go:895] "Failed to get status for pod" podUID="4fbf9846-e6fd-472d-be04-adadcaa251a5" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd" err="pods \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:04.159772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.159751    2575 status_manager.go:895] "Failed to get status for pod" podUID="937f72f2-18d5-4b78-b3ba-e13be8b8f739" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-bnp5s\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:04.839204 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.839109    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn" event={"ID":"ca4d84b4-caa7-436e-bc20-bd60cd53d89d","Type":"ContainerStarted","Data":"59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d"}
May 28 03:27:04.839204 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.839153    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn" event={"ID":"ca4d84b4-caa7-436e-bc20-bd60cd53d89d","Type":"ContainerStarted","Data":"8b54e87d51d17dffb71bc806ec7ee55c9ca951999790cf9aaa8d98c420eed6c0"}
May 28 03:27:04.839758 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.839272    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:04.840892 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.840824    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4" event={"ID":"7661559c-4c9a-4d16-ae1a-6df7fd2381cf","Type":"ContainerStarted","Data":"b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486"}
May 28 03:27:04.840892 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.840861    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4" event={"ID":"7661559c-4c9a-4d16-ae1a-6df7fd2381cf","Type":"ContainerStarted","Data":"5aacb7504efa57bbd9fd6a789ecb79d2c0fb96e98fbf67c94f0e1886ab0fba70"}
May 28 03:27:04.841094 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.840941    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:04.842296 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.842235    2575 status_manager.go:895] "Failed to get status for pod" podUID="4fbf9846-e6fd-472d-be04-adadcaa251a5" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd" err="pods \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:04.844287 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.843563    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd"
May 28 03:27:04.844287 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.843713    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s"
May 28 03:27:04.844995 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.844879    2575 status_manager.go:895] "Failed to get status for pod" podUID="937f72f2-18d5-4b78-b3ba-e13be8b8f739" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-bnp5s\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:04.873114 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.873092    2575 status_manager.go:895] "Failed to get status for pod" podUID="4fbf9846-e6fd-472d-be04-adadcaa251a5" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-rd9vd" err="pods \"kuadrant-operator-controller-manager-84b657d985-rd9vd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:04.873537 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.873505    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn" podStartSLOduration=1.8734953989999998 podStartE2EDuration="1.873495399s" podCreationTimestamp="2026-05-28 03:27:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:27:04.870709777 +0000 UTC m=+613.679725376" watchObservedRunningTime="2026-05-28 03:27:04.873495399 +0000 UTC m=+613.682511005"
May 28 03:27:04.875194 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.875175    2575 status_manager.go:895] "Failed to get status for pod" podUID="937f72f2-18d5-4b78-b3ba-e13be8b8f739" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bnp5s" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-bnp5s\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object"
May 28 03:27:04.901146 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:04.901109    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4" podStartSLOduration=1.901099367 podStartE2EDuration="1.901099367s" podCreationTimestamp="2026-05-28 03:27:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:27:04.897757633 +0000 UTC m=+613.706773228" watchObservedRunningTime="2026-05-28 03:27:04.901099367 +0000 UTC m=+613.710114971"
May 28 03:27:05.749333 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:05.749305    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fbf9846-e6fd-472d-be04-adadcaa251a5" path="/var/lib/kubelet/pods/4fbf9846-e6fd-472d-be04-adadcaa251a5/volumes"
May 28 03:27:05.749537 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:05.749526    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a3369a0-a52c-4726-b6ba-90fb1b83790c" path="/var/lib/kubelet/pods/5a3369a0-a52c-4726-b6ba-90fb1b83790c/volumes"
May 28 03:27:05.749845 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:05.749834    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8cad8ef-99f3-4dc9-9053-75afde3a5391" path="/var/lib/kubelet/pods/c8cad8ef-99f3-4dc9-9053-75afde3a5391/volumes"
May 28 03:27:15.849832 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:15.849801    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:27:15.850320 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:15.849852    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:15.930180 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:15.930153    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"]
May 28 03:27:15.930391 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:15.930369    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn" podUID="ca4d84b4-caa7-436e-bc20-bd60cd53d89d" containerName="manager" containerID="cri-o://59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d" gracePeriod=10
May 28 03:27:16.173500 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.173479    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:16.313982 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.313954    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmlln\" (UniqueName: \"kubernetes.io/projected/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-kube-api-access-cmlln\") pod \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\" (UID: \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\") "
May 28 03:27:16.313982 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.313987    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-extensions-socket-volume\") pod \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\" (UID: \"ca4d84b4-caa7-436e-bc20-bd60cd53d89d\") "
May 28 03:27:16.314462 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.314437    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca4d84b4-caa7-436e-bc20-bd60cd53d89d" (UID: "ca4d84b4-caa7-436e-bc20-bd60cd53d89d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:27:16.315945 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.315920    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-kube-api-access-cmlln" (OuterVolumeSpecName: "kube-api-access-cmlln") pod "ca4d84b4-caa7-436e-bc20-bd60cd53d89d" (UID: "ca4d84b4-caa7-436e-bc20-bd60cd53d89d"). InnerVolumeSpecName "kube-api-access-cmlln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:27:16.415620 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.415540    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmlln\" (UniqueName: \"kubernetes.io/projected/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-kube-api-access-cmlln\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:16.415620 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.415570    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca4d84b4-caa7-436e-bc20-bd60cd53d89d-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:16.890896 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.890862    2575 generic.go:358] "Generic (PLEG): container finished" podID="ca4d84b4-caa7-436e-bc20-bd60cd53d89d" containerID="59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d" exitCode=0
May 28 03:27:16.891339 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.890926    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"
May 28 03:27:16.891339 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.890946    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn" event={"ID":"ca4d84b4-caa7-436e-bc20-bd60cd53d89d","Type":"ContainerDied","Data":"59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d"}
May 28 03:27:16.891339 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.890986    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn" event={"ID":"ca4d84b4-caa7-436e-bc20-bd60cd53d89d","Type":"ContainerDied","Data":"8b54e87d51d17dffb71bc806ec7ee55c9ca951999790cf9aaa8d98c420eed6c0"}
May 28 03:27:16.891339 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.891007    2575 scope.go:117] "RemoveContainer" containerID="59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d"
May 28 03:27:16.900684 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.900670    2575 scope.go:117] "RemoveContainer" containerID="59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d"
May 28 03:27:16.900926 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:27:16.900911    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d\": container with ID starting with 59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d not found: ID does not exist" containerID="59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d"
May 28 03:27:16.900962 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.900933    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d"} err="failed to get container status \"59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d\": rpc error: code = NotFound desc = could not find container \"59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d\": container with ID starting with 59ae015dcf7ad70bd7ae20fc1715517243a9adcb8e9eb371e98b3591d81add3d not found: ID does not exist"
May 28 03:27:16.916887 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.916865    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"]
May 28 03:27:16.925033 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:16.925015    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2h5bn"]
May 28 03:27:17.749322 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:17.749289    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca4d84b4-caa7-436e-bc20-bd60cd53d89d" path="/var/lib/kubelet/pods/ca4d84b4-caa7-436e-bc20-bd60cd53d89d/volumes"
May 28 03:27:32.263107 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.263078    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"]
May 28 03:27:32.263602 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.263584    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4d84b4-caa7-436e-bc20-bd60cd53d89d" containerName="manager"
May 28 03:27:32.263689 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.263605    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4d84b4-caa7-436e-bc20-bd60cd53d89d" containerName="manager"
May 28 03:27:32.263689 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.263623    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3369a0-a52c-4726-b6ba-90fb1b83790c" containerName="manager"
May 28 03:27:32.263689 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.263631    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3369a0-a52c-4726-b6ba-90fb1b83790c" containerName="manager"
May 28 03:27:32.263828 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.263750    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a3369a0-a52c-4726-b6ba-90fb1b83790c" containerName="manager"
May 28 03:27:32.263828 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.263763    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca4d84b4-caa7-436e-bc20-bd60cd53d89d" containerName="manager"
May 28 03:27:32.267182 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.267160    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.271014 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.270993    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4lwwt\""
May 28 03:27:32.295353 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.295328    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"]
May 28 03:27:32.331992 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.331965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfkts\" (UniqueName: \"kubernetes.io/projected/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-kube-api-access-nfkts\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.332112 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.332002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.332112 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.332035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.332112 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.332099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.332285 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.332142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.332285 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.332220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.332370 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.332293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.332370 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.332321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.332370 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.332340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.432983 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.432957    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433101 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.432993    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433101 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433012    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433209 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433138    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433288 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433228    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfkts\" (UniqueName: \"kubernetes.io/projected/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-kube-api-access-nfkts\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433351 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433292    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433351 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433330    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433455 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433368    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433455 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433399    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433455 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433407    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433455 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433367    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433696 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433672    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.433772 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.433716    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.434086 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.434069    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.435216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.435198    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.435472 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.435454    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.443067 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.443045    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.443642 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.443623    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfkts\" (UniqueName: \"kubernetes.io/projected/81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7-kube-api-access-nfkts\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-flhth\" (UID: \"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.577394 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.577316    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:32.723689 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.723617    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"]
May 28 03:27:32.726230 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:27:32.726196    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81eae5c7_a4b5_4f4a_968d_40fbc1e21ee7.slice/crio-b8c93471f0c3176611941b262c5512c58dd77236cf974e6f477cda46196e07d2 WatchSource:0}: Error finding container b8c93471f0c3176611941b262c5512c58dd77236cf974e6f477cda46196e07d2: Status 404 returned error can't find the container with id b8c93471f0c3176611941b262c5512c58dd77236cf974e6f477cda46196e07d2
May 28 03:27:32.728844 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.728813    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 28 03:27:32.728965 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.728887    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 28 03:27:32.728965 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.728930    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 28 03:27:32.951003 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.950971    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth" event={"ID":"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7","Type":"ContainerStarted","Data":"08587a75e3c3952652f08050f1fabf67b36ccbfdcd1a0020779519abc3faa755"}
May 28 03:27:32.951003 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.951006    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth" event={"ID":"81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7","Type":"ContainerStarted","Data":"b8c93471f0c3176611941b262c5512c58dd77236cf974e6f477cda46196e07d2"}
May 28 03:27:32.976574 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:32.976535    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth" podStartSLOduration=0.976520694 podStartE2EDuration="976.520694ms" podCreationTimestamp="2026-05-28 03:27:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:27:32.974263344 +0000 UTC m=+641.783278939" watchObservedRunningTime="2026-05-28 03:27:32.976520694 +0000 UTC m=+641.785536299"
May 28 03:27:33.577689 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:33.577657    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:33.582380 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:33.582358    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:33.955213 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:33.955187    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:33.956058 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:33.956040    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-flhth"
May 28 03:27:36.618691 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.618650    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:27:36.621177 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.621158    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:36.623958 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.623930    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lgq78\""
May 28 03:27:36.624060 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.624033    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 28 03:27:36.630478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.630454    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:27:36.656385 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.656360    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:27:36.672582 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.672555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/805867f6-53dc-4a69-b513-32ca9b3cd78b-config-file\") pod \"limitador-limitador-78c99df468-55869\" (UID: \"805867f6-53dc-4a69-b513-32ca9b3cd78b\") " pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:36.672698 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.672596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc9fw\" (UniqueName: \"kubernetes.io/projected/805867f6-53dc-4a69-b513-32ca9b3cd78b-kube-api-access-zc9fw\") pod \"limitador-limitador-78c99df468-55869\" (UID: \"805867f6-53dc-4a69-b513-32ca9b3cd78b\") " pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:36.773489 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.773450    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/805867f6-53dc-4a69-b513-32ca9b3cd78b-config-file\") pod \"limitador-limitador-78c99df468-55869\" (UID: \"805867f6-53dc-4a69-b513-32ca9b3cd78b\") " pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:36.773698 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.773513    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc9fw\" (UniqueName: \"kubernetes.io/projected/805867f6-53dc-4a69-b513-32ca9b3cd78b-kube-api-access-zc9fw\") pod \"limitador-limitador-78c99df468-55869\" (UID: \"805867f6-53dc-4a69-b513-32ca9b3cd78b\") " pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:36.774303 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.774274    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/805867f6-53dc-4a69-b513-32ca9b3cd78b-config-file\") pod \"limitador-limitador-78c99df468-55869\" (UID: \"805867f6-53dc-4a69-b513-32ca9b3cd78b\") " pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:36.785965 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.785941    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc9fw\" (UniqueName: \"kubernetes.io/projected/805867f6-53dc-4a69-b513-32ca9b3cd78b-kube-api-access-zc9fw\") pod \"limitador-limitador-78c99df468-55869\" (UID: \"805867f6-53dc-4a69-b513-32ca9b3cd78b\") " pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:36.933118 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:36.933093    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:37.058745 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.058712    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:27:37.059975 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:27:37.059946    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805867f6_53dc_4a69_b513_32ca9b3cd78b.slice/crio-8072e802b1524e6e36ff8c88e3dd4ae613da430db59946d3e45cf977cdecd3ca WatchSource:0}: Error finding container 8072e802b1524e6e36ff8c88e3dd4ae613da430db59946d3e45cf977cdecd3ca: Status 404 returned error can't find the container with id 8072e802b1524e6e36ff8c88e3dd4ae613da430db59946d3e45cf977cdecd3ca
May 28 03:27:37.061757 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.061738    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 03:27:37.152107 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.152083    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-f4lwg"]
May 28 03:27:37.155894 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.155877    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg"
May 28 03:27:37.158819 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.158796    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xlm95\""
May 28 03:27:37.168229 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.168209    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-f4lwg"]
May 28 03:27:37.177540 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.177516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qprb\" (UniqueName: \"kubernetes.io/projected/261ff106-4204-4c32-a103-30335921d543-kube-api-access-2qprb\") pod \"authorino-f99f4b5cd-f4lwg\" (UID: \"261ff106-4204-4c32-a103-30335921d543\") " pod="kuadrant-system/authorino-f99f4b5cd-f4lwg"
May 28 03:27:37.278648 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.278589    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qprb\" (UniqueName: \"kubernetes.io/projected/261ff106-4204-4c32-a103-30335921d543-kube-api-access-2qprb\") pod \"authorino-f99f4b5cd-f4lwg\" (UID: \"261ff106-4204-4c32-a103-30335921d543\") " pod="kuadrant-system/authorino-f99f4b5cd-f4lwg"
May 28 03:27:37.288405 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.288384    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qprb\" (UniqueName: \"kubernetes.io/projected/261ff106-4204-4c32-a103-30335921d543-kube-api-access-2qprb\") pod \"authorino-f99f4b5cd-f4lwg\" (UID: \"261ff106-4204-4c32-a103-30335921d543\") " pod="kuadrant-system/authorino-f99f4b5cd-f4lwg"
May 28 03:27:37.464690 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.464638    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg"
May 28 03:27:37.643977 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.643945    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-f4lwg"]
May 28 03:27:37.644567 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:27:37.644311    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod261ff106_4204_4c32_a103_30335921d543.slice/crio-c610db1f46515f56d48fc37ef43a05c0a73a0ff651252e9962c274abc283f475 WatchSource:0}: Error finding container c610db1f46515f56d48fc37ef43a05c0a73a0ff651252e9962c274abc283f475: Status 404 returned error can't find the container with id c610db1f46515f56d48fc37ef43a05c0a73a0ff651252e9962c274abc283f475
May 28 03:27:37.973832 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.973797    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg" event={"ID":"261ff106-4204-4c32-a103-30335921d543","Type":"ContainerStarted","Data":"c610db1f46515f56d48fc37ef43a05c0a73a0ff651252e9962c274abc283f475"}
May 28 03:27:37.975010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:37.974983    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-55869" event={"ID":"805867f6-53dc-4a69-b513-32ca9b3cd78b","Type":"ContainerStarted","Data":"8072e802b1524e6e36ff8c88e3dd4ae613da430db59946d3e45cf977cdecd3ca"}
May 28 03:27:39.986262 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:39.986209    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-55869" event={"ID":"805867f6-53dc-4a69-b513-32ca9b3cd78b","Type":"ContainerStarted","Data":"e0e80e7a85ff8ee303a7bc9e415aeb9a2894658ce38c8d9c1aca2b119ee59a2a"}
May 28 03:27:39.986782 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:39.986304    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:27:40.006174 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:40.006125    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-55869" podStartSLOduration=1.607245279 podStartE2EDuration="4.006110395s" podCreationTimestamp="2026-05-28 03:27:36 +0000 UTC" firstStartedPulling="2026-05-28 03:27:37.06185423 +0000 UTC m=+645.870869813" lastFinishedPulling="2026-05-28 03:27:39.460719345 +0000 UTC m=+648.269734929" observedRunningTime="2026-05-28 03:27:40.00484958 +0000 UTC m=+648.813865211" watchObservedRunningTime="2026-05-28 03:27:40.006110395 +0000 UTC m=+648.815126002"
May 28 03:27:42.999641 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:42.999605    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg" event={"ID":"261ff106-4204-4c32-a103-30335921d543","Type":"ContainerStarted","Data":"5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81"}
May 28 03:27:43.018828 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:43.018784    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg" podStartSLOduration=1.309928362 podStartE2EDuration="6.018771369s" podCreationTimestamp="2026-05-28 03:27:37 +0000 UTC" firstStartedPulling="2026-05-28 03:27:37.645741919 +0000 UTC m=+646.454757510" lastFinishedPulling="2026-05-28 03:27:42.354584917 +0000 UTC m=+651.163600517" observedRunningTime="2026-05-28 03:27:43.017105209 +0000 UTC m=+651.826120816" watchObservedRunningTime="2026-05-28 03:27:43.018771369 +0000 UTC m=+651.827786973"
May 28 03:27:44.035378 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:44.035348    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-f4lwg"]
May 28 03:27:45.008104 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:45.008063    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg" podUID="261ff106-4204-4c32-a103-30335921d543" containerName="authorino" containerID="cri-o://5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81" gracePeriod=30
May 28 03:27:45.250785 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:45.250763    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg"
May 28 03:27:45.353768 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:45.353691    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qprb\" (UniqueName: \"kubernetes.io/projected/261ff106-4204-4c32-a103-30335921d543-kube-api-access-2qprb\") pod \"261ff106-4204-4c32-a103-30335921d543\" (UID: \"261ff106-4204-4c32-a103-30335921d543\") "
May 28 03:27:45.355569 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:45.355546    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261ff106-4204-4c32-a103-30335921d543-kube-api-access-2qprb" (OuterVolumeSpecName: "kube-api-access-2qprb") pod "261ff106-4204-4c32-a103-30335921d543" (UID: "261ff106-4204-4c32-a103-30335921d543"). InnerVolumeSpecName "kube-api-access-2qprb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:27:45.454299 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:45.454278    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qprb\" (UniqueName: \"kubernetes.io/projected/261ff106-4204-4c32-a103-30335921d543-kube-api-access-2qprb\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:27:46.012694 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.012615    2575 generic.go:358] "Generic (PLEG): container finished" podID="261ff106-4204-4c32-a103-30335921d543" containerID="5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81" exitCode=0
May 28 03:27:46.012694 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.012671    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg"
May 28 03:27:46.012694 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.012679    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg" event={"ID":"261ff106-4204-4c32-a103-30335921d543","Type":"ContainerDied","Data":"5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81"}
May 28 03:27:46.012915 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.012703    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-f4lwg" event={"ID":"261ff106-4204-4c32-a103-30335921d543","Type":"ContainerDied","Data":"c610db1f46515f56d48fc37ef43a05c0a73a0ff651252e9962c274abc283f475"}
May 28 03:27:46.012915 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.012719    2575 scope.go:117] "RemoveContainer" containerID="5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81"
May 28 03:27:46.021146 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.021119    2575 scope.go:117] "RemoveContainer" containerID="5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81"
May 28 03:27:46.021382 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:27:46.021360    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81\": container with ID starting with 5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81 not found: ID does not exist" containerID="5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81"
May 28 03:27:46.021442 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.021388    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81"} err="failed to get container status \"5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81\": rpc error: code = NotFound desc = could not find container \"5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81\": container with ID starting with 5c34b5657b37069267f4c6deeaa1bdbc560ceef50eb96f7462982606bd31fc81 not found: ID does not exist"
May 28 03:27:46.032872 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.032850    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-f4lwg"]
May 28 03:27:46.036720 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:46.036694    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-f4lwg"]
May 28 03:27:47.749980 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:47.749946    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="261ff106-4204-4c32-a103-30335921d543" path="/var/lib/kubelet/pods/261ff106-4204-4c32-a103-30335921d543/volumes"
May 28 03:27:50.991737 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:27:50.991709    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-55869"
May 28 03:28:08.607965 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.607931    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mf5ds"]
May 28 03:28:08.608452 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.608332    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="261ff106-4204-4c32-a103-30335921d543" containerName="authorino"
May 28 03:28:08.608452 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.608348    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="261ff106-4204-4c32-a103-30335921d543" containerName="authorino"
May 28 03:28:08.608452 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.608432    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="261ff106-4204-4c32-a103-30335921d543" containerName="authorino"
May 28 03:28:08.611537 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.611517    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mf5ds"
May 28 03:28:08.614990 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.614704    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xlm95\""
May 28 03:28:08.623312 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.618675    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mf5ds"]
May 28 03:28:08.744855 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.744831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs8w8\" (UniqueName: \"kubernetes.io/projected/b4263ea8-74e8-4ed4-8b70-f14e2610ea02-kube-api-access-gs8w8\") pod \"authorino-8b475cf9f-mf5ds\" (UID: \"b4263ea8-74e8-4ed4-8b70-f14e2610ea02\") " pod="kuadrant-system/authorino-8b475cf9f-mf5ds"
May 28 03:28:08.846288 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.846259    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gs8w8\" (UniqueName: \"kubernetes.io/projected/b4263ea8-74e8-4ed4-8b70-f14e2610ea02-kube-api-access-gs8w8\") pod \"authorino-8b475cf9f-mf5ds\" (UID: \"b4263ea8-74e8-4ed4-8b70-f14e2610ea02\") " pod="kuadrant-system/authorino-8b475cf9f-mf5ds"
May 28 03:28:08.854443 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.854420    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mf5ds"]
May 28 03:28:08.854663 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:28:08.854641    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gs8w8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-mf5ds" podUID="b4263ea8-74e8-4ed4-8b70-f14e2610ea02"
May 28 03:28:08.856550 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:08.856523    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs8w8\" (UniqueName: \"kubernetes.io/projected/b4263ea8-74e8-4ed4-8b70-f14e2610ea02-kube-api-access-gs8w8\") pod \"authorino-8b475cf9f-mf5ds\" (UID: \"b4263ea8-74e8-4ed4-8b70-f14e2610ea02\") " pod="kuadrant-system/authorino-8b475cf9f-mf5ds"
May 28 03:28:09.108262 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:09.108210    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mf5ds"
May 28 03:28:09.113023 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:09.112985    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mf5ds"
May 28 03:28:09.248603 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:09.248577    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs8w8\" (UniqueName: \"kubernetes.io/projected/b4263ea8-74e8-4ed4-8b70-f14e2610ea02-kube-api-access-gs8w8\") pod \"b4263ea8-74e8-4ed4-8b70-f14e2610ea02\" (UID: \"b4263ea8-74e8-4ed4-8b70-f14e2610ea02\") "
May 28 03:28:09.250471 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:09.250449    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4263ea8-74e8-4ed4-8b70-f14e2610ea02-kube-api-access-gs8w8" (OuterVolumeSpecName: "kube-api-access-gs8w8") pod "b4263ea8-74e8-4ed4-8b70-f14e2610ea02" (UID: "b4263ea8-74e8-4ed4-8b70-f14e2610ea02"). InnerVolumeSpecName "kube-api-access-gs8w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:28:09.350034 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:09.350009    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs8w8\" (UniqueName: \"kubernetes.io/projected/b4263ea8-74e8-4ed4-8b70-f14e2610ea02-kube-api-access-gs8w8\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:28:10.113668 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:10.113592    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mf5ds"
May 28 03:28:10.153006 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:10.152975    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mf5ds"]
May 28 03:28:10.159842 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:10.159817    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mf5ds"]
May 28 03:28:11.750041 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:11.750008    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4263ea8-74e8-4ed4-8b70-f14e2610ea02" path="/var/lib/kubelet/pods/b4263ea8-74e8-4ed4-8b70-f14e2610ea02/volumes"
May 28 03:28:48.926437 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:28:48.926355    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:29:16.105283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.105233    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"]
May 28 03:29:16.108905 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.108886    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.111910 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.111889    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 28 03:29:16.113028 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.113008    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 03:29:16.113126 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.113062    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9vdxf\""
May 28 03:29:16.113126 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.113063    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 03:29:16.125086 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.125060    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"]
May 28 03:29:16.205588 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.205556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.205761 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.205598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.205761 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.205677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.205761 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.205741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.205874 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.205791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2d6329c-b113-4590-b8a3-fa55474a80dd-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.205874 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.205818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4bd\" (UniqueName: \"kubernetes.io/projected/b2d6329c-b113-4590-b8a3-fa55474a80dd-kube-api-access-8g4bd\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.306909 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.306871    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.307093 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.306921    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.307093 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.306996    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.307093 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.307052    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.307093 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.307083    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2d6329c-b113-4590-b8a3-fa55474a80dd-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.307304 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.307113    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4bd\" (UniqueName: \"kubernetes.io/projected/b2d6329c-b113-4590-b8a3-fa55474a80dd-kube-api-access-8g4bd\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.307418 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.307391    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.307540 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.307438    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.307540 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.307474    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.309346 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.309321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2d6329c-b113-4590-b8a3-fa55474a80dd-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.309656 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.309635    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2d6329c-b113-4590-b8a3-fa55474a80dd-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.315563 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.315542    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4bd\" (UniqueName: \"kubernetes.io/projected/b2d6329c-b113-4590-b8a3-fa55474a80dd-kube-api-access-8g4bd\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq\" (UID: \"b2d6329c-b113-4590-b8a3-fa55474a80dd\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.425047 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.425008    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:16.562826 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.562791    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"]
May 28 03:29:16.564672 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:29:16.564644    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d6329c_b113_4590_b8a3_fa55474a80dd.slice/crio-7399ea03868c3d9feb17332f5c4d43150f10fe7afaf475bf72a7dc166bd49485 WatchSource:0}: Error finding container 7399ea03868c3d9feb17332f5c4d43150f10fe7afaf475bf72a7dc166bd49485: Status 404 returned error can't find the container with id 7399ea03868c3d9feb17332f5c4d43150f10fe7afaf475bf72a7dc166bd49485
May 28 03:29:16.603925 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:16.603887    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:29:17.378145 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:17.378100    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq" event={"ID":"b2d6329c-b113-4590-b8a3-fa55474a80dd","Type":"ContainerStarted","Data":"7399ea03868c3d9feb17332f5c4d43150f10fe7afaf475bf72a7dc166bd49485"}
May 28 03:29:18.803922 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:18.803881    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:29:23.206056 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:23.205956    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:29:23.407875 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:23.407835    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq" event={"ID":"b2d6329c-b113-4590-b8a3-fa55474a80dd","Type":"ContainerStarted","Data":"8755aeb385e417b2b57b624615d91156a14eb42965cb8f4182adab8e33bd01bd"}
May 28 03:29:26.398468 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:26.398434    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:29:28.428220 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:28.428189    2575 generic.go:358] "Generic (PLEG): container finished" podID="b2d6329c-b113-4590-b8a3-fa55474a80dd" containerID="8755aeb385e417b2b57b624615d91156a14eb42965cb8f4182adab8e33bd01bd" exitCode=0
May 28 03:29:28.428612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:28.428266    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq" event={"ID":"b2d6329c-b113-4590-b8a3-fa55474a80dd","Type":"ContainerDied","Data":"8755aeb385e417b2b57b624615d91156a14eb42965cb8f4182adab8e33bd01bd"}
May 28 03:29:30.438176 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:30.438143    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq" event={"ID":"b2d6329c-b113-4590-b8a3-fa55474a80dd","Type":"ContainerStarted","Data":"70ca85f53633ffea001bd0979c81b7a840998b33118885c0c7d8a55cb199aed3"}
May 28 03:29:30.438564 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:30.438381    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:29:30.459951 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:30.459905    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq" podStartSLOduration=1.531846223 podStartE2EDuration="14.459892496s" podCreationTimestamp="2026-05-28 03:29:16 +0000 UTC" firstStartedPulling="2026-05-28 03:29:16.566508094 +0000 UTC m=+745.375523679" lastFinishedPulling="2026-05-28 03:29:29.494554365 +0000 UTC m=+758.303569952" observedRunningTime="2026-05-28 03:29:30.456520363 +0000 UTC m=+759.265535971" watchObservedRunningTime="2026-05-28 03:29:30.459892496 +0000 UTC m=+759.268908102"
May 28 03:29:41.455779 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:29:41.455746    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq"
May 28 03:30:00.138522 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.138485    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29665650-xk4mw"]
May 28 03:30:00.160393 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.160356    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665650-xk4mw"]
May 28 03:30:00.160568 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.160437    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw"
May 28 03:30:00.163326 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.163305    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lng4z\""
May 28 03:30:00.319213 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.319179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw9tk\" (UniqueName: \"kubernetes.io/projected/40e457b5-6621-46f1-af80-ef8943568ecc-kube-api-access-zw9tk\") pod \"maas-api-key-cleanup-29665650-xk4mw\" (UID: \"40e457b5-6621-46f1-af80-ef8943568ecc\") " pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw"
May 28 03:30:00.420566 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.420537    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zw9tk\" (UniqueName: \"kubernetes.io/projected/40e457b5-6621-46f1-af80-ef8943568ecc-kube-api-access-zw9tk\") pod \"maas-api-key-cleanup-29665650-xk4mw\" (UID: \"40e457b5-6621-46f1-af80-ef8943568ecc\") " pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw"
May 28 03:30:00.429367 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.429338    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw9tk\" (UniqueName: \"kubernetes.io/projected/40e457b5-6621-46f1-af80-ef8943568ecc-kube-api-access-zw9tk\") pod \"maas-api-key-cleanup-29665650-xk4mw\" (UID: \"40e457b5-6621-46f1-af80-ef8943568ecc\") " pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw"
May 28 03:30:00.471139 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.471114    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw"
May 28 03:30:00.846625 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:00.846597    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665650-xk4mw"]
May 28 03:30:00.847183 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:30:00.847151    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e457b5_6621_46f1_af80_ef8943568ecc.slice/crio-645cea08b8e3e6b177aa29be86c356d91f973ea3c3a7db18564d6f2763d0732b WatchSource:0}: Error finding container 645cea08b8e3e6b177aa29be86c356d91f973ea3c3a7db18564d6f2763d0732b: Status 404 returned error can't find the container with id 645cea08b8e3e6b177aa29be86c356d91f973ea3c3a7db18564d6f2763d0732b
May 28 03:30:01.565456 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:01.565423    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw" event={"ID":"40e457b5-6621-46f1-af80-ef8943568ecc","Type":"ContainerStarted","Data":"645cea08b8e3e6b177aa29be86c356d91f973ea3c3a7db18564d6f2763d0732b"}
May 28 03:30:02.403174 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:02.399066    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:30:03.576191 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:03.576154    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw" event={"ID":"40e457b5-6621-46f1-af80-ef8943568ecc","Type":"ContainerStarted","Data":"1fa7c011dfe242d18df252250bb487e7fb5d8806aacb6a46ef9ff208f0f1b4b9"}
May 28 03:30:03.593866 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:03.593820    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw" podStartSLOduration=1.30701436 podStartE2EDuration="3.59380567s" podCreationTimestamp="2026-05-28 03:30:00 +0000 UTC" firstStartedPulling="2026-05-28 03:30:00.849010146 +0000 UTC m=+789.658025730" lastFinishedPulling="2026-05-28 03:30:03.135801439 +0000 UTC m=+791.944817040" observedRunningTime="2026-05-28 03:30:03.591152079 +0000 UTC m=+792.400167685" watchObservedRunningTime="2026-05-28 03:30:03.59380567 +0000 UTC m=+792.402821277"
May 28 03:30:04.581131 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:04.581098    2575 generic.go:358] "Generic (PLEG): container finished" podID="40e457b5-6621-46f1-af80-ef8943568ecc" containerID="1fa7c011dfe242d18df252250bb487e7fb5d8806aacb6a46ef9ff208f0f1b4b9" exitCode=0
May 28 03:30:04.581547 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:04.581139    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw" event={"ID":"40e457b5-6621-46f1-af80-ef8943568ecc","Type":"ContainerDied","Data":"1fa7c011dfe242d18df252250bb487e7fb5d8806aacb6a46ef9ff208f0f1b4b9"}
May 28 03:30:05.716766 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:05.716739    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw"
May 28 03:30:05.768557 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:05.768531    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw9tk\" (UniqueName: \"kubernetes.io/projected/40e457b5-6621-46f1-af80-ef8943568ecc-kube-api-access-zw9tk\") pod \"40e457b5-6621-46f1-af80-ef8943568ecc\" (UID: \"40e457b5-6621-46f1-af80-ef8943568ecc\") "
May 28 03:30:05.770595 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:05.770575    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e457b5-6621-46f1-af80-ef8943568ecc-kube-api-access-zw9tk" (OuterVolumeSpecName: "kube-api-access-zw9tk") pod "40e457b5-6621-46f1-af80-ef8943568ecc" (UID: "40e457b5-6621-46f1-af80-ef8943568ecc"). InnerVolumeSpecName "kube-api-access-zw9tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:30:05.870101 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:05.870028    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw9tk\" (UniqueName: \"kubernetes.io/projected/40e457b5-6621-46f1-af80-ef8943568ecc-kube-api-access-zw9tk\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:30:06.589403 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:06.589367    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw" event={"ID":"40e457b5-6621-46f1-af80-ef8943568ecc","Type":"ContainerDied","Data":"645cea08b8e3e6b177aa29be86c356d91f973ea3c3a7db18564d6f2763d0732b"}
May 28 03:30:06.589403 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:06.589390    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665650-xk4mw"
May 28 03:30:06.589682 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:06.589399    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="645cea08b8e3e6b177aa29be86c356d91f973ea3c3a7db18564d6f2763d0732b"
May 28 03:30:27.606735 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:27.606695    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:30:46.113498 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.113459    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56ff5dd595-fsw6d"]
May 28 03:30:46.114139 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.114048    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e457b5-6621-46f1-af80-ef8943568ecc" containerName="cleanup"
May 28 03:30:46.114139 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.114069    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e457b5-6621-46f1-af80-ef8943568ecc" containerName="cleanup"
May 28 03:30:46.114311 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.114192    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="40e457b5-6621-46f1-af80-ef8943568ecc" containerName="cleanup"
May 28 03:30:46.116334 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.116309    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56ff5dd595-fsw6d"
May 28 03:30:46.119101 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.119082    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xlm95\""
May 28 03:30:46.120064 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.120049    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 03:30:46.124738 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.124716    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56ff5dd595-fsw6d"]
May 28 03:30:46.166073 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.166028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfptx\" (UniqueName: \"kubernetes.io/projected/d8cd7490-261b-4ea1-85e2-14066deae861-kube-api-access-zfptx\") pod \"authorino-56ff5dd595-fsw6d\" (UID: \"d8cd7490-261b-4ea1-85e2-14066deae861\") " pod="kuadrant-system/authorino-56ff5dd595-fsw6d"
May 28 03:30:46.166290 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.166148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8cd7490-261b-4ea1-85e2-14066deae861-tls-cert\") pod \"authorino-56ff5dd595-fsw6d\" (UID: \"d8cd7490-261b-4ea1-85e2-14066deae861\") " pod="kuadrant-system/authorino-56ff5dd595-fsw6d"
May 28 03:30:46.267166 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.267127    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfptx\" (UniqueName: \"kubernetes.io/projected/d8cd7490-261b-4ea1-85e2-14066deae861-kube-api-access-zfptx\") pod \"authorino-56ff5dd595-fsw6d\" (UID: \"d8cd7490-261b-4ea1-85e2-14066deae861\") " pod="kuadrant-system/authorino-56ff5dd595-fsw6d"
May 28 03:30:46.267374 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.267216    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8cd7490-261b-4ea1-85e2-14066deae861-tls-cert\") pod \"authorino-56ff5dd595-fsw6d\" (UID: \"d8cd7490-261b-4ea1-85e2-14066deae861\") " pod="kuadrant-system/authorino-56ff5dd595-fsw6d"
May 28 03:30:46.269963 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.269932    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8cd7490-261b-4ea1-85e2-14066deae861-tls-cert\") pod \"authorino-56ff5dd595-fsw6d\" (UID: \"d8cd7490-261b-4ea1-85e2-14066deae861\") " pod="kuadrant-system/authorino-56ff5dd595-fsw6d"
May 28 03:30:46.282470 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.282443    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfptx\" (UniqueName: \"kubernetes.io/projected/d8cd7490-261b-4ea1-85e2-14066deae861-kube-api-access-zfptx\") pod \"authorino-56ff5dd595-fsw6d\" (UID: \"d8cd7490-261b-4ea1-85e2-14066deae861\") " pod="kuadrant-system/authorino-56ff5dd595-fsw6d"
May 28 03:30:46.426138 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.426105    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56ff5dd595-fsw6d"
May 28 03:30:46.566958 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.566929    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56ff5dd595-fsw6d"]
May 28 03:30:46.567639 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:30:46.567614    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8cd7490_261b_4ea1_85e2_14066deae861.slice/crio-c91564c42c5687a0d67264a16170970cdc23b9d250e7fa19146b7e48b8ddd815 WatchSource:0}: Error finding container c91564c42c5687a0d67264a16170970cdc23b9d250e7fa19146b7e48b8ddd815: Status 404 returned error can't find the container with id c91564c42c5687a0d67264a16170970cdc23b9d250e7fa19146b7e48b8ddd815
May 28 03:30:46.762859 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:46.762767    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56ff5dd595-fsw6d" event={"ID":"d8cd7490-261b-4ea1-85e2-14066deae861","Type":"ContainerStarted","Data":"c91564c42c5687a0d67264a16170970cdc23b9d250e7fa19146b7e48b8ddd815"}
May 28 03:30:47.768447 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:47.768340    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56ff5dd595-fsw6d" event={"ID":"d8cd7490-261b-4ea1-85e2-14066deae861","Type":"ContainerStarted","Data":"6c2aafebc9a9ff0f5c76724fc727d8447b61bb4ba4357acda64d5536397a027d"}
May 28 03:30:47.790450 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:30:47.790393    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-56ff5dd595-fsw6d" podStartSLOduration=0.936582122 podStartE2EDuration="1.790377322s" podCreationTimestamp="2026-05-28 03:30:46 +0000 UTC" firstStartedPulling="2026-05-28 03:30:46.569007729 +0000 UTC m=+835.378023315" lastFinishedPulling="2026-05-28 03:30:47.422802932 +0000 UTC m=+836.231818515" observedRunningTime="2026-05-28 03:30:47.787964027 +0000 UTC m=+836.596979633" watchObservedRunningTime="2026-05-28 03:30:47.790377322 +0000 UTC m=+836.599392928"
May 28 03:31:04.405353 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:31:04.405314    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:31:09.500254 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:31:09.500200    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:31:15.807589 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:31:15.807545    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:31:25.305555 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:31:25.301573    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:31:34.416268 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:31:34.416211    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:31:45.205401 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:31:45.205307    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:31:54.309605 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:31:54.309565    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:32:03.899106 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:32:03.899065    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:33:16.912422 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:33:16.912390    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:33:33.000652 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:33:33.000620    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:34:11.900937 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:34:11.900905    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:34:27.612579 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:34:27.612532    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:34:43.402071 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:34:43.401984    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:34:59.897219 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:34:59.897180    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:35:58.003664 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:35:58.003632    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:36:06.299282 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:36:06.299190    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:36:23.703803 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:36:23.703762    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:36:31.912201 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:36:31.912160    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:36:48.303483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:36:48.303442    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:36:57.802511 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:36:57.802467    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:37:30.305067 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:37:30.305032    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:37:37.900724 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:37:37.900624    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:37:47.420334 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:37:47.420292    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:37:55.205100 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:37:55.205063    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:38:03.618693 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:38:03.618635    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:38:11.598724 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:38:11.598690    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:38:16.197533 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:38:16.197496    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:38:20.104671 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:38:20.104631    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:38:34.002506 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:38:34.002473    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:39:20.306184 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:39:20.306147    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:39:26.009989 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:39:26.009949    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:39:32.599098 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:39:32.599063    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:39:40.105061 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:39:40.105022    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:39:49.604010 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:39:49.603974    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:39:57.701040 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:39:57.701008    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:40:06.599880 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:40:06.599840    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:40:15.306440 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:40:15.306404    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:40:24.202425 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:40:24.202389    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:40:32.700779 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:40:32.700733    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:40:41.697025 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:40:41.696936    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:40:50.303776 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:40:50.303742    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:40:59.102478 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:40:59.102444    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:41:07.401913 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:41:07.401878    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:41:16.294919 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:41:16.294880    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:41:25.201527 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:41:25.201488    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:41:34.505976 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:41:34.505935    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:41:42.403750 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:41:42.403707    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:42:34.068437 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.068398    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"]
May 28 03:42:34.070784 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.068638    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4" podUID="7661559c-4c9a-4d16-ae1a-6df7fd2381cf" containerName="manager" containerID="cri-o://b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486" gracePeriod=10
May 28 03:42:34.617999 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.617977    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:42:34.680532 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.680493    2575 generic.go:358] "Generic (PLEG): container finished" podID="7661559c-4c9a-4d16-ae1a-6df7fd2381cf" containerID="b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486" exitCode=0
May 28 03:42:34.680699 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.680531    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4" event={"ID":"7661559c-4c9a-4d16-ae1a-6df7fd2381cf","Type":"ContainerDied","Data":"b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486"}
May 28 03:42:34.680699 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.680577    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"
May 28 03:42:34.680699 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.680586    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4" event={"ID":"7661559c-4c9a-4d16-ae1a-6df7fd2381cf","Type":"ContainerDied","Data":"5aacb7504efa57bbd9fd6a789ecb79d2c0fb96e98fbf67c94f0e1886ab0fba70"}
May 28 03:42:34.680699 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.680607    2575 scope.go:117] "RemoveContainer" containerID="b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486"
May 28 03:42:34.691704 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.691683    2575 scope.go:117] "RemoveContainer" containerID="b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486"
May 28 03:42:34.691971 ip-10-0-135-231 kubenswrapper[2575]: E0528 03:42:34.691953    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486\": container with ID starting with b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486 not found: ID does not exist" containerID="b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486"
May 28 03:42:34.692044 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.691977    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486"} err="failed to get container status \"b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486\": rpc error: code = NotFound desc = could not find container \"b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486\": container with ID starting with b3371a80902bc7b0a7a6dd050b2d971e478fb833bb5f1be9e0080f9b13995486 not found: ID does not exist"
May 28 03:42:34.726377 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.726321    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jsgh\" (UniqueName: \"kubernetes.io/projected/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-kube-api-access-8jsgh\") pod \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\" (UID: \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\") "
May 28 03:42:34.726377 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.726359    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-extensions-socket-volume\") pod \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\" (UID: \"7661559c-4c9a-4d16-ae1a-6df7fd2381cf\") "
May 28 03:42:34.726719 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.726698    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7661559c-4c9a-4d16-ae1a-6df7fd2381cf" (UID: "7661559c-4c9a-4d16-ae1a-6df7fd2381cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 03:42:34.728188 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.728158    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-kube-api-access-8jsgh" (OuterVolumeSpecName: "kube-api-access-8jsgh") pod "7661559c-4c9a-4d16-ae1a-6df7fd2381cf" (UID: "7661559c-4c9a-4d16-ae1a-6df7fd2381cf"). InnerVolumeSpecName "kube-api-access-8jsgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:42:34.827755 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.827733    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jsgh\" (UniqueName: \"kubernetes.io/projected/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-kube-api-access-8jsgh\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:42:34.827755 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:34.827751    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7661559c-4c9a-4d16-ae1a-6df7fd2381cf-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:42:35.004860 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:35.004826    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"]
May 28 03:42:35.008667 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:35.008645    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghwc4"]
May 28 03:42:35.750614 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:42:35.750573    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7661559c-4c9a-4d16-ae1a-6df7fd2381cf" path="/var/lib/kubelet/pods/7661559c-4c9a-4d16-ae1a-6df7fd2381cf/volumes"
May 28 03:43:40.113601 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.113510    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"]
May 28 03:43:40.114199 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.114106    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7661559c-4c9a-4d16-ae1a-6df7fd2381cf" containerName="manager"
May 28 03:43:40.114199 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.114126    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7661559c-4c9a-4d16-ae1a-6df7fd2381cf" containerName="manager"
May 28 03:43:40.114369 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.114235    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7661559c-4c9a-4d16-ae1a-6df7fd2381cf" containerName="manager"
May 28 03:43:40.117386 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.117365    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.120206 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.120189    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vntjn\""
May 28 03:43:40.132025 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.131997    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"]
May 28 03:43:40.235696 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.235647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddfaa1f0-1d9d-4bff-96e4-8891b16accba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hhhpp\" (UID: \"ddfaa1f0-1d9d-4bff-96e4-8891b16accba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.235696 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.235699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxr42\" (UniqueName: \"kubernetes.io/projected/ddfaa1f0-1d9d-4bff-96e4-8891b16accba-kube-api-access-nxr42\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hhhpp\" (UID: \"ddfaa1f0-1d9d-4bff-96e4-8891b16accba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.336542 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.336508    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddfaa1f0-1d9d-4bff-96e4-8891b16accba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hhhpp\" (UID: \"ddfaa1f0-1d9d-4bff-96e4-8891b16accba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.336697 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.336548    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxr42\" (UniqueName: \"kubernetes.io/projected/ddfaa1f0-1d9d-4bff-96e4-8891b16accba-kube-api-access-nxr42\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hhhpp\" (UID: \"ddfaa1f0-1d9d-4bff-96e4-8891b16accba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.336966 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.336943    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddfaa1f0-1d9d-4bff-96e4-8891b16accba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hhhpp\" (UID: \"ddfaa1f0-1d9d-4bff-96e4-8891b16accba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.347001 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.346979    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxr42\" (UniqueName: \"kubernetes.io/projected/ddfaa1f0-1d9d-4bff-96e4-8891b16accba-kube-api-access-nxr42\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hhhpp\" (UID: \"ddfaa1f0-1d9d-4bff-96e4-8891b16accba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.427789 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.427762    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.563197 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.563169    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"]
May 28 03:43:40.564708 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:43:40.564682    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfaa1f0_1d9d_4bff_96e4_8891b16accba.slice/crio-b8c68fb15b733384ff1812032c9169b3b4f97a334c4a702c244d2d606a1b00c9 WatchSource:0}: Error finding container b8c68fb15b733384ff1812032c9169b3b4f97a334c4a702c244d2d606a1b00c9: Status 404 returned error can't find the container with id b8c68fb15b733384ff1812032c9169b3b4f97a334c4a702c244d2d606a1b00c9
May 28 03:43:40.570069 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.570047    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 03:43:40.949164 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.949129    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp" event={"ID":"ddfaa1f0-1d9d-4bff-96e4-8891b16accba","Type":"ContainerStarted","Data":"ab5e25ad1a7300864cc0db50516d6fcd605c5c7c4838f940ddf487836ed29d89"}
May 28 03:43:40.949344 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.949175    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp" event={"ID":"ddfaa1f0-1d9d-4bff-96e4-8891b16accba","Type":"ContainerStarted","Data":"b8c68fb15b733384ff1812032c9169b3b4f97a334c4a702c244d2d606a1b00c9"}
May 28 03:43:40.949344 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.949236    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:40.974283 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:40.974212    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp" podStartSLOduration=0.974194064 podStartE2EDuration="974.194064ms" podCreationTimestamp="2026-05-28 03:43:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:43:40.968070762 +0000 UTC m=+1609.777086368" watchObservedRunningTime="2026-05-28 03:43:40.974194064 +0000 UTC m=+1609.783209663"
May 28 03:43:51.955584 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:51.955549    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hhhpp"
May 28 03:43:59.795842 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:43:59.795797    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:44:04.900863 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:44:04.900825    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:44:30.596691 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:44:30.596649    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:44:37.706074 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:44:37.706025    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:44:47.123683 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:44:47.123641    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:44:56.403207 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:44:56.403174    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:45:00.136676 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.136646    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29665665-k2xvn"]
May 28 03:45:00.140045 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.140027    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn"
May 28 03:45:00.142612 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.142588    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lng4z\""
May 28 03:45:00.149835 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.149803    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665665-k2xvn"]
May 28 03:45:00.191440 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.191408    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlm9l\" (UniqueName: \"kubernetes.io/projected/e463f75f-2fef-45d3-bc83-0fa179eaf491-kube-api-access-jlm9l\") pod \"maas-api-key-cleanup-29665665-k2xvn\" (UID: \"e463f75f-2fef-45d3-bc83-0fa179eaf491\") " pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn"
May 28 03:45:00.292774 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.292745    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlm9l\" (UniqueName: \"kubernetes.io/projected/e463f75f-2fef-45d3-bc83-0fa179eaf491-kube-api-access-jlm9l\") pod \"maas-api-key-cleanup-29665665-k2xvn\" (UID: \"e463f75f-2fef-45d3-bc83-0fa179eaf491\") " pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn"
May 28 03:45:00.302306 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.302271    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlm9l\" (UniqueName: \"kubernetes.io/projected/e463f75f-2fef-45d3-bc83-0fa179eaf491-kube-api-access-jlm9l\") pod \"maas-api-key-cleanup-29665665-k2xvn\" (UID: \"e463f75f-2fef-45d3-bc83-0fa179eaf491\") " pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn"
May 28 03:45:00.456038 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.456010    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn"
May 28 03:45:00.793434 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:00.793405    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665665-k2xvn"]
May 28 03:45:00.795358 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:45:00.795333    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode463f75f_2fef_45d3_bc83_0fa179eaf491.slice/crio-db717fa9e51b06735ed2e27a28cfbe24a4f283e7729203eb0878d265041d3641 WatchSource:0}: Error finding container db717fa9e51b06735ed2e27a28cfbe24a4f283e7729203eb0878d265041d3641: Status 404 returned error can't find the container with id db717fa9e51b06735ed2e27a28cfbe24a4f283e7729203eb0878d265041d3641
May 28 03:45:01.296408 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:01.296375    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn" event={"ID":"e463f75f-2fef-45d3-bc83-0fa179eaf491","Type":"ContainerStarted","Data":"817bf5dd35fbdbb192816a6368aa3052b5a2096676d547e18949aff4113caef7"}
May 28 03:45:01.296408 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:01.296410    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn" event={"ID":"e463f75f-2fef-45d3-bc83-0fa179eaf491","Type":"ContainerStarted","Data":"db717fa9e51b06735ed2e27a28cfbe24a4f283e7729203eb0878d265041d3641"}
May 28 03:45:01.313862 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:01.313784    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn" podStartSLOduration=1.313771791 podStartE2EDuration="1.313771791s" podCreationTimestamp="2026-05-28 03:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:45:01.312022415 +0000 UTC m=+1690.121038022" watchObservedRunningTime="2026-05-28 03:45:01.313771791 +0000 UTC m=+1690.122787396"
May 28 03:45:02.302980 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:02.302942    2575 generic.go:358] "Generic (PLEG): container finished" podID="e463f75f-2fef-45d3-bc83-0fa179eaf491" containerID="817bf5dd35fbdbb192816a6368aa3052b5a2096676d547e18949aff4113caef7" exitCode=0
May 28 03:45:02.303402 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:02.303011    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn" event={"ID":"e463f75f-2fef-45d3-bc83-0fa179eaf491","Type":"ContainerDied","Data":"817bf5dd35fbdbb192816a6368aa3052b5a2096676d547e18949aff4113caef7"}
May 28 03:45:03.443097 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:03.443070    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn"
May 28 03:45:03.522783 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:03.522751    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlm9l\" (UniqueName: \"kubernetes.io/projected/e463f75f-2fef-45d3-bc83-0fa179eaf491-kube-api-access-jlm9l\") pod \"e463f75f-2fef-45d3-bc83-0fa179eaf491\" (UID: \"e463f75f-2fef-45d3-bc83-0fa179eaf491\") "
May 28 03:45:03.524900 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:03.524878    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e463f75f-2fef-45d3-bc83-0fa179eaf491-kube-api-access-jlm9l" (OuterVolumeSpecName: "kube-api-access-jlm9l") pod "e463f75f-2fef-45d3-bc83-0fa179eaf491" (UID: "e463f75f-2fef-45d3-bc83-0fa179eaf491"). InnerVolumeSpecName "kube-api-access-jlm9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 03:45:03.623735 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:03.623646    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlm9l\" (UniqueName: \"kubernetes.io/projected/e463f75f-2fef-45d3-bc83-0fa179eaf491-kube-api-access-jlm9l\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
May 28 03:45:04.311936 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:04.311907    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn"
May 28 03:45:04.312141 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:04.311931    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665665-k2xvn" event={"ID":"e463f75f-2fef-45d3-bc83-0fa179eaf491","Type":"ContainerDied","Data":"db717fa9e51b06735ed2e27a28cfbe24a4f283e7729203eb0878d265041d3641"}
May 28 03:45:04.312141 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:04.311966    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db717fa9e51b06735ed2e27a28cfbe24a4f283e7729203eb0878d265041d3641"
May 28 03:45:06.097864 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:06.097781    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:45:16.703606 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:16.703561    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:45:25.904072 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:25.904034    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:45:35.596496 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:35.596459    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:45:44.203649 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:44.203603    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:45:55.099605 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:45:55.099568    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:46:04.500558 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:46:04.500523    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:46:39.301752 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:46:39.301654    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:47:22.356500 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:47:22.356460    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:47:30.300841 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:47:30.300798    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:47:39.309425 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:47:39.309393    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:47:47.300846 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:47:47.300813    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:47:56.513881 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:47:56.513841    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:48:09.705068 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:48:09.705030    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:48:17.901539 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:48:17.901499    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:48:25.903867 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:48:25.903827    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:48:34.903343 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:48:34.903307    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:48:42.900875 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:48:42.900836    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:48:51.407402 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:48:51.407365    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:49:01.605450 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:49:01.605410    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:49:19.803307 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:49:19.803269    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:49:28.113206 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:49:28.113168    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:49:36.602049 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:49:36.601955    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:49:44.598622 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:49:44.598587    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:50:01.918076 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:50:01.918038    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:50:10.100447 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:50:10.100399    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:50:19.106445 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:50:19.106395    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:50:27.804607 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:50:27.804565    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:50:35.401994 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:50:35.401959    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:50:44.799887 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:50:44.799850    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:50:53.993969 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:50:53.993934    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:51:07.200314 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:51:07.200210    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:51:16.409875 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:51:16.409826    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:51:25.907482 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:51:25.907445    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:51:35.703840 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:51:35.703798    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:51:44.102581 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:51:44.102545    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:51:53.300561 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:51:53.300520    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:51:59.457997 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:51:59.457960    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:52:16.500774 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:52:16.500736    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:52:25.398425 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:52:25.398385    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:52:33.900006 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:52:33.899967    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:52:41.996354 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:52:41.996316    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:53:05.396711 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:05.396671    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:53:19.106171 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:19.106125    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-55869"]
May 28 03:53:22.042603 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:22.042570    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56ff5dd595-fsw6d_d8cd7490-261b-4ea1-85e2-14066deae861/authorino/0.log"
May 28 03:53:26.463385 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:26.463358    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665650-xk4mw_40e457b5-6621-46f1-af80-ef8943568ecc/cleanup/0.log"
May 28 03:53:26.573937 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:26.573896    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665665-k2xvn_e463f75f-2fef-45d3-bc83-0fa179eaf491/cleanup/0.log"
May 28 03:53:27.038459 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:27.038429    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cd789dcd-bnb9p_ae649575-c446-4123-903a-eacdeb311582/manager/0.log"
May 28 03:53:28.011232 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.011202    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l_a43682a5-9dba-4423-8b3c-d5f3ef3ebef0/util/0.log"
May 28 03:53:28.017047 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.017027    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l_a43682a5-9dba-4423-8b3c-d5f3ef3ebef0/pull/0.log"
May 28 03:53:28.022319 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.022302    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l_a43682a5-9dba-4423-8b3c-d5f3ef3ebef0/extract/0.log"
May 28 03:53:28.123394 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.123289    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r_2668f310-5905-4a73-aef3-8f47a60111ff/util/0.log"
May 28 03:53:28.128795 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.128768    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r_2668f310-5905-4a73-aef3-8f47a60111ff/pull/0.log"
May 28 03:53:28.133956 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.133941    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r_2668f310-5905-4a73-aef3-8f47a60111ff/extract/0.log"
May 28 03:53:28.237764 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.237738    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw_92547c43-1c68-42b5-adf0-6951024cb1c9/util/0.log"
May 28 03:53:28.243235 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.243218    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw_92547c43-1c68-42b5-adf0-6951024cb1c9/pull/0.log"
May 28 03:53:28.249067 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.249051    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw_92547c43-1c68-42b5-adf0-6951024cb1c9/extract/0.log"
May 28 03:53:28.362027 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.361950    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r_c77dcc6e-8d29-464d-b48f-14c01b2ce45e/util/0.log"
May 28 03:53:28.367627 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.367605    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r_c77dcc6e-8d29-464d-b48f-14c01b2ce45e/pull/0.log"
May 28 03:53:28.373127 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.373106    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r_c77dcc6e-8d29-464d-b48f-14c01b2ce45e/extract/0.log"
May 28 03:53:28.481837 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.481803    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56ff5dd595-fsw6d_d8cd7490-261b-4ea1-85e2-14066deae861/authorino/0.log"
May 28 03:53:28.696617 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:28.696584    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-62j2j_226723ed-cfc4-4b9a-a121-d141a974188d/manager/0.log"
May 28 03:53:29.027292 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:29.027197    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-hhhpp_ddfaa1f0-1d9d-4bff-96e4-8891b16accba/manager/0.log"
May 28 03:53:29.143898 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:29.143867    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-55869_805867f6-53dc-4a69-b513-32ca9b3cd78b/limitador/0.log"
May 28 03:53:29.592638 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:29.592607    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b85mn5_59e97508-cf5e-4335-9a45-e436c26f5b58/istio-proxy/0.log"
May 28 03:53:30.021777 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:30.021747    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-flhth_81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7/istio-proxy/0.log"
May 28 03:53:30.238793 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:30.238766    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d5f966876-bmt5s_dd0e16eb-b462-4bcd-9a50-25cd8fd20630/router/0.log"
May 28 03:53:30.669600 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:30.669567    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq_b2d6329c-b113-4590-b8a3-fa55474a80dd/storage-initializer/0.log"
May 28 03:53:30.675885 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:30.675863    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-9ltzq_b2d6329c-b113-4590-b8a3-fa55474a80dd/main/0.log"
May 28 03:53:35.113662 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.113621    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q6qd7/must-gather-f8pcf"]
May 28 03:53:35.114403 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.114379    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e463f75f-2fef-45d3-bc83-0fa179eaf491" containerName="cleanup"
May 28 03:53:35.114403 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.114405    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e463f75f-2fef-45d3-bc83-0fa179eaf491" containerName="cleanup"
May 28 03:53:35.114580 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.114514    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="e463f75f-2fef-45d3-bc83-0fa179eaf491" containerName="cleanup"
May 28 03:53:35.118521 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.118502    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6qd7/must-gather-f8pcf"
May 28 03:53:35.121081 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.121059    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6qd7\"/\"kube-root-ca.crt\""
May 28 03:53:35.121196 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.121136    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q6qd7\"/\"default-dockercfg-lbjv5\""
May 28 03:53:35.122207 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.122188    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6qd7\"/\"openshift-service-ca.crt\""
May 28 03:53:35.134955 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.134929    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6qd7/must-gather-f8pcf"]
May 28 03:53:35.245259 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.245206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb4694b3-1604-4727-ad14-90f838064a24-must-gather-output\") pod \"must-gather-f8pcf\" (UID: \"cb4694b3-1604-4727-ad14-90f838064a24\") " pod="openshift-must-gather-q6qd7/must-gather-f8pcf"
May 28 03:53:35.245440 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.245286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpr8k\" (UniqueName: \"kubernetes.io/projected/cb4694b3-1604-4727-ad14-90f838064a24-kube-api-access-hpr8k\") pod \"must-gather-f8pcf\" (UID: \"cb4694b3-1604-4727-ad14-90f838064a24\") " pod="openshift-must-gather-q6qd7/must-gather-f8pcf"
May 28 03:53:35.346794 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.346757    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb4694b3-1604-4727-ad14-90f838064a24-must-gather-output\") pod \"must-gather-f8pcf\" (UID: \"cb4694b3-1604-4727-ad14-90f838064a24\") " pod="openshift-must-gather-q6qd7/must-gather-f8pcf"
May 28 03:53:35.346794 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.346794    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpr8k\" (UniqueName: \"kubernetes.io/projected/cb4694b3-1604-4727-ad14-90f838064a24-kube-api-access-hpr8k\") pod \"must-gather-f8pcf\" (UID: \"cb4694b3-1604-4727-ad14-90f838064a24\") " pod="openshift-must-gather-q6qd7/must-gather-f8pcf"
May 28 03:53:35.347145 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.347125    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb4694b3-1604-4727-ad14-90f838064a24-must-gather-output\") pod \"must-gather-f8pcf\" (UID: \"cb4694b3-1604-4727-ad14-90f838064a24\") " pod="openshift-must-gather-q6qd7/must-gather-f8pcf"
May 28 03:53:35.355188 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.355158    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpr8k\" (UniqueName: \"kubernetes.io/projected/cb4694b3-1604-4727-ad14-90f838064a24-kube-api-access-hpr8k\") pod \"must-gather-f8pcf\" (UID: \"cb4694b3-1604-4727-ad14-90f838064a24\") " pod="openshift-must-gather-q6qd7/must-gather-f8pcf"
May 28 03:53:35.428487 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.428453    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6qd7/must-gather-f8pcf"
May 28 03:53:35.567092 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.567066    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6qd7/must-gather-f8pcf"]
May 28 03:53:35.568719 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:53:35.568692    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb4694b3_1604_4727_ad14_90f838064a24.slice/crio-96f90197f3beb55da50cb47f49752de9c76de8ce01f0188972ad54a3792ada66 WatchSource:0}: Error finding container 96f90197f3beb55da50cb47f49752de9c76de8ce01f0188972ad54a3792ada66: Status 404 returned error can't find the container with id 96f90197f3beb55da50cb47f49752de9c76de8ce01f0188972ad54a3792ada66
May 28 03:53:35.571051 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:35.571035    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 03:53:36.460811 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:36.460651    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6qd7/must-gather-f8pcf" event={"ID":"cb4694b3-1604-4727-ad14-90f838064a24","Type":"ContainerStarted","Data":"6de07f52d648e6628d88082f5638a6e16396fd1c267a1590624f7b140de22cfa"}
May 28 03:53:36.460811 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:36.460695    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6qd7/must-gather-f8pcf" event={"ID":"cb4694b3-1604-4727-ad14-90f838064a24","Type":"ContainerStarted","Data":"fc422ec8a61acce6f46cbe89f73526a1b0a2d3a93efb9f6ffb3c05944783312f"}
May 28 03:53:36.460811 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:36.460708    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6qd7/must-gather-f8pcf" event={"ID":"cb4694b3-1604-4727-ad14-90f838064a24","Type":"ContainerStarted","Data":"96f90197f3beb55da50cb47f49752de9c76de8ce01f0188972ad54a3792ada66"}
May 28 03:53:36.480111 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:36.480047    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-q6qd7/must-gather-f8pcf" podStartSLOduration=0.842451781 podStartE2EDuration="1.480026648s" podCreationTimestamp="2026-05-28 03:53:35 +0000 UTC" firstStartedPulling="2026-05-28 03:53:35.571166183 +0000 UTC m=+2204.380181766" lastFinishedPulling="2026-05-28 03:53:36.208741049 +0000 UTC m=+2205.017756633" observedRunningTime="2026-05-28 03:53:36.475985993 +0000 UTC m=+2205.285001600" watchObservedRunningTime="2026-05-28 03:53:36.480026648 +0000 UTC m=+2205.289042255"
May 28 03:53:37.813083 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:37.813045    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8flcl_02041b89-775a-421d-bd11-5966795bcf39/global-pull-secret-syncer/0.log"
May 28 03:53:38.061100 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:38.061065    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x8d4x_c4b60b80-1cc7-437f-910f-87f958f240fd/konnectivity-agent/0.log"
May 28 03:53:38.085364 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:38.085275    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-231.ec2.internal_da623cf4961b94d1fdb8d13cf889b129/haproxy/0.log"
May 28 03:53:41.929797 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:41.929755    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l_a43682a5-9dba-4423-8b3c-d5f3ef3ebef0/extract/0.log"
May 28 03:53:41.956886 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:41.956855    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l_a43682a5-9dba-4423-8b3c-d5f3ef3ebef0/util/0.log"
May 28 03:53:41.990722 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:41.990675    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cn8l_a43682a5-9dba-4423-8b3c-d5f3ef3ebef0/pull/0.log"
May 28 03:53:42.028863 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.028835    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r_2668f310-5905-4a73-aef3-8f47a60111ff/extract/0.log"
May 28 03:53:42.053454 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.053378    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r_2668f310-5905-4a73-aef3-8f47a60111ff/util/0.log"
May 28 03:53:42.082104 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.082074    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08t45r_2668f310-5905-4a73-aef3-8f47a60111ff/pull/0.log"
May 28 03:53:42.112628 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.112586    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw_92547c43-1c68-42b5-adf0-6951024cb1c9/extract/0.log"
May 28 03:53:42.133974 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.133945    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw_92547c43-1c68-42b5-adf0-6951024cb1c9/util/0.log"
May 28 03:53:42.159097 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.159063    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hnblw_92547c43-1c68-42b5-adf0-6951024cb1c9/pull/0.log"
May 28 03:53:42.189523 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.189442    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r_c77dcc6e-8d29-464d-b48f-14c01b2ce45e/extract/0.log"
May 28 03:53:42.213332 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.213299    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r_c77dcc6e-8d29-464d-b48f-14c01b2ce45e/util/0.log"
May 28 03:53:42.236172 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.236137    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g9d2r_c77dcc6e-8d29-464d-b48f-14c01b2ce45e/pull/0.log"
May 28 03:53:42.511318 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.510703    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56ff5dd595-fsw6d_d8cd7490-261b-4ea1-85e2-14066deae861/authorino/0.log"
May 28 03:53:42.578402 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.578373    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-62j2j_226723ed-cfc4-4b9a-a121-d141a974188d/manager/0.log"
May 28 03:53:42.738902 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.738865    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-hhhpp_ddfaa1f0-1d9d-4bff-96e4-8891b16accba/manager/0.log"
May 28 03:53:42.762917 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:42.762837    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-55869_805867f6-53dc-4a69-b513-32ca9b3cd78b/limitador/0.log"
May 28 03:53:44.347386 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.347346    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4863d8fe-0780-4f88-aa34-723ce3ace6d4/alertmanager/0.log"
May 28 03:53:44.370115 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.370087    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4863d8fe-0780-4f88-aa34-723ce3ace6d4/config-reloader/0.log"
May 28 03:53:44.398640 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.398614    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4863d8fe-0780-4f88-aa34-723ce3ace6d4/kube-rbac-proxy-web/0.log"
May 28 03:53:44.424916 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.424885    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4863d8fe-0780-4f88-aa34-723ce3ace6d4/kube-rbac-proxy/0.log"
May 28 03:53:44.445048 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.444895    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4863d8fe-0780-4f88-aa34-723ce3ace6d4/kube-rbac-proxy-metric/0.log"
May 28 03:53:44.463944 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.463908    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4863d8fe-0780-4f88-aa34-723ce3ace6d4/prom-label-proxy/0.log"
May 28 03:53:44.485624 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.485587    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4863d8fe-0780-4f88-aa34-723ce3ace6d4/init-config-reloader/0.log"
May 28 03:53:44.524753 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.524717    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-trb59_2c8c4829-9d2a-49d1-8911-35d7eaa9f31f/cluster-monitoring-operator/0.log"
May 28 03:53:44.549861 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.549834    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-c9s9z_b62ae1aa-9d65-45b7-9fd1-af3aa1688956/kube-state-metrics/0.log"
May 28 03:53:44.566075 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.566038    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-c9s9z_b62ae1aa-9d65-45b7-9fd1-af3aa1688956/kube-rbac-proxy-main/0.log"
May 28 03:53:44.588016 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.587990    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-c9s9z_b62ae1aa-9d65-45b7-9fd1-af3aa1688956/kube-rbac-proxy-self/0.log"
May 28 03:53:44.616483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.616365    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5447bdddcc-zjh67_862db339-675b-49db-b27c-822e3a267797/metrics-server/0.log"
May 28 03:53:44.674118 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.674083    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9d4w_c05d391c-7d3c-429a-9e5a-e8d1ba481e46/node-exporter/0.log"
May 28 03:53:44.694213 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.694175    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9d4w_c05d391c-7d3c-429a-9e5a-e8d1ba481e46/kube-rbac-proxy/0.log"
May 28 03:53:44.716730 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:44.716699    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9d4w_c05d391c-7d3c-429a-9e5a-e8d1ba481e46/init-textfile/0.log"
May 28 03:53:45.155294 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:45.155268    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-gltcn_bc7ce473-061b-487d-836f-ff3b36ec7554/prometheus-operator-admission-webhook/0.log"
May 28 03:53:45.188483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:45.188452    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8cbbcd75-kglfb_6824f236-acaa-47eb-b5e5-809d99db1a91/telemeter-client/0.log"
May 28 03:53:45.209464 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:45.209418    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8cbbcd75-kglfb_6824f236-acaa-47eb-b5e5-809d99db1a91/reload/0.log"
May 28 03:53:45.232708 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:45.232649    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8cbbcd75-kglfb_6824f236-acaa-47eb-b5e5-809d99db1a91/kube-rbac-proxy/0.log"
May 28 03:53:46.614049 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.614017    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"]
May 28 03:53:46.620909 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.620882    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.627651 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.627609    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"]
May 28 03:53:46.773379 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.773345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-podres\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.773565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.773407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-lib-modules\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.773565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.773454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-proc\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.773565 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.773526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-sys\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.773721 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.773585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn8w4\" (UniqueName: \"kubernetes.io/projected/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-kube-api-access-qn8w4\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.874942 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.874847    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-sys\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.875394 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.874960    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qn8w4\" (UniqueName: \"kubernetes.io/projected/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-kube-api-access-qn8w4\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.875537 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.875513    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-podres\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.875623 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.875598    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-lib-modules\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.875692 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.875646    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-proc\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.875816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.875743    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-proc\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.875816 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.874983    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-sys\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.876135 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.876083    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-podres\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.876349 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.876330    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-lib-modules\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.885216 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.885190    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn8w4\" (UniqueName: \"kubernetes.io/projected/55b7a96d-5c11-4d92-b7c3-c06b13ef28e4-kube-api-access-qn8w4\") pod \"perf-node-gather-daemonset-bbjfr\" (UID: \"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4\") " pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:46.934011 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:46.933976    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:47.104569 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:47.104520    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"]
May 28 03:53:47.115042 ip-10-0-135-231 kubenswrapper[2575]: W0528 03:53:47.114890    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod55b7a96d_5c11_4d92_b7c3_c06b13ef28e4.slice/crio-98f8aaeb4311eb9f454248a63978a806bcd96c274fcf52a1292bc94181ba838e WatchSource:0}: Error finding container 98f8aaeb4311eb9f454248a63978a806bcd96c274fcf52a1292bc94181ba838e: Status 404 returned error can't find the container with id 98f8aaeb4311eb9f454248a63978a806bcd96c274fcf52a1292bc94181ba838e
May 28 03:53:47.529181 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:47.529135    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr" event={"ID":"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4","Type":"ContainerStarted","Data":"904270034dddc3966c2f94c58f7a60327ee999fdd8bef7ffa195517e534de777"}
May 28 03:53:47.529406 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:47.529189    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr" event={"ID":"55b7a96d-5c11-4d92-b7c3-c06b13ef28e4","Type":"ContainerStarted","Data":"98f8aaeb4311eb9f454248a63978a806bcd96c274fcf52a1292bc94181ba838e"}
May 28 03:53:47.529406 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:47.529294    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:47.546817 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:47.546768    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr" podStartSLOduration=1.546752169 podStartE2EDuration="1.546752169s" podCreationTimestamp="2026-05-28 03:53:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 03:53:47.544367934 +0000 UTC m=+2216.353383540" watchObservedRunningTime="2026-05-28 03:53:47.546752169 +0000 UTC m=+2216.355767814"
May 28 03:53:47.585014 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:47.584967    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59d5d9f79d-n96cs_f929c585-2f26-4c25-907e-6aeb218f3d6d/console/0.log"
May 28 03:53:48.120146 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:48.120119    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-s769d_23d5fcf8-ecbb-44f8-86ed-e9d0be4a5e49/volume-data-source-validator/0.log"
May 28 03:53:48.980920 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:48.980894    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nn7gp_042509a8-7606-4966-b8cd-f7c1385d7133/dns/0.log"
May 28 03:53:49.005653 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:49.005623    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nn7gp_042509a8-7606-4966-b8cd-f7c1385d7133/kube-rbac-proxy/0.log"
May 28 03:53:49.052720 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:49.052695    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vdkz_9306d75d-c142-4179-a7f5-4a85d5a21651/dns-node-resolver/0.log"
May 28 03:53:49.569999 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:49.569971    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gnkmn_a33c77e1-ff1e-44d0-b195-4c6935500e52/node-ca/0.log"
May 28 03:53:50.414461 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:50.414433    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b85mn5_59e97508-cf5e-4335-9a45-e436c26f5b58/istio-proxy/0.log"
May 28 03:53:50.714800 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:50.714770    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-flhth_81eae5c7-a4b5-4f4a-968d-40fbc1e21ee7/istio-proxy/0.log"
May 28 03:53:50.851857 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:50.851825    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d5f966876-bmt5s_dd0e16eb-b462-4bcd-9a50-25cd8fd20630/router/0.log"
May 28 03:53:51.457617 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:51.457589    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zcw8f_f68961e5-5c22-4c5f-8c04-de41cd10e8e1/serve-healthcheck-canary/0.log"
May 28 03:53:51.901233 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:51.901159    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7hpnb_bd10b71d-52e4-4b82-adc7-e6af5ce4ef94/insights-operator/0.log"
May 28 03:53:51.902599 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:51.902580    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7hpnb_bd10b71d-52e4-4b82-adc7-e6af5ce4ef94/insights-operator/1.log"
May 28 03:53:51.922095 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:51.922059    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4f2dr_330a701c-1d95-4913-8e7b-766b2e127d7e/kube-rbac-proxy/0.log"
May 28 03:53:51.940813 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:51.940790    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4f2dr_330a701c-1d95-4913-8e7b-766b2e127d7e/exporter/0.log"
May 28 03:53:51.961313 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:51.961288    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4f2dr_330a701c-1d95-4913-8e7b-766b2e127d7e/extractor/0.log"
May 28 03:53:53.544122 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:53.544090    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q6qd7/perf-node-gather-daemonset-bbjfr"
May 28 03:53:54.220978 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:54.220952    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665650-xk4mw_40e457b5-6621-46f1-af80-ef8943568ecc/cleanup/0.log"
May 28 03:53:54.243483 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:54.243451    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665665-k2xvn_e463f75f-2fef-45d3-bc83-0fa179eaf491/cleanup/0.log"
May 28 03:53:54.476833 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:54.476709    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cd789dcd-bnb9p_ae649575-c446-4123-903a-eacdeb311582/manager/0.log"
May 28 03:53:55.861610 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:55.861521    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8546f974ff-x5cws_04375827-72ed-4a59-a1dc-d700a5dad4d5/manager/0.log"
May 28 03:53:55.890532 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:53:55.890487    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-lz9wr_e5cda5d8-728d-487a-bb31-58e1aab51e91/openshift-lws-operator/0.log"
May 28 03:54:00.126228 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:00.126199    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-r9sj7_f5c867ec-5254-4d45-bec2-57bf61202682/migrator/0.log"
May 28 03:54:00.149016 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:00.148982    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-r9sj7_f5c867ec-5254-4d45-bec2-57bf61202682/graceful-termination/0.log"
May 28 03:54:00.518149 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:00.518120    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-q5vw5_797d1fdc-5aa3-48cb-9e36-27c72b6c1b75/kube-storage-version-migrator-operator/1.log"
May 28 03:54:00.519174 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:00.519147    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-q5vw5_797d1fdc-5aa3-48cb-9e36-27c72b6c1b75/kube-storage-version-migrator-operator/0.log"
May 28 03:54:01.700116 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:01.700090    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5k4fz_805b37cd-8d3c-461c-91af-031e41196836/kube-multus-additional-cni-plugins/0.log"
May 28 03:54:01.719895 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:01.719873    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5k4fz_805b37cd-8d3c-461c-91af-031e41196836/egress-router-binary-copy/0.log"
May 28 03:54:01.741300 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:01.741269    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5k4fz_805b37cd-8d3c-461c-91af-031e41196836/cni-plugins/0.log"
May 28 03:54:01.760763 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:01.760738    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5k4fz_805b37cd-8d3c-461c-91af-031e41196836/bond-cni-plugin/0.log"
May 28 03:54:01.781003 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:01.780982    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5k4fz_805b37cd-8d3c-461c-91af-031e41196836/routeoverride-cni/0.log"
May 28 03:54:01.809897 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:01.809867    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5k4fz_805b37cd-8d3c-461c-91af-031e41196836/whereabouts-cni-bincopy/0.log"
May 28 03:54:01.825715 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:01.825675    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5k4fz_805b37cd-8d3c-461c-91af-031e41196836/whereabouts-cni/0.log"
May 28 03:54:02.019055 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:02.018961    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qbmnf_42005029-cee3-4b35-95c2-cfe92bdaa774/kube-multus/0.log"
May 28 03:54:02.158571 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:02.158531    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrh6v_ce717d11-92f8-498b-a97e-2112e10126e4/network-metrics-daemon/0.log"
May 28 03:54:02.181061 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:02.181034    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrh6v_ce717d11-92f8-498b-a97e-2112e10126e4/kube-rbac-proxy/0.log"
May 28 03:54:03.252317 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:03.252277    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-967gw_a0f3b5fb-111e-4ab5-a883-8abb2b7874f3/ovn-controller/0.log"
May 28 03:54:03.282524 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:03.282498    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-967gw_a0f3b5fb-111e-4ab5-a883-8abb2b7874f3/ovn-acl-logging/0.log"
May 28 03:54:03.304635 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:03.304609    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-967gw_a0f3b5fb-111e-4ab5-a883-8abb2b7874f3/kube-rbac-proxy-node/0.log"
May 28 03:54:03.324758 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:03.324737    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-967gw_a0f3b5fb-111e-4ab5-a883-8abb2b7874f3/kube-rbac-proxy-ovn-metrics/0.log"
May 28 03:54:03.341363 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:03.341338    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-967gw_a0f3b5fb-111e-4ab5-a883-8abb2b7874f3/northd/0.log"
May 28 03:54:03.361740 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:03.361719    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-967gw_a0f3b5fb-111e-4ab5-a883-8abb2b7874f3/nbdb/0.log"
May 28 03:54:03.381030 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:03.381004    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-967gw_a0f3b5fb-111e-4ab5-a883-8abb2b7874f3/sbdb/0.log"
May 28 03:54:03.487885 ip-10-0-135-231 kubenswrapper[2575]: I0528 03:54:03.487847    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-967gw_a0f3b5fb-111e-4ab5-a883-8abb2b7874f3/ovnkube-controller/0.log"